Is there a way to create query points based on location and date imported?

[bill2NMLX]

What going on I have is three groups of points that were each imported on progressive days. We now have polyline boundaries around each date. But these points have some overlap from day to day with older points.  We would like to create a query or pt group of the latest points and only get the newest points ignoring the older ones that the newer ones overlap.

Is this possible in C3D using either a map query or maybe even programing with Dynamo? Any ideals of things to try would be greatly appreciated.

Thanks

Bill Neuhauser, P.E.

CGS LLC.

[Joe-Bouza]

Caveman approach: create the venn diagram of point group A and Point group B

Display the two boundaries and Point Group A. Change or remove the points in the overlap

If that were pseudo code I would say yes it can be programed

[bill2NMLX]

Problem is not the location of the points, it getting just the latest created points of the three that are overlapping.  Problem time stamp of import is not a property of a point nor point groups. 

[Joe-Bouza]

This is how I understood the question. Is this not correct?

[bill2NMLX]

[Joe-Bouza]

I assume these are civil3d cogo points? I do not think MAP queries apply to civil3d object but they do to shp and or sdf files.

you can export cogo to sdf then query by area.

Looking  at you diagram it looks simple enough to caveman... either way the query has to be given the boundary to omit. Which IMO would complete the task ala caveman.

I don't meant to over simplify your task ... the answer to query is YES it can be done

[ChicagoLooper]

Hi @bill2NMLX 

What does the initial, unadulterated, 'DATA' look like?

Are the points grouped by date?

8/1/2023 vs. 8/2/2023 vs. 8/3/2023.

Be careful drawing lines (borders) to segregate the points. They may, or may not, be a little sketchy because points, when physically shot in the field, might have crossed over your borders without you realizing it, and that would put your points on the wrong side of the line. 

If you lumped all the original data together, then you're out-of-luck because there'd be no definitive way to differentiate one group from another. If you can get the date the the points were acquired, then you could make three separate point groups.

Also, depending on your data you might be able to create a shapefile then query AND segregate by 'date of survey' then go from there.

Can you share your data?

[Neilw_05]

I don't have any datasets to experiment with, but in the points group properties there is an advanced query tab. Have you looked into that?

[Pointdump]

Hi Bill,
Just following here with interest.
I don't know where you'd look for a time/date stamp other than corralling those points upon import into date-separated point groups.
Dave

[Joe-Bouza]

Hi Dave, this is what I thought as well and thus the caveman Venn diagram approach. 

[ChicagoLooper]

@bill2NMLX wrote

<<…I have is three groups of points that were each imported on progressive days…>>
 And

<<…We now have polyline boundaries around each date...>>

You can use Overlay Analysis from the Planning and Analysis workspace. (Map3D Toolset, Analysis Tab.)

Create three point shapefiles, one for each survey. You have 3 surveys, correct? And create a polygonal shapefile for for the polyline boundaries. They are ‘closed’ polygons, correct?

Add the shapefiles to a your drawing. Next, overlay a point Feature Class (shapefile) with the polygonal feature class to perform an overlay. 

The result will be an SDF file where the two shapefiles overlap. You can keep the resultant SDF as is, or you can use MAPIMPORT command to turn the SDF into plain vanilla AutoCAD entities. The resultant SDF will contain data from both point and polygonal feature classes. 

You’ll need to perform a separate overlay for each point shapefile unless you combine all three groups together and add a Date of Survey field to differentiate the groups.

[Joe-Bouza]

@bill2NMLX , @Pointdump , @Pointdump , @Neilw_05 

What am I missing with this challenge? Pardon the horrible typos lol

[ChicagoLooper]

@bill2NMLX 

Your uploaded image is confusing. You can easily REDRAW the 'areas' of interest where you can include points you want and exclude points you don't.

Red=Points dated 8/1/23

Green=points dated 8/2/23

Blue=Points dated 8/3/23

The confusing part, based on your parameters which you described in red, is the black zigzag hatch area. Do they belong to the green or the blue group? Whatever, whatever. Your boundaries can easily be adjusted--they're plain vanilla polygons.

You can make three separate point shapefiles; one for each date. Then you can query based on location.

The result will be the points that are only inside the boundary. Since you mentioned you have three groups of points that were each imported on progressive days, you can make a separate shapefile for each group where each group represents a different day. You can query using any polygon and the query will only 'capture' only points falling inside the boundary.

If you delete the query for any reason, you can draw a new polygon and query the new one.  

[Joe-Bouza]

seemed to me any points before 8/3 in a composite boundary are to be removed.

[bill2NMLX]

Thank you to all those that have commented, I'm still trying to digest all the comments.  

Too add since my first post, I have learned that we can get the points in a XML file that would include the PTS and boundary.  Good news is that these are Autocad PTs and not C3D points so they can be queried with MAP without another major conversion step involved.   So bottom line is now I'm working on that pathway for now and will post when I come up with something.  Side note this all wouldn't be necessary  if C3D could paste donut surfaces without creating voids.  (I have another post on this)   Keep in mind this is on a huge project and doing surface pasting is leaving use with lots and lots of voids with every paste.  We do have a time consuming workaround but hoping this will avoid pasting of surfaces issue.

Thanks again for your ideals!

Bill Neuhauser

[Pointdump]

Hi Bill,
I guess it's up to me to ask the hard questions. What do these points represent? Are you using them for linework(breaklines) or for an as-built surface? What kind of project?
Dave

[Joe-Bouza]

Add the donut hole as a hide boundary(s)

[Joe-Bouza]

I'm sure its complicated and don't mean to minimize the task, but it appears to me you don't want the points earlier than 8/3 in some defined boundary. is that  Correct?

Why cant they be removed via this boundary, by selection? 

[bill2NMLX]

Problem with the Donut holes is that there are lots of donuts and lots of wasted time fixing each one.   For one there shouldn't be any donuts in the first place causing voids!  Thats something Autodesk should have fixed a decade ago!

Bill

[ChicagoLooper]

FWIW, I don't think your workflow is right.

Can you share you data? A better workflow can be developed for your surface b/c treating your TINN as a Donut just doesn't seem right. Maybe a sweet roll but not a donut.