Import of Large .tif or .png Images

[Anonymous]

I've received a Raster image that opens correctly in ArcMAP.  I'm trying to import this image into Civil 3D 2019.  My normal mode of using MAPIINSERT results in an error: "[Imagename].tif was not found or is not valid."  

I originally received a JPEG-compressed TIF.  This image was 514 MB.  It opens and displays in ArcMAP rather effortlessly, but will not import in C3D when I use the MAPIINSERT command.  It will not XATTACH. If I attempt to use DataConnect, the dataconnection seems to succeed, and there is a long delay between adding the image and getting control of my cursor again, but when I zoom extents, nothing is visible.

I requested an uncompressed TIF.  This image was 7.5 GB. It opens and displays in ArcMAP (though much more slowly), but has all the same problems as the previous image.

I converted both the compressed and uncompressed images to .png using ArcMAP. The .png will import using MAPIINSERT, but only displays as a blank image with a visible frame.  I have likewise attempted data connections with this image but the result is the same - it appears to add to the map correctly, but when I zoom extents, nothing displays.

I have attempted to convert the compressed and uncompressed TIFs to JPEGs using ArcMAP, but the conversion engine fails instantly.

I'm out of ideas - can anyone help?  I'd attach the images but they are proprietary and enormous.  I could perhaps provide a version of the image via a private message.

[AllenJessup]

Try adding the image through Data Connect (FDO) 

https://knowledge.autodesk.com/support/autocad-map-3d/learn-explore/caas/CloudHelp/cloudhelp/2019/EN...

[Pointdump]

Travis,
Try converting that Tiff to ECW Format in ArcMap. I read somewhere that Civil 3D handles large images best with the ECW Format.
Dave

[ChicagoLooper]

When you use the Data Connect palette, what is shown under the Coordinate System column? Or does it display <unknown>?

Have you assigned a coordinate system to your map? Is the CS relevant to the map area?

[Anonymous]

I've been trying to do that, but the conversion fails every time, whether I use ArcMap or IrfanView 64 to attempt the image conversion, and whether I use the JPEG-compressed TIF, the uncompressed TIF, or the .png as the source image.  I'm wondering if there's just a file size limit on some of these softwares; the uncompressed TIF is 7.5 GB.  Every software seems to be balking at the file size (but that's just a theory).

[Pointdump]

Travis,
"Every software seems to be balking at the file size"
If IrfanView couldn't convert it, maybe there's something whack with the image. Have you tried QGIS and GeoViewer? I think you'd need the Pro Version of Geoview to convert to MrSID, but that would help on image size.
Dave

[Anonymous]

I've attempted to use DataConnect.  The greatest success I've achieved is a large rectangular boundary with no image inside.  This was from connecting to the .png file, which itself was converted from the JPEG-compressed TIF.

[Anonymous]

You can see the coordinate system in the attached image.  When I load the image into ArcMap, this is the coordinate system it chooses for the image.  After clicking "Add to Map", the program hangs for a long time, then displays a progress window that states: "Adding layers..."  When this completes, the drawing is blank, or, at best, has a rectangle with nothing inside it.  Please see the attached images.

As proof of concept, I've also included a screenshot of the image in ArcMap, where it loads effortlessly in < 5 seconds.

[Anonymous]

If there's something wrong with the image, why is it displaying perfectly in ArcMap?

[Pointdump]

Travis,
"...why is it displaying perfectly in ArcMap?"
Then it probably is a size-limitation problem in C3D. Does the image load in QGIS or GeoViewer?
Dave

[Anonymous]

I just downloaded QGIS and yes, it displays perfectly in this software.  See attached screenclip.

See attached for my greatest success to-date. Blank image with rectangular boundary, from the .png (5.15 GB).

I've requested a tiled image set from the image provider.  Perhaps I'll have better luck with a series of images as opposed to one massive image.

Does anyone know what the image size limit is for these files? Obviously if I knew there was an image size limit, I'd break the image into tiles that are small enough for CAD to digest.

[Pointdump]

Travis,
You can Crop or Tile an Image in QGIS. The free version of GeoViewer easily Crops an Image, and maintains the Hi-rez, but only the Pro Version will Tile.
Reluctant to ask you for the image, as it might be proprietary, but is there any way you can share?
Dave

[ChicagoLooper]

OK. Your image has 'voids' or those black areas devoid of colored pixels. Those black areas were added on by Map 3D to the image to give it a rectangular, non-rotated shape. The 'sides' of the pixelated image should be vertical and the top and bottom horizontal. While many programs can handle imagery with voids, AutoCAD cannot. I've seen this happen first hand, e.g. typical drone imagery has black voids.

To resolve, you can use third party software (in the past, I've used Global Mapper) to trim or divide the image into homemade tiles. See image-1.

1-Outline of 'homemade tiles.''

Once you decide on the number and position of your tiles, then trim so you get a rectangular, non-rotated image like shown below. (Not necessary to draw the red polygons, they're merely shown for descriptive purposes.) Image-2.

2-Trimmed tile.

Keep the individual tiles in the same geospatial context as the original image. Once you have the tiles, use Data Connect palette to combine the individual tiles. Image-3.

3-Using Data Connect Palette, combine tiles to one layer. 

[Pointdump]

Travis,
"Does anyone know what the image size limit is for these files?"
I've heard 2GB, but that's just skuttlebutt.
I think @ChicagoLooper is onto something about voids. (Irregular shapes, too, like drone images) So even requesting a tiled image set from the provider might not be a complete solution. I'd opt for custom, do-it-yourself raster clipping. GeoViewer can clip a hi-rez zoomed-in view, and create a world file, as fast as a finger snap. QGIS can clip a geo-referenced raster image also, but with more steps. You first need to create a rectangular polygon shapefile with which to clip the raster.

Dave

[ChicagoLooper]

Hi @Pointdump. I don't know if you remember..........here's a blast from the past. It was back in Jan. 2019 in another C3D post titled C3D 2019 Image Insertion/Projection Issue, and believe it or not, you were there. This post had to do with drone imagery, the 'black voids' (in this case it was gray not black) and how to create tiles using 3rd party software. Here's a >>LINK<<  for a refresher.

[lynn_zhang]

Hello @Anonymous ,

Just checking to see if your problem has been solved. Did the suggestions from our experts above help? Let us know if you still need help. Thanks!

[Anonymous]

I have received individual TIFF tiles; some of these, such as the attached, do not have the apparent void spaces discussed.  They still will not import into CAD.

I thought that perhaps the issue was that the tile itself does not have a .tfw file associated with it - this metadata is contained within the image but I thought perhaps CAD would need a separate file to perform a proper import.  I used OSGeo4W Shell and the listgeo command to write a .tfw for the tile shown.  I continue to receive the error: "<filename> was not found or is not valid."

I have attempted to use DataConnect to import this image. Still no success.

I have converted the tile image to a jpg successfully and I have been able to import that image.  Were I to import these tiled images, however the differences in coloration from tile-to-tile render the image ultimately unusable.  It is also not possible for me to crop the image in such a way that I retain all the data I need, but hold to the requirement of rectangular images.

I also cannot share the images because they are, even in tiled form, hundreds of megabytes, and even if I could share them, I probably shouldn't, as they are proprietary.

At this point I feel I can safely say that AutoCAD simply cannot accept this image, or any functional form of the image, and I can't afford to spend more time trying to get this to work. 

[Anonymous]

No, my issue has not been solved, but I can't afford to continue down this rabbit hole.  The image displays perfectly and effortlessly in ArcMap - I will use ArcMap to generate whatever images I need.

[ChicagoLooper]

If you received tiffs, please upload the exact same tiffs, not replacements such as jpg.

For the time being, please forget OSGeo and converting the images to jpgs. The jpgs can easily be reproduced on this end if they are needed.

Please upload exactly what your received so accurate troubleshooting can take place so the issues you face can be replicated and resolved. So sorry, but 'replacement' copies such as jpgs won't help in troubleshooting.

[Pointdump]

Travis,
"...AutoCAD simply cannot accept this image, or any functional form of the image..."
"The image displays perfectly and effortlessly in ArcMap - I will use ArcMap to generate whatever images I need."
It's OK to say that AutoCAD doesn't work well with heavy data. You definitely wouldn't be the first. (LiDAR Point Clouds are a big sore spot around here.) But I guess I just don't understand exactly what you need to do with these images. If you can do everything you need to do with ArcMap, then that is the right software to use. If these images are to be used as background for design work in Civil 3D, then you'll need to Convert, Crop, or Clip them to be usable. And if ArcMap can't give you a C3D-usable cropped image, then QGIS, GeoViewer, Global Mapper, TatukGIS, etc. can give you a georeferenced (either embedded or world file) image that Civil 3D can use. Without seeing what you see, though, all we can offer are SWAG's.
Dave