Need to composite a F360 model onto 2D image with matched perspective and shadow

[glitchform]

Hello everyone,

I am working on a project that requires me to take models from Fusion 360, render them, and composite them onto a 2D image. I need the following functionality that I do not believe is easily available directly within Fusion:

- I need to place a 2D image as a background canvas for reference to match the perspective of the 3D model to the 2D image

- I need to match the lighting on the model to that of the image

- I need to somehow then composite the 3D model and its shadows to the 2D image (or to at least render it and the shadow on a transparent layer for further compositing in Photoshop)

In the past I was able to accomplish all these things by taking the models as .obj files and importing them into Blender. HOWEVER, this was a one-model job and I spent hours organizing all the different randomly-named parts into parent groups so I could then apply materials to those groups. This time I will have to be working with many different models so the above workflow is out of the question. 

I have tried Thea and Keyshot plugins for Fusion 360 but neither one works. Thea doesn't run at all, and the Keyshot plugin crashes Fusion. 

So if any of you have any ideas on how to accomplish the above, I am all ears!

Perhaps there is some workaround within Fusion to help match perspective?
Or maybe there is a way to export an .obj file so that it retains the structure and the naming of the Fusion file?

Thanks a bunch. 

[Phil.E]

Hi,

Sounds like a fun project.

In Fusion the only way to have a custom background for rendering is to import it as HDR. This takes care of lighting and background.

You can import HDR via the Settings dialog (Environment Library tab) in the Render work space. The command is called "Attach custom environment". There is also a setting to display the background.

Matching Perspective is going to be a manual process.

Please let me know if you have more questions.

Thanks,

[mcramblet]

Can you post an example, to better illustrate what you are trying to achieve?  It would be helpful to see the types of models and images you are working with and what the outcome is to be.

[glitchform]

Hello Phil, 

Thanks for taking the time to answer. The 2D images I am supplied are basic jpegs, so I am assuming that it is impossible to turn them into HDRs. Or am I wrong?
If it is possible to turn them into HDRs then perhaps I would be able to match perspective manually, but even if that works, I would still need to create custom lights to match the lighting quality and the shadows of the photo, and then I would need to render with the model composited onto the background. 

In the ideal world I would just use a stand alone renderer that imports .STEP files. Are there any other ones apart from KeyShot (too expensive) that can do that? I am looking at VRED and Thea at the moment but have not quite figured them out yet. 

The one thing I don't get is this - there are tons of amazing renders out there where the source model must have been built with parametric/solid modelling (automotive/architecture). Is the only way to get those models inside of powerful renderers to convert them to meshes? If that is the case, then how do people retain object separation for easy material application? When I export my Fusion models as OBJ, for example, I just get hundreds of loose and unnamed parts. 

HOW DO PEOPLE DO THIS? There seems to be a surprising lack of info on this topic on the internet. Professional secret? 🙂

Thanks a bunch.

[glitchform]

Hello, thanks for chiming in. 

The models I am working with are basically steel installations the size of a bus stop that need to be composited into the environment of the client's choice. The 2D environment images are basic smartphone snapshots of the locations, and I need to place the Fusion models realistically into those locations. With KeyShot it is easy as pie, but the price is too high. Hence, looking for alternative renderers that can import STEP files.

[mcramblet]

I use Keyshot Pro and have done similar things to what you are referring to. You're right, it's pretty easy to do in Keyshot.

There aren't all that many choices when it comes to standalone rendering software, only a couple that play nicely with native CAD files, that I'm aware of. The only two that I've used are Keyshot and SolidWorks Visualize (formerly Bunkspeed), although I did look at VRED at one time. To my knowledge, Keyshot is the least expensive of the three, for a commercial license. Visualize is very similar to Keyshot, a simple interface and controls for the non-CGI person who needs to create renderings. It's not only more expensive than Keyshot, its library of materials isn't nearly as good. I can't say much about VRED, other than it's too expensive for the license that I'd need.

I've looked at rendering engines that have plug-ins for Rhino, which I also have. All of the big names in rendering have Rhino plug-ins and I've tried them all. Even from within Rhino, I find them much more difficult to use, compared to Keyshot. It also a pain to export from Fusion, import into Rhino (which sometimes has a problem with STEP files that have complex geometry) and than try to render with a 3rd party rendering engine. Of course, if you don't already have Rhino, that's 2 purchases, Rhino and the renderings engine, and the learning curve associated with both pieces of software.

I've tried Thea with Fusion 360 and it was ok, although I didn't deep dive into it. Now that Thea has been acquired by a CAD competitor, I'd be hesitant to purchase it. I don't think the Fusion plug-in is available anymore, which is what made Thea a decent workflow.

These things are why Keyshot is popular, it can work with just about any kind of file (CAD or otherwise) and it's easy to use by those who's primary jobs are something other than CGI artists.

As you can see, I don't have any good alternatives to Keyshot that I can offer.

[Phil.E]

@glitchform

I think all the major points are covered here. I did want to answer your question: you can convert JPG to HDR according to Google. I cannot recommend any of the solutions, having not tried them, but it appears to be solved out there. I have rendered against flat HDR images before.

Thanks,

[glitchform]

@Phil.E @mcramblet

Thank you for your suggestions and clarifications. You have given me some more options to explore.

Best wishes.