Embedding 3d building rendering into drone footage. How?

[Anonymous]

Hello,

we'd like to add a building rendering into drone footage. What is your ideal method for this?

We've found a vague description on Youtube in the comments:

1) Use SynthEyes to analyze the video. It creates "3d tracking points" and a 3d camera based on the video's field of view & motion.

2) That information can be imported into a 3d program - we use 3dsMax.

3) The 3d model of the building is then lined up with the tracking points in the 3d software.

4) The video file is placed in the background so help with aligning. Render the scene with the video as the background, but also render as PNG files - so there is no background. (keeping the video in the background will help eliminate ghosting around the 3d model)

5) Do the final composition in Adobe After Effects (or something similar). Having the modeled building separate from the background will help with color adjustments.

That's already a great start but obviously misses a few steps and details. Are there any tutorials out there that would help me getting started?

Do you guys use Syntheyes too or does the built in camera tracker in After Effects do a similar or better job?

[RobH2 · Accepted solution]

Here's a start. 

https://www.google.com/search?q=3d+camera+matching+tutorials&rlz=1C1SQJL_enUS769US769&oq=3d+camera+m...

This subject is way too much for a forum to handle as far as telling you what to do. You are going to have to watch a ton of tutorials and maybe get a demo of some 'matchmoving' software. Syntheyes, is one of the more affordable. Some of them cost as much at 10K, but the movie houses use those. Syntheyes is not for the faint of heart. I've spent many hours with it and I still struggle with it. But, if you can finally wrap your head around it, it's very powerful and probably your best bet. 

There are also some good plugins for After Effects that go beyond its native abilities. One is Boris FX Mocha Pro. 

Here's something else to get you started:  https://nofilmschool.com/2010/09/3d-matchmoving-for-after-effects-on-an-indie-budget-a-k-a-free

The question you are asking is one of the most difficult things to do. The only way to learn it is to get some software and dive into the deep end. There is no easy solution or easy answer. 

[10DSpace · Accepted solution]

@Anonymous 

I completely agree with @RobH2  comments.  Matchmoving is really hard to get absolutely perfect and the quality of the footage (in particular the number of high contrast points to track that stay in frame for long enough) has a big impact.  Stabilizing the footage first (before you do any tracking) in After Effects can help. There are also 2 books in my library that I have found helpful and depending on how perfect you need the shot to be, may be an additional helpful resource to you:

"Matchmoving  The Invisible Art of Camera Tracking" by Tim Dobbert

"The Art and Technique of Matchmoving"  by Erica Hornung

[Anonymous]

Thank you for your reply. I guess part of why I couldn't find video tutorials was that I didn't know the correct terms. I'll take a look at your links. Thanks!

[Anonymous]

Thank you for your reply. I'll check out those books.