I have used this feature in other softwares.
You have a clean mask/key of a figure shot with in front of a chroma wall with trackers, you place your null/object/box inside the clean white mask, and it will remove all disconnected objects/spots/masks outside this mask.
May be it exists, may be not
Thanks Smokers
I know you will not accept this as an answer, but I tried it in a in-house compositing software at BUF a VFX company in Paris.
They are supposed to release their softwares for the masses but it didn't happen yet.
But I am quite sure I used this function in another soft, but I am not sure may be (Nuke-Shake-AE...etc.)
Thanks
chadi --
Is this what you're trying to do? See pic.
Add another mask inside of your Gmask.
Yes, that makes sense.
But, I don't know of anyway of doing that in Smoke other than creating a mask and tracking it inside or outside of the key.
Sorry.
Can't find what you're looking for? Ask the community or share your knowledge.