Often when working with architectural models, they come in at zero and we leave them there for the working scene, then in our master render file bind them to a parent dummy object to move them around. This lets us position things in the local space of the building and makes modelling a bit easier.
When it comes to adding detail, such as interiors and furniture these get added as a nested xref again, so that everything is together and we aren't repositioning lots of different files.
With me so far?
Back in the master file, everything is loaded in. I need the buildings for camera matching but do not need the furniture inside them loaded in whilst I'm camera matching.
It would be great to have the option to ignore the nested XRefs to keep the scene light whilst I'm camera matching and then enable everything again at render time.
Another option would be to duplicate the positioned Xref and then change the path to the furniture xref.
If this needs clarifying then do say. I'll try and explain better.