I'm going to go out on a limb here and say you don't actually know what you are doing... but that's okay because getting the coordinates systems clear in your head isn't always the easiest thing for people...
you have 2 coordinate systems that you can control - Project and Shared.
the project coordinates are easy - you unclip your project base point and move it where you want it to be on your building - this gives you a 0,0,0 coordinate for your building. this makes providing site dims easy.
The Shared Coordinate system is a bit more tricky but still relatively simple so long as you know what you are doing. I generally find that having two files, one for your site model and one for your building (or more if you have multiple buildings on site).
In your site model you link in your survey data (use center to center) or something that allows you to locate your building in the real world - i.e. using eastings and northings. Once loaded use the 'specify coordinates at point' tool to, well, specify the coordinates at a known point. Check a few other known points to make sure you have this correct.
Now link your buildings in and locate them correctly on the site and simply publish the coordinates back to the linked building model.
Job done.
No worrying about how far anything is away from anything else.
"Give a man a fish and you feed him for a day; teach a man to fish and you feed him for a lifetime."
Maimonides