Well I ended up just deleting the prefix to each layer, one by one. And there were a lot of layers, so that's why it took me a month to follow up. The scale cleanup and nested Xrefs investigation didn't fix the issue, but so far it hasn't happened again either, so maybe it was a preventative measure.