Having an organized library is important for ease of access - in many cases, we have enormous catalogs of detail items being used. In long-running projects, it can be a hassle to sort through the detail objects already loaded into a file to try to find the right one. Even when every object loaded is necessary, it can be burdensome. What if the component dropdown for inserting detail items had a tree option for custom organization, similar to the project browser?
If you are looking for just fasteners, you can catalog detail components as Fastener, then there's an expanding file tree that lets you minimize annotation, framing elements, etc., to locate families faster.