I don’t know about you guys, but sometimes when I Shift + Right-Click, I’d really like the selection to target the assembly instead of the component pattern.
If you actually want to select the pattern, that could be handled with a separate selection mode something like “Component Pattern Select.”
Another option would be to keep the current selection priority, but make doubleclick open the assembly rather than the pattern.