Have you tried turning the Tabs off to see if that helps?
I catch a Tab form time to time when in the groove and it is only because I touched it and clicked.
For me it's down and right when doing a selection window or up and left when starting a crossing window.
It would be unusual for CAD to just switch spaces without something intervening.
Are you going to the actual model tab, or activating a viewport in the layout?
"...Not clicking on the tab..."
"...just flying the curser around..."
Double-clicking on a viewport outline puts you in VPMAX: a possible shortcut or screen icon/button accidentally triggered may be helping as well.
I suspect by "flying around" the OP may be doing more than that realize with delicate mouse button presses and clicking.
Access a broad range of knowledge to help get the most out of your products and services.