You don't need to set annotative to no. In the bottom right corner of your screen you'll see a scale symbol with a lightbulb. Turn that on and you'll see the text. Select all the annotative text you want to see in a particular viewport, right click and select "Add Current Scale". Then you can turn the Annotative Visibility (scale button with light bulb) back off if you want. If you have text you don't want to see in a viewport, select it, and select "Delete Current Scale" and it will no longer be visible in any viewport with that scale (as long as the Anno. Vis. is turned off). This lets you make each viewport look like you want without putting text on different layers and creating it in different sizes. You can also move the text in a viewport and it won't affect any viewports with different scales. It's very powerful, worth learning how to use it.