You don't say what version of Inventor you're using, nor how much experience you have with Inventor.
The appearance of drawing dimensions is controlled by dimension styles. You edit those dimension styles in a particular document by opening the Styles Editor (Manage > Styles and Standards > Style and Standard Editor), selecting the Dimension style in question and looking at the Display tab (see below). The Extension and Origin Offset both look as if they could use some tweaking on your drawing.
Note that you could have more than one dimension style in use on your drawing, and note that any changes you make are made only in that one drawing file, until you save them to your Style Library. Once you do that, then you should open your drawing template file(s) and update their styles from the Style Library.
Sam B
Inventor Pro 2020.2 | Windows 7 SP1
LinkedIn