Yes that works, however the problem is when I'm trying to create a perpendicular line to an existing line somewhere in the middle of the line but not exactly the middle 

I right clicked on Osnap  and then checked "perpendicular" and that seems to have fixed the issue !