Dimension Linear Tool - Scale Problem

Hello, 

I am trying to add a Linear Dimension annotation to a line, but it turns out that the annotation is too big for the sheet where I am trying to add it (The numbers, the arrows and the line are huge!). I tried changing the Annotation Scale but it changes everything in the drawing. How can I just change the scale of the annotations alone and not the drawing elements and such? Help is much appreciated! 

Thank you, 

Enrique