Yes - the belt has to have little slack in order for it to register on the gauge molded into the belt guard. If it's really loose, you'll "(EDIT)?" trying to figure out where to start the measurement.
Please read and understand the info in this link...