Hi Brian, for this part:
> A 3 inch dimension will show up as 7.997369 cm, which equals 3.14857 inches, not 3 inches.
Are you referring to this one here?
That is displayed as 3" because the fractional precision is set to round to the nearest half inch, here (under "Details...") :
You're comparing a high accuracy decimal setting with a low accuracy fractional setting.
With a "Fractional display" of 1/2, the displayed result will be rounded to the nearest 1/2 inch.
The distance is 7.997369 centimeters which equals 3.1485704724 inches.
With a fractional precision of 1/2 inch, it will round 3.1485704724 to either 3" or 3 1/2" whichever is closest and 3" is closest.
If you want more accuracy in the feet & inches display you need to adjust the "Fractional display" to be smaller so that it will round to the nearest 1/16 or finer.
Does that help?
- Michael
|