Precision
Overview
Precision is the level of detail or exactness in spatial data, often referring to the number of decimal places in coordinate values or the resolution of raster data. Precision describes the consistency of repeated measurements and should not be confused with accuracy (closeness to true value).
Key Concepts
Coordinate precision is the number of decimal places in coordinate values. Measurement precision is the repeatability of observations. Floating-point precision relates to computer storage of decimal numbers. Significant digits are meaningful digits in a measurement. Accuracy vs. precision - accuracy is correctness; precision is consistency.
Coordinate Decimal Places
| Decimal Places | Approximate Precision |
|---|---|
| 0 | 111 km |
| 1 | 11 km |
| 2 | 1.1 km |
| 3 | 111 m |
| 4 | 11 m |
| 5 | 1.1 m |
| 6 | 11 cm |
| 7 | 1.1 cm |
Appendix
Created: 2025-12-13 | Modified: 2025-12-13