Data FormattingSTD_2043v1

Numeric Precision for Measurements

Ensures measurement data is stored with appropriate precision for engineering requirements.

Owner: Unassigned

Updated: 10/31/2025

Business Rule

Insufficient precision causes quality issues; excessive precision wastes storage and creates false accuracy.

Technical Implementation

Define precision requirements per measurement type. Dimensions: 0.1mm, Weight: 0.01kg, Temperature: 0.1°C.

Examples

Good practices vs common violations

Good Examples

Length: 1234.5 mm

Weight: 567.89 kg

Poor Examples (Violations)

Length: 1234 mm (insufficient)

Weight: 567.891234567 kg (excessive)

Additional Information

Target Industries

Heavy ManufacturingEnergy & UtilitiesMining

Status

active

Local Network

DQ Improvements

Data quality dimensions improved by this standard

Precision (2 - Statistical Spread)

high

The degree to which the error in data values spreads around zero (in statistics).

Type: prevents

Precision (1 - Recording Accuracy)

high

The degree of accuracy with which data values are recorded or classified.

Type: prevents

Quick Stats

Related KPIs0

DQ Improvements2

Versionv1

API Access

GET /api/standards/numeric-precision-for-measurements