Referential Integrity Spot-Checks Without Foreign Key Constraints
Spot missing references with a simple LEFT JOIN query pattern.
Tomasz Wielecki
Section
7 stories in Data Profiling.
Spot missing references with a simple LEFT JOIN query pattern.
Detecting when data silently changes between pipeline runs.
The right outlier detection method depends on your data's shape and what you're willing to miss.
Continuous null rate monitoring catches pipeline breaks before downstream users do.
Catching duplicates before aggregation prevents cascading errors across metrics.
Catch silent type conversions before they corrupt downstream data.
Cardinality ratios reveal whether a column behaves like a category, identifier, or unique key.