Data Quality

Databases & Data Engineering

Your Data Pipeline Cannot Be Rerun and That Is a Design Flaw

Pipelines that append on every run cannot be safely retried. Making each run replaceable rather than additive is what makes…

Read More »
Databases & Data Engineering

An Upstream Field Rename Breaks Your Pipeline Silently, Not Loudly

A pipeline reading a field that got renamed upstream does not error. It reads null for a field that used…

Read More »
Back to top button