dataops-lakehouse-platform

Live documentation, rebuilt by GitHub Actions from main on every merge. Nothing on these pages is hand-written: lineage, tests and quality numbers come straight from the CI build.

dbt docs and lineage

Every model, column, test and exposure, with the full lineage graph from raw TLC files to the gold marts the dashboards read.

Data quality report

Test results, quarantined rows by reason, row counts per layer, contract status and freshness for the latest build.

Source and CI/CD

dlt, dbt Core, Dagster, Terraform and the GitHub Actions workflows that test, deploy and monitor all of it.

NYC TLC files→dlt (frozen contract)→ raw / ADLS Gen2→bronze→silver + quarantine→ gold (enforced contracts)→Write-Audit-Publish→dashboards