Back to work2025
referenceData Engineering · ML prep
End-to-End Recommender Data Pipeline
Sole builder — reference architecture
Contract-first data pipeline: Airflow, Great Expectations, AWS Kinesis/S3, Terraform.
Problem
Retrieval systems are only as good as the data reaching them.
What I built
ETL/ELT workflows with Airflow DAGs, data-quality gates with Great Expectations, AWS integration, Terraform, and a mock-services mode.
Outcome
Reference architecture showing contract-first pipeline design.