Bergfreunde
Bergfreunde GmbH
E-Commerce / Outdoor
·
2020 – 2022
https://www.bergfreunde.de ↗
Projects
Data Orchestration with Apache Airflow
2020–2022
For Bergfreunde, we rebuilt the data orchestration layer from scratch. The result was a unified orchestration system on Apache Airflow with a complete ETL pipeline spanning over 600 DAGs, including data modelling jobs. Bergfreunde gained a single engine that executes all data jobs on schedule with 100% consistency. Comprehensive documentation was produced for the handover, and a team of 4 data engineers was trained on the new platform.
Data Engineer
Google Cloud
Kubernetes
Apache Airflow
BigQuery
Python
Terraform