2020- prestent / New York
Data Engineer
Maintained data pipeline up-time of 99.99% across 10 primary data sources using Spark, Kafka and Python
Automated ETL processes across billions of rows of data which redused manual workload by 50% mounthly
2016-2020 / Berlin
Data Engineer
Skills
- Airflow
- kafka
- Python
- Spark
- SQL