Description
The Data Engineer will design, build, and optimize scalable ETL/ELT pipelines using Python and PySpark on Azure Databricks and Azure Data Factory. Responsibilities include data ingestion and transformation, data quality and monitoring, OpenShift and Azure infrastructure management, GitHub Actions CI/CD, SQL and data modeling, performance optimization, and documentation. The role requires 6–8 years of relevant experience and strong proficiency in Python, PySpark, SQL, Azure data services, and related data engineering practices.
