Description
The Data Engineer will design, develop, and maintain scalable and reliable data pipelines on Databricks and cloud platforms, integrating databases, APIs, log files, streaming platforms, and external providers. The role covers ETL and ELT development, data transformation, governance, monitoring, performance optimization, data validation, reporting, and support for analytics, product, and machine learning workloads. It requires at least three years of data engineering experience, hands-on PySpark, Spark SQL, Databricks, Azure, and pipeline orchestration experience, along with SQL, DevOps, CI/CD, and streaming technology knowledge.
