Description
The Data Engineer will design, build, and optimize Databricks and Apache Spark data pipelines and ETL/ELT workflows for the AMAT client in Bangalore. The role involves developing scalable distributed data solutions, leading automation and platform modernization, managing CI/CD and Git workflows, ensuring data quality and security, troubleshooting Spark and Databricks workloads, and developing reusable engineering frameworks. Candidates need at least five years of Data Engineering experience, strong Databricks and PySpark expertise, Python and SQL proficiency, and knowledge of Databricks Genie and distributed systems.
