Description
ShyftLabs is hiring a Data Engineer to design, develop, and maintain scalable ETL/ELT pipelines on the Databricks Lakehouse Platform. The role involves integrating data from databases, Amazon S3, files, and REST APIs; building Unity Catalog and Delta Lake solutions; implementing data transformations and models; scheduling and optimizing Databricks jobs; and ensuring data quality and performance. Candidates need strong Python, PySpark, SQL, Databricks, AWS, and REST API experience, along with data modeling, warehousing, Git, and CI/CD knowledge.
