Description
The Databricks Engineer will design, build, and operate scalable batch and streaming data pipelines on the Databricks Lakehouse platform for federal mission needs. Responsibilities include developing Spark and PySpark pipelines, managing Delta Lake and Unity Catalog, implementing data governance and security, integrating ETL/ELT workflows, optimizing jobs, supporting machine learning and advanced analytics, and collaborating with cross-functional teams. The role requires a bachelor's degree or equivalent experience, at least four years of data engineering or big data development experience, and at least two years of hands-on Databricks experience.
