Description
The role leads the migration of legacy enterprise data platforms to Databricks on strategic cloud platforms, including application, data, and pipeline refactoring, migration planning, cutover strategy, and transition to cloud-only execution. Responsibilities include designing Databricks Lakehouse architectures, building batch and streaming pipelines with PySpark and Spark SQL, using Delta Lake, implementing data quality and reconciliation controls, enforcing security and governance, and enabling reporting, analytics, and AI/ML workloads. The position requires 8–12+ years of data engineering or platform modernization experience, strong Databricks and Spark expertise, and experience with cloud migration programs in regulated environments.
