Summary from listing
The role is a senior Databricks engineer responsible for migrating and modernizing DB2/400 and Guidewire data into Databricks. Responsibilities include developing notebooks, jobs, and workflows; implementing Delta Lake and medallion architecture; integrating with AWS, Azure, ADF, Synapse, Key Vault, and Snowflake; optimizing clusters and queries; building incremental and batch pipelines; collaborating with Snowflake and dbt teams; validating data; and supporting SIT, UAT, and post-go-live stabilization. The role requires 8+ years of Databricks experience with legacy data ingestion, CDC or batch extraction, cloud storage, PySpark, Spark SQL, Scala, Unity Catalog, data governance, and serverless compute.
