Summary from listing
The employer is seeking a hands-on Lead Data Engineer to own and build the data architecture for an AI-driven product platform deployed across customer cloud environments. The role combines architectural leadership with hands-on engineering, including designing scalable data platforms, setting standards, reviewing code, mentoring engineers, and working with complex data and AI workloads. Required expertise includes Databricks, Delta Lake, Unity Catalog, Medallion Architecture, PySpark, Spark SQL, Python, SQL, Kimball dimensional modelling, dbt, Snowflake, Data Vault 2.0, Azure and AWS, LLM/RAG pipelines, embeddings, vector search, data governance, security, observability, cost optimization, Kubernetes, Terraform or Bicep, and CI/CD.
