Description
This role involves designing and implementing large-scale solutions on the Databricks Lakehouse Platform, architecting comprehensive data pipelines for both batch and real-time processing utilizing Apache Spark and PySpark. The individual will also focus on developing scalable data ingestion, transformation, and data quality systems, along with implementing Medallion Architecture.
