Description
The role builds and maintains a Databricks data platform for cost and usage attribution, including scheduled ingestion of logs, APIs, SaaS usage, billing exports, and reference data into bronze, silver, and gold layers. Responsibilities include implementing attribution and allocation logic, Unity Catalog governance, data-quality monitoring, CI/CD, and performance and cost optimization of Spark workloads. The role requires advanced Databricks engineering, Python, PySpark, SQL, REST-API ingestion, cloud object storage, and Git-based development.
