Summary from listing
The role involves working within an existing British construction, services, and property group to build a data pipeline across three stages. Stage 1 focuses on business interaction, data discovery, ownership, access, and data dictionary mapping. Stage 2 covers Azure Data Factory, Azure Key Vault, RDBMS and API logic, data lake ingestion, Azure Data Bricks, Python, PySpark, SQL, Delta Lake, Hive, and SQL-based dataset shaping. Stage 3 involves Power BI consuming the loaded data from the data lake.
