Description
This job involves designing, reviewing, and developing PySpark scripts for data pipelines, testing, and troubleshooting. The role also includes creating reports and dashboards in PowerBI, establishing connections to various data sources like on-premise databases and IoT devices, managing data collection in diverse storage solutions, and deploying pipeline artifacts via Azure DevOps.
