Description
This job involves implementing ETL/ELT solutions, designing and maintaining data pipelines, ensuring data security and compliance, and optimizing data processing systems. The role requires collaboration with other teams and applies various data transformation, cleaning, and aggregation tasks. It also includes understanding and applying software design principles, data modeling techniques, and optimizing PySpark and SQL query performance.
