Description
The posting describes a Data Engineer responsible for designing, developing, and maintaining scalable data pipelines and systems. The role involves collaborating with data scientists, analysts, and cross-functional teams; implementing data integration and transformation with PySpark and Python; optimizing SQL databases and queries; and monitoring and troubleshooting pipeline issues to maintain data quality, integrity, availability, and performance.
