Description
The AWS Data Engineer will design and implement scalable, secure, and cost-optimized AWS data architectures for a Fortune 500 client program focused on financial master and reference data management. The role involves building ETL pipelines with AWS Lambda and Glue, developing PySpark applications, optimizing Apache Iceberg data lakes, orchestrating event-driven workflows, integrating Starburst, implementing CI/CD and unit testing, and connecting internal and external data sources. Required expertise includes AWS services, Apache Spark, Python, Kafka, and data lake technologies.
