Summary from listing
The Data Engineer, Advanced Analytics Platforms will design, test, deploy, and maintain production big-data ingestion pipelines that move structured, unstructured, and semi-structured data from process and operational stores into on-premises and cloud-based data lakes. The role includes data validation, profiling, cleansing, enrichment, version control, CI/CD, code reviews, and DevOps monitoring, while collaborating with data source teams, domain experts, application developers, controls engineers, and data scientists. The position requires a bachelor's degree in a technical discipline, production programming in a modern JVM language and Python, AWS experience, and familiarity with Apache Spark, S3, Parquet, Delta Lake, relational and polyglot persistence, agile development, and related tools.
