Description
Viaduct is hiring an early data engineer to build and maintain batch, incremental, and real-time ETL pipelines for connected vehicle data. The role focuses on data quality, ingestion, validation, schema management, Spark optimization, and client integrations, with responsibilities including security and privacy compliance. Candidates need at least three years of data engineering experience, experience as a tech lead or mentor, proficiency in Python, Scala, Java, C++, and SQL, and experience with Spark, workflow schedulers, distributed file systems, and incremental or real-time processing technologies.
