Description
Prevalent AI is hiring a Lead Data Engineer as a contractor to lead the design and delivery of client data engineering projects. The role focuses on building and optimizing large-scale distributed data pipelines, diagnosing performance and failure issues, establishing storage strategies, creating reusable configuration-driven components, reviewing code, mentoring developers, and contributing to platform and delivery work. Candidates must have at least 10 years of data engineering experience, including 5 years of hands-on PySpark work on large-volume workloads, along with expertise in Spark internals, time-series data, Delta Lake or Iceberg, Python, and self-managed Spark clusters.
