The Data Engineer will build and operate the storage, compute, orchestration, loading, cataloging, quality, and monitoring systems that support petabyte-scale physical-data ingestion and training. The role covers lakehouse architecture, Spark and Ray, batch and streaming pipelines, data formats such as Parquet and Zarr, cloud infrastructure, and end-to-end optimization of data throughput for large-scale training.
Every query opens live roles, salary samples, and market demand — tap a search to run it instantly.
Unlock powerful job search, personalized recommendations, and deep career insights from comprehensive, market-leading data and live market signals.
For job seekers
Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.
Match
Compare live roles against your current evidence.
Position
Turn proof projects into role-specific applications.
Improve
Use market feedback to keep the skill plan current.
Causal Labs is building a Large Physics foundation Model (LPM) to learn causality through physics and weather
.png&sig=GmGZl0hIEC4KeSLZOLIDYB_qjM5Xym0OKo-pzrtoUqQ)