Summary from listing
The Data Analytics Engineer will design and develop data lake and data mart solutions, optimize existing Spark-based data processing pipelines for execution time and resources, build monitoring for those pipelines, and improve deployment strategies. The role requires strong Spark architecture knowledge, PySpark and Python programming, experience optimizing Spark solutions and deploying big data computing solutions, with Apache Airflow and time-series data processing as added advantages.
