Senior Data Platform System Engineer - Data Engineering Team (Data & AI) at SGPOWER

Level: senior
Posted: Aug 3, 2026

Summary from listing

SP Group is hiring a Data Platform Engineer to operate and evolve its enterprise data and AI platform, primarily Cloudera and Talend Big Data. The role manages large-scale Hadoop environments, cluster lifecycle, performance and capacity, DevOps automation, CI/CD, security, governance, and platform support for data engineering, analytics, and business teams. Candidates need 5–10 years of relevant experience, strong Hadoop and big-data platform expertise, and proficiency with Python, Bash, Terraform, Ansible, and related DevOps practices.

Required Skills

Cloudera CDP
Hadoop ecosystem
HDFS
Spark
Terraform
Ansible
CI/CD pipelines
Kerberos
Python
Bash

Additional Information

Required Previous Experiences: 5–10 years of experience in data platform engineering, big data operations, or infrastructure engineering
Hands-on experience managing Cloudera CDP and Hadoop ecosystem platforms
Experience with cluster operations, performance tuning, and troubleshooting
Proficiency in Python, Bash, Terraform, and Ansible automation and scripting
Experience with CI/CD pipelines and DevOps practices
Understanding of data platform security and access control concepts
Preferred Qualifications: Experience with Databricks, Talend, or hybrid data platforms
Knowledge of containerization and orchestration
Experience with streaming platforms such as Kafka or real-time processing
Familiarity with modern data lakehouse concepts such as Iceberg and Delta
Exposure to cloud or hybrid environments, with Azure preferred