Big Data Engineer

We’re looking for a skilled professional with experience in the following areas:

Location: Onsite - Singapore

5+ years of experience in building or designing large-scale, fault-tolerant distributed systems (e.g., data lakes, lakehouses, streaming solutions)

Strong knowledge of distributed technologies: Hadoop ecosystem, Kafka, Kubernetes, Spark

Hands-on experience with storage migration (e.g., HDFS to S3 Object Storage)

Expertise in both streaming and file-based data ingestion/consumption using tools like Kafka, Control-M, and AWA

Proficiency in DevOps and automation using tools like Jenkins, Octopus (plus Ansible, Chef, XL Release/Deploy as a bonus)

Strong programming background in Python and Java (Scala/R a plus), plus scripting in Linux/Unix, Jinja templates, Puppet

Experience with VM setup and scaling, Kubernetes pod management, Docker (Harbor), and image deployments via CI/CD

Familiarity with modern data formats: Parquet, ORC, Avro

Exposure to machine learning algorithms is a plus

Experience integrating platforms like Dataiku is an advantage

Cloud migration experience is beneficial

Familiarity with Agile methodologies such as Scrum or SAFe

Understanding of the financial sector and related products is a bonus

If you're passionate about working with modern data platforms, solving complex challenges, and driving innovation, we'd love to hear from you!

Please forward your updated CV to [email protected] / WhatsApp +91 8072826140

#Big Data #Hadoop # Kafka #Python