Big Data Specialist

Big Data Expert

Job Summary

We’re looking for Big Data Expert to support our team in Muscat, Oman.This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to the success of a growing company. If you’re someone who takes initiative, values continuous learning, and thrives in a collaborative setting, we’d love to hear from you.

Role Description

Job Description:

We are seeking a Senior Big Data Engineer with deep expertise in on-premises Big Data platforms, specifically the Cloudera ecosystem, and a strong background in the telecom domain. The ideal candidate will have 12–15 years of experience building and managing large-scale data lakes, developing batch and real-time pipelines, and working with distributed data systems in telecom environments.

While the primary focus is on on-premises Cloudera-based data lakes, familiarity with cloud data services (AWS, Azure, or GCP) is considered an added advantage.

Key Responsibilities:

• Design, build, and maintain on-premises data pipelines using Apache Spark, Hive, and Python on Cloudera.
• Develop real-time data ingestion workflows using Kafka, tailored for telecom datasets (e.g., usage logs, CDRs).
• Manage job orchestration and scheduling using Oozie, with data access enabled via Hue and secured through Ranger.
• Implement and manage data security policies (Kerberos, Ranger) to ensure compliance and controlled access.
• Develop and expose REST APIs for downstream integration and data access.
• Ensure performance tuning, resource optimization, and high availability of the Cloudera platform.
• Collaborate with data architects, engineers, and business stakeholders to deliver end-to-end solutions in a telecom context.
• Support data migration or integration efforts with cloud platforms where applicable is added advantage.

Required Skills & Experience:

• 12–15 years of experience in Big Data engineering, with hands-on focus on on-premises data lake environments.
• Extensive Telecom domain knowledge – including data models and pipelines related to CDRs, BSS/OSS, customer and network data.
• Strong practical experience with:
• Cloudera (CDH/CDP) components: Spark, Hive, HDFS, HBase, Impala
• Kafka: configuration, topic management, producer/consumer setup
• Python for data transformations and automation
• Job orchestration via Oozie
• Access control and metadata management using Ranger
• Proficient in performance tuning, resource management, and security hardening of Big Data platforms.
• Experience with API development and integration for data services.
• Optional/Added Advantage: Exposure to cloud platforms (AWS EMR, Azure HDInsight, GCP Dataproc), hybrid architecture understanding.

Please send the update CV along with the following information to [email protected]

If you are not interested, please refer to your friends.

Full Name:

Current Location:

Visa Status:

Total years of experience:

Relevant years of experience:

Current salary:

Expected Salary:

Notice period:

Reason for leaving:

About CLPS RiDiK

RiDiK is a global technology solutions provider and a subsidiary of CLPS Incorporation (NASDAQ: CLPS), delivering cutting-edge end-to-end services across banking, wealth management, and e-commerce. With deep expertise in AI, cloud, big data, and blockchain, we support clients across Asia, North America, and the Middle East in driving digital transformation and achieving sustainable growth. Operating from regional hubs in 10 countries and backed by a global delivery network, we combine local insight with technical excellence to deliver real, measurable impact. Join RiDiK and be part of an innovative, fast-growing team shaping the future of technology across industries.

Thanks & Regards,

Rituparna Das

IT Recruiter

CLPS Inc.

| India HP/Whatsapp: +91 9078590574

| India Office: + 65 68178695