Track This Job
Add this job to your tracking list to:
- Monitor application status and updates
- Change status (Applied, Interview, Offer, etc.)
- Add personal notes and comments
- Set reminders for follow-ups
- Track your entire application journey
Save This Job
Add this job to your saved collection to:
- Access easily from your saved jobs dashboard
- Review job details later without searching again
- Compare with other saved opportunities
- Keep a collection of interesting positions
- Receive notifications about saved jobs before they expire
AI-Powered Job Summary
Get a concise overview of key job requirements, responsibilities, and qualifications in seconds.
Pro Tip: Use this feature to quickly decide if a job matches your skills before reading the full description.
Job Title: Data Modular Engineer / Consultant
Department: Data Center Engineering & Infrastructure, Location: Dubai or Abu Dhabi, UAE. Employment Type: 1 year contract (possibility of Extension)
Summary
We’re looking for a Lead Data Engineer with deep expertise in Azure, Big Data, and RDBMS ecosystems, capable of designing and implementing scalable data solutions across modern data platforms. The ideal candidate will have strong hands-on experience with ETL/ELT pipelines, Azure Data Factory, Databricks (PySpark/Spark SQL), and Medallion architecture.
Key Responsibilities
- Design, build, and optimize ETL/ELT data pipelines using Azure Data Factory (ADF) and Databricks.
- Implement Medallion architecture, Delta Lake, and Unity Catalog for data governance and schema evolution.
- Develop real-time data streaming and batch ingestion solutions leveraging Event Hub, ADLS Gen2, and Spark.
- Manage and tune data workflows for performance optimization (scan time, shuffle, spill, and data skew).
- Ensure data quality, lineage, and consistency across different data layers.
- Work with structured and semi-structured data (CSV, JSON, Parquet, Delta).
- Apply data governance practices using Unity Catalog and automation frameworks.
- Collaborate with BI, analytics, and DevOps teams for integrated data delivery.
Qualifications
- 13+ years of experience in Data Engineering and Data Architecture.
- Expertise in Azure, ADF, Databricks, ADLS Gen2, Event Hub, and Hadoop ecosystem (HDFS, Hive, Sqoop, Kafka).
- Proficiency in PySpark, Spark SQL, Python, PL/SQL, and SQL Server/Oracle/MySQL.
- Experience implementing Delta Lake for ACID transactions and data versioning.
- Skilled in ETL design, Medallion architecture, real-time streaming, and performance tuning.
- Hands-on experience with GitHub, GitLab, or similar version control tools.
- Familiarity with Linux, Windows, and data ingestion automation.
- Microsoft Certified – Azure Data Engineer Associate (DP-203) or equivalent certification preferred.
Technical Skills Summary
- Cloud & Big Data: Azure (ADF, Databricks, ADLS Gen2, Event Hub), Hadoop (HDFS, Hive, Sqoop, Kafka)
- Programming: Python, PySpark, Spark SQL, PL/SQL
- Databases: SQL Server, Oracle, MySQL
- Version Control: GitHub, GitLab, VS Code, SQL Developer
- Operating Systems: Linux, Windows
- Certifications: Azure Data Engineer (DP-203) preferred
Key Skills
Ranked by relevanceReady to apply?
Join OnDemand Talent and take your career to the next level!
Application takes less than 5 minutes