Data Engineer

Job Title: Microsoft Fabric Certified Senior Data Engineer

Location: On-Site, Abu Dhabi

Experience Required: 6-7 Years

Job Overview:

We are seeking a highly skilled and experienced Microsoft Fabric Certified Senior Data Engineer to join our team. The ideal candidate will possess strong expertise in data engineering, project leadership, and client management. They should be proficient in working with Microsoft Fabric, Databricks, ADF, and related tools, with the ability to architect solutions and lead end-to-end implementations.

Key Responsibilities:

• Collaborate with stakeholders to gather and analyze business requirements.
• Architect end-to-end data solutions leveraging Microsoft Fabric capabilities.
• Design scalable data pipelines, workflows, and orchestration strategies.
• Develop data security and governance frameworks as part of the solution design.
• Develop and optimize ETL processes using Microsoft Fabric Experiences.
• Establish connectivity with on-premises data sources and cloud services.
• Ensure high-performance data ingestion and transformation.
• Implement orchestration frameworks for scheduling and monitoring workflows.
• Utilize DevOps practices to automate CI/CD pipelines for data solutions.
• Apply Spark optimization techniques, including partitioning, caching, and job optimization, to handle large-scale data processing.
• Conduct performance benchmarking and implement tuning strategies for ETL workflows.
• Identify and resolve bottlenecks in data processing pipelines.
• Perform rigorous testing to validate data quality, accuracy, and performance.
• Ensure timely delivery of high-quality data engineering solutions.
• Prepare comprehensive project documentation, including architectural designs, workflows, and deployment guides.

Required Qualifications and Skills:

1. Certifications:

• DP-203: Data Engineering on Microsoft Azure
• Databricks Certified Data Engineer
• DP-600: Fabric Analytics Engineer Associate

1. Technical Skills:

• Proficiency in Microsoft Fabric, Databricks, ADF, Python, and SQL.
• Strong understanding of ETL processes, data orchestration, and on-prem data source connectivity.
• Experience in solution architecture and designing end-to-end data engineering workflows.

1. Soft Skills:

• Excellent communication and client handling skills.
• Strong problem-solving and decision-making abilities.
• Ability to collaborate with stakeholders and lead cross-functional teams.