Azure  Data Engineer

We have an urgent requirement for Azure Data Engineer for our client based in Qatar

Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, and other Azure services.--Must

Implement data integration and ETL processes to transform raw data--Must

Familiarity with data visualization tools (e.g., Power BI) for creating insighƞ ul dashboards--Must

Background

Client is seeking a skilled and experienced Azure Data Engineer to contribute to the development of a Labor Market Information on System(LMIS). The LMIS will serve as a critical

web-based platform for data entry, data retrieval, and data visualization and also a tool to manage labor-related data, streamline processes, and provide valuable insights for policymaking and

decision-making purposes. The selected candidate will play a key role in designing, implementing,

and maintaining the LMIS.

Objectives

The ideal candidate should have a minimum of 3 to 4 years of hands-on experience working with Microsoft Azure data services, data pipelines, and data integration. As a key member of our data

engineering team, you will play a crucial role in designing, implementing, and optimizing data solutions that empower our organization to derive actionable insights from large and complex

datasets.

The main objectives of the Data Engineer are as follows:

 Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, and other Azure services.

 Collaborate with data scientists, analysts, and stakeholders to understand data requirements, business needs, and use cases.

 Implement data integration and ETL processes to transform raw data into usable formats for analysis and reporting.

 Optimize and tune data pipelines for performance and efficiency, ensuring reliability and data quality.

 Implement data security and privacy best practices, ensuring compliance with industry standards and regulations.

 Troubleshoot data-related issues, perform root cause analysis, and implement solutions in a mely manner.

 Stay current with emerging trends, tools, and technologies in the data engineering and Azure ecosystem.

 Document data pipelines, data flows, and processes for knowledge sharing and future reference.

 Expertise in Neo4j Graph Tool is mandatory.

Preferred Qualifications

Azure certifications, such as Microsoft Certified: Azure Data Engineer.

Experience with data streaming technologies (e.g., Azure Stream Analytics).

Familiarity with data visualization tools (e.g., Power BI) for creating insighƞ ul dashboards and reports.

Knowledge of DevOps practices for CI/CD in data engineering pipelines.

 Bachelor's degree in Computer Science, Information Technology, or a related field.

 Minimum of 3 to 4 years of hands-on experience as a data engineer, with a focus on Azure data services.

 Proficiency in Azure Data Factory, Azure Databricks, and other relevant Azure services.

 Strong expertise in data modeling, data integration, and ETL processes.

 Experience with SQL, NoSQL, and data warehousing concepts.

 Programming skills in languages such as Python, Spark, or Scala.

 Knowledge of data security, privacy, and compliance best practices.

 Excellent problem-solving skills and the ability to work collaboratively in a fast-paced

environment.

 Strong communicate on skills to work effectively with cross-functional teams and

stakeholders.

Skills: data,integration,azure