Connect Vision International
Azure DevOps (Data) Engineer
Connect Vision InternationalQatar13 hours ago
Full-timeInformation Technology

Job Title: Azure DevOps (Data) Engineer

Location: Doha, Qatar (Onsite)

Employment Type: Permanent – Full-time or Contract (Open to both)

Compensation: Competitive salary / rate (open and negotiable based on experience)


Job Description

We are looking for an experienced Azure DevOps (Data) Engineer to join our team in Doha, Qatar.

The ideal candidate will have strong hands-on experience with Azure DevOps, CI/CD pipelines, and Azure Data Services, particularly Databricks and Azure Data Factory (ADF). The role focuses on designing, implementing, and maintaining automated deployment processes for data platforms, ensuring reliability, scalability, and compliance with best practices.


Key Responsibilities

  • Design, build, and maintain CI/CD pipelines using Azure DevOps for data engineering projects.
  • Implement deployment automation for Azure Data Factory (ADF) and Databricks.
  • Manage Databricks Asset Bundle implementations for Databricks CI/CD.
  • Develop scripts and automation tools using PowerShell, Python, or other relevant languages.
  • Implement selective deployment strategies for ADF data pipelines.
  • Collaborate with data engineers, architects, and DevOps teams to optimize build and release processes.
  • Ensure security best practices and compliance within CI/CD and Azure environments.
  • Monitor, troubleshoot, and resolve issues related to pipeline failures, environment configuration, and deployment automation.
  • Contribute to continuous improvement and documentation of DevOps standards and procedures.


Required Skills & Experience

  • 5+ years of experience in DevOps, preferably with a focus on data engineering environments.
  • Proven expertise with Azure DevOps and CI/CD pipeline automation.
  • Strong knowledge of Azure Data Services, including Databricks and Azure Data Factory (ADF).
  • Proficiency in Databricks Asset Bundle (DAB) for CI/CD deployment.
  • Experience with scripting and automation tools such as PowerShell or Python.
  • Understanding of selective deployment for ADF pipelines.
  • Familiarity with containerization and orchestration tools (Docker, Kubernetes) is a plus.
  • Knowledge of security best practices for CI/CD and Azure cloud environments.
  • Strong problem-solving, analytical, and collaboration skills.
  • Detail-oriented with a focus on quality, reliability, and performance.


Education

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.


If interested, please apply with an up to date CV

Key Skills

Ranked by relevance