GCP Data Engineer

We are seeking a talented and motivated GCP Data Engineer to join our dynamic team in Doha. In this role, you will be responsible for designing, implementing, and optimizing cloud-based data solutions on Google Cloud Platform (GCP), supporting our AI/ML initiatives, and ensuring robust, scalable, and secure data infrastructure.

Key Responsibilities

• Architect and Deploy Cloud Environments:
• Design and implement cloud architectures on GCP, including production, staging, and QA environments, ensuring high availability and scalability for 24×7 operations.

End-to-End Data Solutions:

• Develop and optimize data ingestion, curation, storage, and pipeline solutions tailored to business and AI/ML requirements.

Data Pipeline Development:

• Build, deploy, and maintain robust data pipelines using tools such as BigQuery, Airflow, and GCS to support diverse use cases.

Automation and Infrastructure as Code:

• Leverage tools like Terraform, Pulumi, and TypeScript to automate infrastructure provisioning and management on GCP.

Multi-Cloud Integration:

• Design and implement APIs for seamless integration across multiple cloud platforms.

Continuous Improvement:

• Proactively identify opportunities to enhance data infrastructure and processes, applying new technologies and best practices.

Collaboration and Communication:

• Work closely with cross-functional teams, clearly articulating technical concepts and results to both technical and non-technical stakeholders.

Required Skills & Experience

Programming:

• Strong proficiency in Python (object-oriented design) and SQL; experience with PySpark is a plus.

Cloud Platforms:

• Hands-on experience with GCP services (BigQuery, GCS, Airflow) and cloud automation.

Infrastructure as Code:

• Proven experience with Terraform, Pulumi, or similar tools.

DevOps & Kubernetes:

• Solid understanding of Kubernetes administration, CI/CD, and general DevOps practices.

Data & Analytics Tools:

• Familiarity with tools such as Flyte, Ray, MLflow, Elasticsearch, and Kibana.

Cloud Architecture:

• Deep knowledge of cloud infrastructure components, including servers, storage, networks, and data management.

Problem Solving:

• Excellent logical, analytical, debugging, and troubleshooting skills.

Communication:

• Strong verbal and written communication abilities.

Teamwork:

• Collaborative mindset and ability to contribute effectively as a team player.

Preferred Qualifications

• Generative AI (GenAI):
• Experience or knowledge in GenAI technologies is highly desirable.
• Multi-Cloud Environments:
• Experience building APIs for multi-cloud deployments.