Data Engineer

Job Title :-GCP Data Engineer

Locations: Doha

Contract :- Long term

Experience: 4-10 Years

Mandatory Skills: Big Query, Airflow, GCS, Python, SQL, PySpark (Optional)

Skill Requirements:

Essential Skills and experience:

• Excellent Programming skills in Python with object-oriented design
• Excellent knowledge in current computing trends and technologies
• Knowledge or working experience in Generative AI (GenAI) technologies is preferred.
• Experience in designing and implementing cloud infrastructure, platforms, and applications
• Hands-On Experience on Infrastructure as a Code using terraform /pulumi /typescript in GCP
• Hands-On Experience with Google Cloud platform & product deployment and automation
• Hands-On Experience with Multi cloud API building
• In-depth knowledge of Kubernetes, K8s administration, devops , Databases, and CI/CD
• Knowledge of commonly used tools/components/technologies in applications –Flyte/Airflow, Ray, MLflow, Elastic search, Kibana, etc.
• Strong understanding across cloud and infrastructure components (server, storage, network, data, and applications) to deliver end to end cloud infrastructure, architectures, and designs
• Excellent logical, analytical, debugging and problem-solving skills
• Strong communication skills

Key Job Responsibilities:

• Design and deploy cloud environments with a focus on GCP and demonstrate technical cloud architectural knowledge, playing a vital role in the design of production, staging, QA, and deployment of cloud infrastructures running in 24×7 environments
• Architect End to end scalable and Optimized data solutions for data ingestion, curation, storage, data pipelines for AI/ML development and deliver to the end user based on business need
• Design, Develop and deploy various data pipelines based on the use case scenarios
• Maintain clear and coherent communication, both verbal and written, to understand data needs and report results
• Continuously Ideates and improvises on the requirements and apply new techniques and methods
• Able to work in & contribute as a good team player