Cloud Engineer

Role Description

• Design & Build Data Solutions: Develop scalable, reliable data pipelines and architectures using Azure services.
• Develop ETL/ELT Processes: Build and optimize ETL/ELT workflows using Azure Data Factory and related tools.
• Data Storage Management: Implement and manage Azure SQL Database, Azure Data Lake Storage (ADLS), Cosmos DB, and other storage solutions.
• Ensure Data Quality: Apply data validation, cleansing, and quality assurance practices to maintain data integrity.
• Performance Optimization: Monitor, troubleshoot, and optimize data pipelines and database performance.
• Stakeholder Collaboration: Work closely with data scientists, analysts, and cross-functional teams to deliver data-driven solutions.
• Data Security: Implement security standards and access controls using Azure tools such as Azure Key Vault.

Essential Skills

• Strong proficiency with Azure Data services:
• Azure Data Factory
• Azure Databricks
• Azure SQL Database
• Azure Data Lake Storage
• Azure Key Vault
• Programming & Scripting: Python, SQL, PySpark
• Data Modeling: Ability to design and maintain scalable, consistent data models
• Strong understanding of data warehousing and cloud-based data architectures
• Ability to work with large datasets and perform detailed data analysis