Data Engineer

Job Description:

We are seeking an experienced Data Engineer to join our team, focusing on building and maintaining robust data platforms. The ideal candidate will have extensive experience in SQL, data warehousing, data modeling, ETL development, and a strong proficiency with Azure cloud services, including Azure Data Factory, dbt, and Databricks. Experience with Power BI is also essential.

Key Responsibilities:

• Data Pipeline Development: Design, develop, and deploy scalable data pipelines using Azure Data Factory, ensuring efficient data extraction, transformation, and loading (ETL) processes.
• Data Modeling: Create and maintain data models and schemas to support business intelligence and analytics requirements.
• Cloud Integration: Utilize Azure services, including Azure Data Factory, dbt, and Databricks, to integrate and process data from various sources.
• Data Quality Assurance: Implement data validation and quality checks to ensure the accuracy and reliability of data.
• Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
• Documentation: Maintain comprehensive documentation of data pipelines, models, and processes to support knowledge sharing and future development.

Qualifications:

• Education: Bachelor's degree in Computer Science, Information Technology, or a related field.
• Experience: Minimum of 8 years in data engineering roles, with a strong focus on data platforms and cloud technologies.
• Technical Skills:
• Proficiency in SQL and data warehousing concepts.
• Hands-on experience with Azure Data Factory, dbt, and Databricks.
• Experience with Power BI for data visualization and reporting.
• Familiarity with data modeling and ETL development.
• Soft Skills:
• Strong analytical and problem-solving abilities.
• Excellent communication and collaboration skills.
• Ability to work independently and manage multiple tasks effectively.

Preferred Qualifications:

• Experience with additional Azure services such as Azure Synapse Analytics or Azure Data Lake.
• Knowledge of programming languages like Python or Scala.
• Familiarity with Agile methodologies and DevOps practices.