Middle Data Engineer

Dive deep into Digital! For 20 years Intellias has been developing top-tier digital solutions for the world’s leading companies, keeping them in line with the latest technology trends. Join in and provide innovations for the future!

Project Overview:

Project focus: to move from BigQuery to Databricks and set up Databricks

Requirements:

3+ years of hands-on experience in data engineering with Python and SQL.

2 years of experience with cloud vendors (e.g., Azure, DWH services like Databricks or BigQuery, cloud storages like Azure Storage).

Experience with ETL/ELT/orchestration tools (e.g., Airflow, ADF).

Familiarity with the design and maintenance of data warehouses or data lakes.

Basic knowledge of DevOps practices and CI/CD pipelines.

Experience with requirement gathering and basic documentation skills.

Will be a plus:

Exposure to NoSQL databases.

Bachelor's in Computer Science, Engineering, or a related field.

Relevant Azure or Databricks certifications (e.g., Data Engineer Associate).

Interest in machine learning frameworks or data visualization techniques.

Responsibilities:

Work closely with senior engineers and business stakeholders to understand and analyze data requirements.

Assist in designing, building, and maintaining scalable data systems using Azure Databricks under supervision.

Develop and optimize data processing pipelines with Databricks Notebooks, Python, and relevant libraries.

Support ETL processes and ensure efficient data performance with guidance from senior team members.

Contribute to monitoring and improving data reliability, efficiency, and quality.

Maintain clear documentation on assigned data pipeline components.

Provide basic technical support for data-related issues to internal teams.

Collaborate on ensuring data integrity, consistency, and accuracy.

Actively learn and participate in data-driven strategies aligned with business objectives.