Infinity Quest
Senior Microsoft Fabric Data Engineer
Infinity QuestNorway2 days ago
ContractInformation Technology

Role name : Senior Microsoft Fabric Data Engineer

Location : Oslo, Norway

Work mode : Contract


Job Description:

About the Role:

We are looking for a highly skilled and motivated Data Engineer with hands-on experience in Microsoft Fabric, Azure Data Factory, Azure Data Lake, Azure Databricks. The ideal candidate will be responsible for designing and implementing robust, scalable data engineering solutions for both batch and real-time/IoT data processing. This role is critical in enabling data-driven decision-making across the organization.


Key Responsibilities:

  • Design, build, and maintain data pipelines using Microsoft Fabric, Azure Data Factory, Azure Databricks for batch and streaming data ingestion.
  • Develop and optimize real-time data processing solutions for IoT and telemetry data using services like Fabric Event Stream, Fabric Event House, KQL DB, Azure Event Hubs, Azure Stream Analytics, or similar.
  • Manage and organize data storage using Microsoft One Lake and Azure Data Lake ensuring efficient data partitioning, lifecycle management, and access control.
  • Collaborate with data scientists, analysts, BI developers and business stakeholders to understand data requirements and deliver high-quality, reliable datasets.
  • Implement data quality checks, monitoring, and alerting mechanisms to ensure pipeline reliability and performance.
  • Ensure compliance with data governance, privacy, and security standards.
  • Continuously evaluate and improve data engineering practices, tools, and architectures.


Required Qualifications:

  • Proven hands-on experience with Microsoft Fabric, including Dataflows, Pipelines, and Lakehouses.
  • Strong expertise in Azure Data Factory for orchestrating complex ETL/ELT workflows.
  • Proficiency in managing and optimizing Azure Data Lake storage solutions.
  • Solid understanding of data engineering principles and distributed data processing.
  • Proficiency in SQL, Python, or PySpark and Scala for data transformation and automation.
  • Experience with real-time data ingestion and processing, especially from IoT devices.
  • Familiarity with Azure cloud services and best practices for cloud-based data architecture.


Preferred Qualifications:

  • Knowledge of CI/CD pipelines and DevOps practices for data engineering.
  • Familiarity with data cataloging, metadata management, and data lineage tools.
  • Experience working in Agile/Scrum environments.


Why Join Us?

  • Be part of a forward-thinking team leveraging the latest in cloud-native data platforms.
  • Work on impactful projects involving real-time analytics and IoT data.
  • Enjoy a collaborative, innovative, and inclusive work environment.
  • Competitive salary, benefits, and opportunities for professional growth.

Key Skills

Ranked by relevance