Devops specialist with data experience - Stockholm

About the Assignment:

We are looking for an experienced consultant to support the modernization and migration of an existing on-premise data platform to a modern, cloud-native architecture on Google Cloud Platform (GCP). The current data lake is based on Apache technologies such as Spark, NiFi, and Airflow, and the goal is to build a future-proof, compliant, and scalable cloud data foundation leveraging containerization, managed GCP services, and infrastructure-as-code.

You will work as part of a DataOps team, contributing directly to delivery and helping establish a sustainable and high-performing cloud data environment.

Key Responsibilities:

Support the migration of data pipelines and workflows from on-premise (Cloudera stack) to GCP.

Design and implement scalable solutions using Dataproc, Docker/Kubernetes, and Terraform.

Develop and maintain ETL processes, data pipelines, and CI/CD workflows.

Optimize performance and ensure compliance, observability, and automation across the platform.

Collaborate closely with cross-functional teams to ensure smooth integration and delivery.

Required Skills:

Apache Spark

Cloud experience (preferably GCP)

Containerization (Docker, Kubernetes)

Infrastructure as Code (Terraform)

CI/CD pipelines

Python and SQL

Database management and ETL processes

Meritorious Skills:

Experience with on-premise stack: Apache NiFi, Apache Airflow, Cloudera ecosystem

Experience with GCP services (Dataproc, Event Hubs, etc.)

Scala (bonus, especially for Spark)

Observability and monitoring tools (Elasticsearch, Kibana)

YAML, Linux, Windows

Command-line interface (CLI) proficiency

Soft Skills:

Flexible and delivery-oriented mindset

Strong communication skills in English (Swedish is a plus)

Team-oriented, proactive, and structured in approach