Data Engineer

Senior Data Engineer

Type: Long-term Contract (B2B) Location: Remote (with occasional travel to Brussells Tech Stack focus: Trino, Spark, dbt, Iceberg, Kubernetes, Airflow.

THE MISSION

We are building a massive-scale, fully Open-Source Data Lakehouse from the ground up.

While most organizations are settling for vendor lock-in with proprietary platforms, we are committed to technical sovereignty. We are moving away from "black-box" solutions to build a high-performance, modular, and vendor-agnostic data platform. We need a veteran Data Engineer/Architect who values code-over-configuration and knows how to orchestrate complex data flows at a global scale.

WHAT YOU WILL DO

• Architect the Lakehouse: Design and maintain a production-grade Data Lakehouse using open-source protocols like Apache Iceberg or Delta Lake.
• Engineered Pipelines: Build scalable ELT workflows to transform vast quantities of structured and unstructured data using Spark and dbt.
• Query Optimization: Use Trino to enable lightning-fast SQL access across disparate data sources.
• DevOps for Data: Deploy and manage your workloads using Docker and Kubernetes, ensuring the environment is as robust as the code.
• Real-Time Integration: Design integrations for data streaming services (Kafka/RabbitMQ) and a variety of APIs and cloud platforms.
• Code Excellence: Write modular, testable, and production-ready Python/SQL code, backed by automated monitoring and validation checks.

YOUR TOOLBOX

• The Engines: Expert-level knowledge of Trino, Spark, and SQL.
• The Storage: Deep understanding of modern storage formats (specifically Apache Iceberg or Delta Lake).
• The Orchestrators: Proficiency with Airflow, Dagster, or similar "Data-as-Code" tools.
• The Infrastructure: You are comfortable with Kubernetes and Docker/Podman; you understand that the environment is part of the solution.
• The Modern Edge: Experience leveraging AI-powered assistants (like Amazon Q) to accelerate development and troubleshoot complex pipelines.
• The Mindset: You treat Data Engineering like Software Engineering. You believe in CI/CD, unit testing, and modular architecture.

WHY THIS ROLE?

• Open-Source Purity: No proprietary constraints. You get to work with the "guts" of the technology.
• Global Impact: This project serves a world-class enterprise client with data volumes that will challenge your optimization skills.
• Tech-Forward: We are actively integrating AI-assisted engineering tools into our workflow to eliminate the "grunt work" of data mapping and documentation.
• Autonomy: This is a role for a "Builder." You will have a significant say in the design patterns and architectural decisions of the platform.