Big Data Engineer (Lisbon or Porto)

iQube

iQube is an IT consulting company based in Lisbon, Portugal, specialising in accelerating its clients' digital transformation through intelligent and efficient technological solutions.

The company focuses on three main areas of services: IT Outsourcing (providing scalable integration of experienced professionals), Project Implementation (custom software development, web and mobile applications) and AI Consulting (helping organisations implement and optimise Artificial Intelligence strategies, from feasibility assessments to building predictive systems). iQube operates with a flexible, customer-centric approach, supporting both Portuguese national operations and international customers through a nearshore model.

Big Data Engineer (Lisbon or Porto)

We are looking for a motivated Big Data Engineer to join our data platform team. This is an exciting opportunity for someone with at least one year of experience to scale their skills in a high-volume data environment. You will be responsible for building, maintaining, and optimizing our data pipelines, ensuring that our data is accessible, reliable, and ready for analysis.

🔴 *Required Skills & Qualifications*

Mandatory

• Experience: 1+ year of professional experience as a Big Data Engineer or in a closely related data-heavy role.
• Technical Stack: Proficiency in Python, Scala, or Java.
• Hands-on experience with Apache Spark, Hadoop, or Kafka.
• Strong command of SQL for complex data manipulation.
• Cloud Knowledge: Familiarity with at least one major cloud provider (AWS, GCP, or Azure, but we give preference to AWS and GCP).
• Languages: * English: Fluency is required for technical documentation and international meetings.
• Portuguese: Proficiency is required for collaboration with specific regional stakeholders.
• Location: Must be currently living in the European Union (EU).
• Hybrid with 2 days per week in the Lisbon or Porto office.

Valued:

• Experience with workflow orchestration tools like Apache Airflow
• Familiarity with NoSQL databases (e.g., MongoDB, Cassandra)
• Basic understanding of CI/CD pipelines and containerization (Docker/Kubernetes).

🔴 *The Impact You Will Make*

Data Foundation: Build the infrastructure that powers our business intelligence and AI initiatives.

Pipeline Excellence: Transition manual data processes into automated, scalable ETL workflows.

Global Collaboration: Use your bilingual skills to bridge communication between our international teams.

🔴 *Responsibilities*

• ETL/ELT Development: Design and implement efficient data pipelines using modern Big Data frameworks.
• Data Modeling: Assist in designing scalable data schemas that support diverse business requirements.
• Optimization: Monitor and tune the performance of data processing jobs to ensure cost-effectiveness and speed.
• Collaboration: Work closely with Data Scientists and Architects to deliver high-quality data products.
• Maintenance: Troubleshoot and resolve issues within the data ecosystem to ensure 24/7 data availability.