Big Data Engineer

Positium

Estonia · Full-time · Associate

Positium produces impactful statistics that are effective and easy to use for decision-makers around the world. We believe that through better-informed decisions we can do our bit to improve societies around the world.

As Big Data Engineer at Positium, you will be at the forefront of designing and optimising robust data pipelines that process vast datasets from mobile positioning data sources. You will work with cutting-edge big data technologies, contribute to the architecture of scalable cloud-based systems, and streamline data integration processes. Join our expert team in developing efficient, high-performing solutions that drive meaningful insights for our global clients.

Tasks

Design, build, and optimise data pipelines using big data technologies to efficiently process and integrate large datasets from mobile positioning data sources.
Collaborate in the design and implementation of relational database schemas and ensure effective data storage and retrieval practices.
Deploy and manage data solutions on major cloud platforms to enhance scalability and accessibility of data resources.
Use command-line tools and shell scripting (e.g., bash, Python) to automate data processing tasks and improve operational efficiency.
Stay up-to-date with the latest advancements in data engineering and big data technologies and be ready to share knowledge with colleagues.

Requirements

BSc/MSc in Computer Science or MSc in Data Science.
At least two years of work experience as a Data Engineer or similar.
Proficiency in programming: working proficiency in Python and SQL. Familiarity with JavaScript for data visualisation is also beneficial.
Databases: working experience with relational databases (preferably PostgreSQL) and familiarity with designing data models.
Big data technologies and engineering: experience with Apache Spark for large-scale data processing, familiarity with Hadoop ecosystem and distributed storage solutions (e.g. S3, Azure Blob Storage, MinIO). Experience in designing, building, and managing data pipelines. Experience in working with APIs for data sourcing, integration and delivery.
Cloud platforms: familiarity with major cloud providers and services (AWS, Azure, Google Cloud); work experience with at least one of them is a plus.
Unix/Linux systems: proficient with Unix/Linux command-line tools and shell scripting (e.g. bash). Experience with system administration and automation tasks.
Containerisation and orchestration: experience with Docker; experience with Kubernetes is a plus.
Software development practices: familiarity with object-oriented programming (OOP), design patterns, clean code practices, and testing frameworks (e.g., pytest, unittest). Experience using Git for version control and collaboration on platforms like GitHub and GitLab, including code reviews and refactoring.
Agile methodologies: understanding of software development life cycles and agile methodologies.
Being a team player with great communication skills.
Good speaking and writing skills in English.
We expect the candidate to be located in Estonia and have a right to work here.

Additional experience that would be beneficial:

Geospatial database experience: proficiency with spatial extensions for relational databases (e.g. PostGIS, Oracle Spatial, DuckDB Spatial).
Python geospatial libraries: familiarity with Python libraries for geospatial analysis, such as GeoPandas and Shapely.
Geospatial data formats: experience handling various geospatial data formats, including GeoParquet, GeoJSON, Shapefiles, and raster data formats.
Big geospatial data frameworks: familiarity with Apache Sedona.
Understanding of geospatial concepts: knowledge of spatial reference systems, coordinate transformations, and familiarity with spatial analysis and GIS theory.

Benefits

Working in our HQ in Tartu with an amazing view of the city (remote working is also a possibility, depending on the nature of the projects).
Flexible working hours – just make sure you are available to other team members and complete your tasks on time.
Global reach – you get to be part of different client projects across the globe and a chance to travel.
Support for your active life. Your wellbeing is important to us – we provide compensation for sporting activities and taking care of your mental health so that you can feel your best every day.
Fun team – we enjoy each other’s company and organise regular social activities.

Positium is the only data analytics company in the world specialising in mobile positioning data for official statistics. Founded in 2003, we have nearly two decades of experience working with global clients and scientists alike. Positium develops cool GIS solutions, high-quality methodology, software and expertise to process MPD for insights on the spatio-temporal behaviour of human beings. At Positium you will be a part of a close group of industry experts who are determined to make a positive impact on the world.

If you share our passion, we invite you to apply to join Positium’s data-driven mission!

Key Skills

Ranked by relevance

cloud python storage bash linux apache s3 aws git oop sql unix spark docker gitlab hadoop oracle javascript kubernetes postgresql

Related Jobs

3 roles aligned with this opportunity

View all jobs