Data Engineer

Data Engineer | Data Engineering & Platform Development | 100% Remote

Specific-Group is an international software development company delivering high-quality, custom software solutions to corporate clients across Europe and the United States. With offices in Austria, Germany, the USA, Lithuania, Poland, Spain, Vietnam, and other locations, we combine global expertise with a strong local presence.

We primarily collaborate with clients in the financial sector, while also delivering impactful solutions across insurance, healthcare, automotive, public media, AI, and other industries.

We are currently looking for a Senior Data engineer with strong technical expertise to join our team and contribute to challenging, business-critical projects.

About the client

Many AI solutions fail due to a lack of traceability, compliance, data sovereignty, or clear integration into existing systems. Our partner company addresses these challenges through AI and agent engineering combined with an integrated blockchain, enabling AI systems to be operated in a sovereign, scalable, and auditable manner. Trust, operational logic, and decision-making processes are unified within a single system, allowing AI to be monitored and audited directly within productive workflows.

The platform is a fully automated SaaS solution that combines AI workflow engineering with blockchain technology. This enables the development of sovereign, transparent, and auditable AI systems that are regulatory-compliant and production-ready. Domain-specific AI agents, service language models, and real-time data fusion are combined into end-to-end workflows designed to be tamper-resistant.

Projects & Responsibilities

• Design and implementation of batch and real-time data processing for structured and unstructured data;
• Development of scalable, stable, and auditable data pipelines and platform architectures;
• Direct integration of the data platform into production applications;
• Contribution to trustworthy AI systems that aggregate, process, and integrate data from multiple sources into operational workflows;
• Ensuring that decisions are based on consistent, traceable, and verifiable data.

Platform use cases include, among others:

• Critical infrastructure
• Security and resilience
• Tourism
• Natural hazard and risk management

Example Project – Location Analytics Platform

Development of a location analytics platform that provides real-time insights for public authorities and planners:

1. Data integration & cleansing: Mobile network aggregation data, public transport logs, event data, real estate prices; schema validation and anomaly detection;
2. Geospatial analytics: GIS layer overlays (population, infrastructure, points of interest), heatmaps, hotspot analysis;
3. Forecasting & simulation: Trend analysis (ARIMA, Prophet, LSTM), ROI simulations under different scenarios;
4. Dashboards & reporting: Interactive visualizations for decision-makers, automated textual summaries;
5. Compliance & audit: Full traceability of analyses, optional blockchain-based immutable audit trails.

Team

The core team consists of highly qualified senior experts with more than 15 years of experience in complex projects, covering:

• Senior Architecture & Solution Design
• Backend Development
• Senior Frontend Development

Blockchain and AI expertise is complemented by international specialists who work closely with the core team.

Profile

Must-have

• PostgreSQL as the primary database;
• Apache Kafka (Producer/Consumer), KafkaJS, or Confluent.Kafka;
• Experience with data pipeline architecture, ETL/ELT, and data transformation;
• Knowledge of batch processing and real-time data integration;
• Experience in data quality and validation;
• Experience with Entity Framework Core or a comparable ORM;
• Processing of CSV, JSON / JSONB.

Nice-to-have

• Experience with vector and geospatial data (pgvector, NetTopologySuite, GeoJSON, spatial indexing);
• Knowledge of geospatial processing (GeoTIFF, vector tile generation);
• Experience with infrastructure and tools such as MinIO, MQTT, Python;
• Domain expertise in satellite and climate data, aviation data (OpenSky API), image embeddings, and time series processing.

Benefits:

• Flexible work format: office-based or fully remote options;
• Competitive and market-aligned salary;
• Stable, long-term projects with well-established clients;
• Strong focus on professional growth, including trainings, knowledge-sharing sessions, and internal meet-ups;
• Clear career development paths and long-term career opportunities;
• Annual performance assessment and regular salary reviews;
• Transparent, structured, and supportive management;
• Friendly, collaborative team and a positive working atmosphere;
• Company events, team buildings, and corporate gatherings;
• Flexible working hours (you can start your day until 11:00 AM; standard 40-hour work.

Link on GDPR: https://spg-docs.s3.eu-central 1.amazonaws.com/PL/GDPR_recruitment.pdf