-
XpertDirect

Senior Embedded Software Engineer

XpertDirect
Estonia · Full-time · Mid-Senior

Senior Embedded AI Engineer – Edge LLM & Inference Systems

Embedded AI | Edge Computing | Machine Learning Inference


Are you ready to bring cutting-edge AI to the edge?

We’re seeking a Senior Embedded AI Engineer to help deploy compact, transformer-based LLMs on real-world embedded platforms. Based in Tallinn, this on-site role challenges you to push the limits of inference performance under tight power, latency, and memory constraints.

You'll be part of a team building next-generation intelligent systems—from optimizing model architectures to deploying them on diverse edge hardware, including ARM, RISC-V, and neural processing units (NPUs).


What You’ll Do:

• Optimize and deploy transformer-based LLMs using embedded ML frameworks (e.g., TFLite Micro, Edge Impulse)

• Perform quantization, pruning, and memory mapping for efficient model execution

• Integrate real-time data pipelines with on-device inference

• Adapt and tune models for hardware-specific acceleration (ARM, RISC-V, NPUs)

• Write performant C/C++ and Python code in embedded Linux environments

• Collaborate with hardware and systems teams to align performance goals with real-world deployment


Your Background:

• Solid experience with edge ML frameworks like TFLite Micro, TVM, or Edge Impulse

• Deep understanding of LLM model compression, optimization, and deployment workflows

• Proficient in C/C++, Python, and embedded Linux systems

• Familiar with real-time data ingestion and memory-constrained processing


Bonus Points:

• Prior work with transformer models in edge or mobile environments

• Familiarity with Neural Network Compiler toolchains (e.g., XNNPack, Glow, Apache TVM)

• Hands-on experience with hardware profiling tools and performance counters

• Experience integrating AI into IoT or robotics systems

• Contributions to open-source embedded AI projects

Key Skills

Ranked by relevance

embedded ai machine learning python apache linux
Login to Apply
Posted
May 22, 2025
Type
Full-time
Level
Mid-Senior
Location
Tallinn

Industries

Semiconductor Manufacturing

Categories

Engineering

Related Jobs

3 roles aligned with this opportunity

View all jobs
View Job Details
European Tech Recruit
Related

Systems Software Engineer - Embedded / Sensors

2026-05-18

Full-time
Mid-Senior
Ireland
Semiconductor Manufacturing
Engineering
View Job Details
European Tech Recruit
Related

Senior Systems Engineer (DSP) - C/C++ / MATLAB / Python

2026-05-22

Full-time
Mid-Senior
Ireland
Semiconductor Manufacturing
Information Technology
View Job Details
Arm
Related

Software ML Engineer

2026-05-16

Full-time
Associate
United Kingdom
Semiconductor Manufacturing
Engineering