HubMub
-
EPAM Systems

Senior Engineer/ML Engineer – Real-Time AI, Streaming, and Orchestration

EPAM Systems
Latvia · Full-time · Mid-Senior
EPAM is seeking a Senior Machine Learning Engineer to develop advanced real-time AI systems incorporating streaming protocols, agentic AI (LangChain/LangGraph), voice-enabled functionality, and sophisticated orchestration of machine learning models.

This position is tailored for professionals with significant expertise in low-latency streaming systems, real-time voice processing, distributed computing, and the end-to-end deployment of AI solutions.

This is your chance to tackle advanced AI challenges at the convergence of multimedia, real-time data, and machine learning.

Feel free to work remotely from anywhere across Latvia or connect with colleagues at our Riga office.

Responsibilities


  • Design low-latency real-time streaming systems for multimedia, voice/audio, and events using WebRTC, gRPC, Kafka, and associated protocols
  • Build audio pipelines for live interaction leveraging technologies like Noise Suppression, Voice Activity Detection, and Turn Detection
  • Optimize and scale streaming data systems to handle thousands of concurrent interactions while ensuring reliability, concurrency, and performance
  • Create data pipelines with tools like Apache Kafka, Flink, and Spark Streaming to enable real-time data processing and AI model integration
  • Develop LangChain/LangGraph workflows to manage multi-agent orchestration, task planning, memory systems, and streaming AI outputs
  • Fine-tune and distill language, vision, or speech models with techniques such as LoRA, PEFT, or QLoRA for production settings
  • Innovate adapters and retrieval-augmented generation methods to integrate AI models with private knowledge bases
  • Support the deployment of multi-agent AI systems for voice-enabled conversations, complex workflows, and scalable architectures
  • Monitor production AI models for drift, optimize their performance, and manage retraining processes
  • Deploy services using containerization tools like Docker and Kubernetes while leveraging infrastructure-as-code tools such as Terraform or Ansible
  • Utilize monitoring platforms like Prometheus, Grafana, and OpenTelemetry for observability and cost control
  • Ensure AI systems meet privacy and security standards compliant with industry regulations
  • Foster collaboration with DevOps, backend, and frontend teams for fully functional real-time AI systems
  • Guide and mentor junior engineers while promoting best practices in ML development and innovation in Agentic AI workflows and voice-AI pipelines
  • Propose technical solutions aligned with business objectives, prioritizing scalability and impact
  • Present updates, findings, and technical roadmaps to stakeholders and organizational leaders


Requirements


  • 5+ years of experience in ML engineering, distributed systems, or real-time communication, with at least 2+ years focused on real-time AI applications in production
  • Expertise in real-time communication systems involving protocols such as WebRTC, gRPC, RTP/SRTP, or SIP
  • Proficiency in LangChain/LangGraph for modeling workflows, orchestrating multi-agent systems, and streaming applications
  • Knowledge of Voice Activity Detection, Noise Suppression, Speaker Turn Detection, or equivalent techniques for voice-focused solutions
  • Strong skills in Python and modern ML frameworks, including PyTorch, TensorFlow, and the LangChain ecosystem
  • Background in working with vector databases like Milvus, PGVector, or Weaviate for embedding-based retrieval
  • Solid understanding of distributed systems, concurrency, and deploying real-time systems leveraging cloud GPUs on platforms like AWS, GCP, or Azure
  • Familiarity with frameworks such as Apache Flink, Apache Spark Streaming, or Kafka Streams for processing real-time data
  • Analytical problem-solving acumen with demonstrated expertise in designing systems for low-latency and performance-critical applications
  • Excellent teamwork and communication skills for fast-paced and experimental environments


Nice to have


  • Background in low-code/no-code platforms like n8n, Zapier, or Make
  • Knowledge of IoT/Edge technologies and their integration strategies


We offer


  • Engineering Heritage: Best-in-class experts sharing a culture of engineering excellence and tackling complex engineering challenges for over 30 years.
  • Advanced Tech Stack: Innovative projects where you can apply or enhance your expertise in Cloud, Data, AI, and other emerging technologies.
  • World-Class Clients: Work closely with 295+ of the Forbes Global 2000 on creating disruptive solutions that make a global impact.
  • Professional Growth: Exceptional support for career development with comprehensive resources for upskilling or reskilling in pioneering practices.
  • GenAI Community: Strong AI competencies with 600+ experts across 55+ locations driving GenAI-enabled transformation journeys.
  • Entrepreneurial Culture: If you're passionate and dedicated to improving business transformation, we provide the support you need to bring your ideas to life.
  • Hybrid Setup: The flexibility to work from any location in Latvia, whether it's your home or our office in Riga.
  • Other Benefits: Additional vacation and trust days, private health insurance, Employee Stock Purchase Plan and more.


Salary range €3.8K-€5.2K gross, based on your experience and interview results.

About EPAM


EPAM is a leading global provider of digital platform engineering and development services. For over 30 years, our team has helped leading brands navigate the waves of digital transformation, building solutions that help them stay competitive through constant market disruption.

With offices in 55+ countries, EPAM has grown in Latvia to over 888+ talented innovators in 3 years. We foster creativity and unconventional ways of doing things, welcoming like-minded professionals to join us.

Key Skills

Ranked by relevance

ai apache kafka machine learning cloud spark grpc distributed computing containerization kubernetes prometheus tensorflow terraform grafana pytorch python docker devops aws gcp
Login to Apply
Posted
Aug 07, 2025
Type
Full-time
Level
Mid-Senior
Location
Latvia
Company
EPAM Systems

Industries

Software Development IT Services IT Consulting

Categories

Engineering Information Technology Research

Related Jobs

3 roles aligned with this opportunity

View all jobs
View Job Details
EPAM Systems
Related

Full-stack .NET Software Engineer (React/Angular)

2026-05-27

Full-time
Associate
Ukraine
Software Development
Information Technology
View Job Details
EPAM Systems
Related

Lead AI Engineer

2026-05-26

Full-time
Mid-Senior
Turkey
Software Development
Information Technology
View Job Details
EPAM Systems
Related

Lead Generative AI Data Scientist

2026-05-24

Full-time
Mid-Senior
Ukraine
Software Development
Business Development