Senior Machine Learning Engineer

EPAM is seeking a Senior Machine Learning Engineer to work on cutting-edge real-time AI systems that integrate streaming protocols, agentic AI (LangChain/LangGraph), voice-enabled applications, and advanced orchestration of machine learning models. This role is ideal for engineers and ML specialists with significant expertise in low-latency streaming systems, real-time voice processing, distributed computing, and the end-to-end production of AI-driven solutions.

This is your opportunity to work on complex AI challenges at the intersection of multimedia, real-time data, and machine learning.

Responsibilities

• Architect and implement low-latency, real-time streaming systems for multimedia, voice/audio, and events using WebRTC, gRPC, Kafka, and related protocols
• Build and optimize audio pipelines for live interactions with technologies such as Noise Suppression, Voice Activity Detection, and Turn Detection
• Develop and scale streaming data systems to support thousands of simultaneous interactions, with a focus on reliability, concurrency, and performance
• Design and deploy data pipelines using tools like Apache Kafka, Flink, and Spark Streaming for real-time data processing and AI model inputs
• Build and optimize LangChain/LangGraph workflows for multi-agent orchestration, task planning, memory management, and streaming AI outputs
• Fine-tune and distill large language, vision, or speech models using LoRA, PEFT, or QLoRA for production-grade applications
• Develop adapters and retrieval-augmented generation techniques to integrate models with private knowledge bases
• Collaborate on the deployment of multi-agent AI systems to handle complex workflows, voice-enabled conversational systems, and scalable architectures
• Continuously monitor AI models in production for drift, performance optimization, and retraining
• Containerize and deploy services using Docker, Kubernetes, and infrastructure-as-code tools (Terraform/Ansible)
• Instrument monitoring tools such as Prometheus, Grafana, and OpenTelemetry to ensure system observability and cost efficiency
• Ensure compliance with industry privacy and security requirements in AI production systems
• Provide cross-functional collaboration by working closely with DevOps, backend, and frontend teams to ensure the end-to-end functionality of real-time AI systems
• Mentor junior engineers, share best practices for ML development, and drive innovation in Agentic AI workflows and voice-AI pipelines
• Translate business objectives into robust technical solutions with measurable scalability
• Present progress updates, findings, and technical roadmaps to stakeholders and executives

Requirements

• 5+ years of experience in ML engineering, distributed systems, or real-time communication development, with at least 2+ years in real-time production-level AI applications
• Proven expertise in designing real-time communication systems with protocols like WebRTC, gRPC, RTP/SRTP, or SIP
• Hands-on experience with LangChain/LangGraph in modeling workflows, orchestrating LLM agents, and streaming processing
• Practical knowledge of Voice Activity Detection, Noise Suppression, Speaker Turn Detection, or similar techniques for real-time voice applications
• Strong proficiency in Python and modern ML frameworks (PyTorch, TensorFlow, LangChain ecosystem)
• Experience with vector databases (e.g., Milvus, PGVector, Weaviate) and embedding-based retrieval systems
• Solid understanding of concurrency, distributed systems, and deploying real-time solutions on cloud GPUs (AWS, GCP, Azure)
• Familiarity with data processing frameworks such as Apache Flink, Apache Spark Streaming, or Kafka Streams
• Strong problem-solving abilities combined with a proven understanding of system design for low-latency, high-performance applications
• Excellent communication and teamwork skills, with the ability to work in a fast-paced, experimental environment

Nice to have

• Experience with low-code/no-code workflows using tools like n8n, Zapier, or Make
• Familiarity with IoT/Edge development and integration

We offer

• Engineering Heritage: Best-in-class experts sharing a culture of engineering excellence and tackling complex engineering challenges for over 30 years.
• Advanced Tech Stack: Innovative projects where you can apply or enhance your expertise in Cloud, Data, AI, and other emerging technologies
• World-Class Clients: Work closely with 295+ of the Forbes Global 2000 on creating disruptive solutions that make a global impact
• Professional Growth: Exceptional support for career development with comprehensive resources for upskilling or reskilling in pioneering practices
• GenAI Community: Strong AI competencies with 600+ experts across 55+ locations driving GenAI-enabled transformation journeys
• Entrepreneurial Culture: If you're passionate and dedicated to improving business transformation, we provide the support you need to bring your ideas to life
• Hybrid Setup: The flexibility to work from any location in Lithuania, whether it's your home or our dynamic offices in Vilnius and Kaunas
• Other Benefits: Additional vacation and trust days, private health insurance, Employee Stock Purchase Plan and more

Salary range €3.8K-€5.7K gross, based on your experience and interview results.

Join our team in our cozy offices in Vilnius or Kaunas.

About EPAM

EPAM is a leading global provider of digital platform engineering and development services. For over 30 years, our team has helped leading brands navigate the waves of digital transformation, building solutions that help them stay competitive through constant market disruption.

With offices in 55+ countries, EPAM has grown in Lithuania to over 1,200+ talented innovators in just 4 years. We foster creativity and unconventional ways of doing things, welcoming like-minded professionals to join us

Feel free to work remotely from anywhere across Lithuania or connect with colleagues at our Vilnius and Kaunas offices.