Senior ML Engineer

We’re seeking a highly skilled Generative AI Engineer with deep expertise in LLM app development, backend systems, and prompt engineering. You will lead the design and implementation of advanced AI applications using OpenAI APIs and other LLM providers, with a focus on robust, scalable, and production-grade architectures. You’ll work across the GenAI stack, from backend services in .NET and Python to prompt engineering and RAG pipelines, and will contribute to benchmarking, testing, and observability of LLM-powered systems.

Responsibilities

Integrate and optimize applications using LLM provider APIs (e.g. OpenAI Chat Completions), including model/parameter selection, structured output, function calling, etc.
Design and refine prompts with few-shot, chain-of-thought, context crafting, and prompt chaining techniques.
Benchmark and evaluate models (e.g., reasoning vs. non-reasoning) using custom eval sets and automated testing frameworks.
Build and monitor RAG pipelines, implement summarization, chat with data and other use cases.
Develop robust backend services in .NET and Python, working with SQL, REST APIs, and integrating with LLM services.
Implement LLM tracing, monitoring, and logging for observability.
Apply prompt security best practices, including injection protection and guardrails.
Collaborate across teams to build agentic workflows, and support ETL/data transformations for AI readiness.

Requirements:

1-2+ years demonstrable experience in developing Generative AI applications.
Proven hands-on experience with OpenAI APIs, model selection, and LLM capabilities
Proven hands-on experience with prompt engineering, including structured prompts, function calls, and evaluation techniques.
Experience with RAG and building LLM-centric workflows
3+ years of experience as a software developer
Strong backend development skills in .NET (C#) and SQL
Proficiency in Python; familiarity with JavaScript
Experience with Docker, Kubernetes, and RESTful APIs
Familiarity with Azure, particularly AKS, ACR, and containerized app deployment
English - fluent speaking, reading and writing

Advantages:

Experience with Azure OpenAI, PromptFlow, Azure AI Services, and Azure ML
Familiarity with CosmosDB, KQL, Azure Log Analytics, App Insights
LLM use cases: Text-to-SQL, chat over DBs
Exposure to other LLM APIs (Anthropic, Mistral, Cohere, etc.)
Prompt caching/compression, LLM output validation
Familiarity with Redis caching
Frontend experience with React and Next.js

Senior ML Engineer

Key Skills

Related Jobs

Backend Engineer - Remote

Backend Engineer - Remote

Middle Software Engineer (JS/TS)

Related Jobs

Backend Engineer - Remote

Backend Engineer - Remote

Middle Software Engineer (JS/TS)

Cookie Settings