Azure AI Engineer / Azure ML Engineer – LLM, Conversational AI, RAG | Vienna Hybrid

We are hiring a senior Azure AI Engineer / Azure ML Engineer (m/f/d) for a long-term enterprise AI programme focused on Large Language Models (LLMs), Conversational AI, Retrieval-Augmented Generation (RAG), and AI agent / multi-agent systems on Microsoft Azure.

This Azure AI / ML Engineer role in Vienna (hybrid) offers the opportunity to design, implement, and operate production-grade Generative AI solutions within a stable, multi-year environment. You will work across architecture, development, deployment, and operational handover in close collaboration with business and IT stakeholders.

Location: Vienna, Austria (Hybrid – approx. 40% on-site, 60% remote)

Start: March / April 2026

Duration: 3 years (extension possible up to 5 years)

Workload: Full-time (100%)

Language: English or German

Key Responsibilities – Azure AI / ML Engineer

• Design, develop, and deploy LLM-based Conversational AI solutions on Microsoft Azure
• Build and orchestrate AI agents and multi-agent systems for enterprise use cases
• Implement Retrieval-Augmented Generation (RAG) architectures
• Integrate and apply Model Context Protocols (MCPs)
• Analyse and translate business requirements into scalable AI and cloud architectures
• Deliver solutions using agile methodologies
• Integrate, harmonise, and manage internal and external data sources
• Support rollout, production operation, monitoring, and optimisation
• Handover solutions to internal teams, including documentation and knowledge transfer
• Ensure scalability, security, maintainability, and high availability of Azure AI solutions

Required Skills – Azure AI Engineer / Azure ML Engineer

• Strong hands-on experience with Large Language Models (LLMs) and Conversational AI
• Proven experience with RAG (Retrieval-Augmented Generation) solutions
• Experience designing and implementing AI agents and multi-agent systems
• Experience with Model Context Protocols (MCPs)
• Strong expertise in Microsoft Azure, including:
• Azure Machine Learning
• Azure Cognitive Services
• Microsoft Foundry
• Development experience with C# / .NET and Python
• Experience with DevOps, CI/CD pipelines, and automation
• Hands-on experience with Docker and Azure Kubernetes Service (AKS)
• Experience with Infrastructure as Code (IaC)
• Experience working with business stakeholders and technical teams

Nice to Have (SEO-Relevant Plus Skills)

• Experience with Azure API Management
• Monitoring and logging using Azure Monitor and Log Analytics
• Data governance experience with Microsoft Purview
• Experience with Confluence and JIRA
• Industry background in the energy sector or public sector

Why This Azure AI Engineer Role?

• Long-term, stable enterprise Azure AI programme
• Hands-on work with Generative AI, LLMs, Conversational AI, and RAG
• Hybrid working model in Vienna, Austria
• High technical ownership and architectural responsibility
• International environment with English or German as project language