Senior AI / LLM Engineer (Freelance / Azure)

Freelance Senior Azure AI / LLM Engineer

Start: March / April 2026

Duration: 2 years+

Workload: 100%

Working model: Hybrid (40% onsite)

Responsibilities

• Design, develop, and implement LLM-based Conversational AI solutions (e.g. RAG applications) on Microsoft Azure
• Build, orchestrate, and further develop AI agents and multi-agent systems
• Apply and integrate Model Context Protocols (MCPs)
• Elicit, analyze, and structure business requirements in close collaboration with stakeholders
• Deliver solutions in an agile setup and continuously enhance them in alignment with business units
• Integrate, connect, and harmonize relevant internal and external data sources
• Roll out and provide user-friendly AI solutions for productive operation
• Hand over solutions to internal teams, including upskilling and enablement of users
• Ensure scalability, security, maintainability, and stable operation of AI solutions

Required Skills & Experience

• Deep understanding and hands-on experience with Large Language Models and Conversational AI solutions (e.g. RAG) on Azure
• Proven experience in designing, developing, and implementing AI agents and multi-agent systems
• Experience working with Model Context Protocols (MCPs)
• Experience in requirements management and close collaboration with business units
• Experience in agile delivery and continuous improvement of technical solutions
• Experience in data integration and harmonization
• Experience in rolling out and operating production-grade applications
• Experience in solution handover, documentation, and user enablement

Technical Expertise

• Strong knowledge of Microsoft Azure, in particular:
• Microsoft Foundry, Azure Cognitive Services, Azure Machine Learning
• Experience in developing robust, scalable applications using C# / .NET and Python
• Experience with DevOps principles and CI/CD pipelines
• Hands-on experience with Docker and Azure Kubernetes Service (AKS)
• Experience with Infrastructure as Code

If outside Austria, you must be based in Europe and willing to relocate