Track This Job
Add this job to your tracking list to:
- Monitor application status and updates
- Change status (Applied, Interview, Offer, etc.)
- Add personal notes and comments
- Set reminders for follow-ups
- Track your entire application journey
Save This Job
Add this job to your saved collection to:
- Access easily from your saved jobs dashboard
- Review job details later without searching again
- Compare with other saved opportunities
- Keep a collection of interesting positions
- Receive notifications about saved jobs before they expire
AI-Powered Job Summary
Get a concise overview of key job requirements, responsibilities, and qualifications in seconds.
Pro Tip: Use this feature to quickly decide if a job matches your skills before reading the full description.
Team will be building cloud solutions meeting scales that few companies in the industry are required to support, that leverage state of the art technologies to deliver holistic protection to a planet scale user base. Office 365 is the industry leader in hosted productivity suites and boasts to be the fastest growing business at Microsoft with more than 100 million seats hosted in multiple data centers across the globe. The SCM Engineering team provides leadership, direction and accountability for application architecture, Cloud design, infrastructures development and end to end implementation. You will independently determine and develop architectural approaches and Infrastructure solutions, conduct business reviews, and operate our production services. Strong collaboration skills will be required to work closely with other engineering teams to ensure services/systems are highly stable and performant and meet the expectations of internal and external customers and users.
Responsibilities
- Design, develop, and deploy end-to-end AI/ML systems, including data ingestion, model training, evaluation, and integration into production environments.
- Build and optimize applications leveraging LLMs and open-source GenAI frameworks such as LangChain, LlamaIndex, Haystack, Transformers, AutoGen, and DSPy.
- Implement advanced GenAI techniques including agent-based orchestration, prompt engineering, retrieval-augmented generation (RAG), and model fine-tuning.
- Write production-grade software in Python and C# or Java, ensuring maintainability, scalability, and performance.
- Collaborate with cross-functional teams to translate business requirements into technical solutions.
- Ship and maintain large-scale AI applications, with a focus on performance monitoring and continuous improvement.
- Conduct rigorous evaluation of AI models using appropriate metrics and benchmarks.
- Optimize models for latency, throughput, and accuracy in real-world scenarios.
- Work closely with data scientists, product managers, and other engineers to drive AI initiatives.
- Stay current with the latest advancements in GenAI, LLMs, and AI frameworks.
- Prototype and experiment with emerging technologies to assess feasibility and impact.  
- Bachelor's Degree in Computer Science, Data Science or related technical field
- Should have total 4+ years in Data Science experience
- 2+ years technical engineering experience with coding in languages including C#, Python and Pytorch
- 2+ years of experience in shipping at least 2 large scale ML/AI-based services or applications on cloud platforms (Azure, AWS, GCP, etc.)
- 3+ years of experience with LLMs and open-source GenAI frameworks, such as LangChain, LlamaIndex, Haystack, or equivalents (e.g., Transformers, AutoGen, DSPy), including agent-based orchestration, prompt engineering, retrieval-augmented generation (RAG), and fine-tuning and evaluation.
- Proficiency in writing production-quality software code in one or more modern programming languages (Python, C#)  
Key Skills
Ranked by relevanceReady to apply?
Join Microsoft and take your career to the next level!
Application takes less than 5 minutes

