Member of Technical Staff - AI Pretraining

Help deliver one of the best foundational models in the world at Microsoft AI.

At Microsoft AI, we are on a mission to train the world’s most capable AI frontier models, pushing the boundaries of scale, performance and product deployment. The Pre-Training team at Microsoft AI tackles some of the most challenging problems in deep learning at scale. As a team, we will deliver one of the best foundation models in the world, forming the foundation of many initiatives across Microsoft AI.

About

We are looking for outstanding individuals excited about contributing to the next generation of systems that will transform the field. We are looking for candidates who:

• Have proven expertise in areas of interest, evidenced by an exceptional publication track record and significant technical leadership in high-impact projects
• Exhibit strong analytical skills, attention to detail, and a commitment to data-driven decision-making
• Have experience and/or in-depth understandings about large-scale distributed systems
• Demonstrate an ability to work collaboratively in a fast-paced, innovative environment
  
  

Responsibilities

• Develop algorithms, model architectures, data mixtures, and scaling laws for large-scale training using a rigorous data-driven approach grounded in meticulous ablations
• Drive algorithmic implementations, conduct experiments, and oversee flagship training runs on our in-house large-scale distributed stack
• Collaborate closely with teams on infrastructure, data, post-training, and multimodality
• Embody our culture and values.
  
  

Qualifications

Minimum Qualifications:

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, data modeling or data engineering work
• OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, or data engineering work
• OR equivalent experience.
• Experience working with specific frameworks or libraries for model pre-training, such as TensorFlow, PyTorch, or Hugging Face Transformers.
  

Preferred Qualifications

• Demonstrated experience in large-scale AI.
• Passionate about conversational AI and its deployment.
• Passion for learning new technologies and staying up to date with industry trends, best practices, and emerging technologies in AI.
  

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.