Applied Scientist / Applied Scientistess

Overview

The Spatial AI Lab is a distinguished part of the Applied Sciences Group, a Microsoft research and development organization dedicated to pioneering next-generation human-computer interaction technologies. We leverage the latest advancements in AI while exploring innovative hardware capabilities and device form factors. Our team comprises accomplished scientists and engineers with deep expertise in computer vision and multimodal AI, particularly in the realms of spatial and embodied AI.

As a Scientist specializing in Multimodal Foundation Models & Robotics, you will embark on research at the dynamic intersection of large-scale generative modeling and embodied AI with a focus on robotics. Your main objective will be to develop the core intelligence behind a new generation of agents, training the multimodal foundation models that enable them to perceive complex environments, reason through tasks, and operate seamlessly across both physical and digital landscapes. This position presents an exciting opportunity to enhance your expertise in training embodied foundation models, deploying algorithms on robotic hardware and large-scale AI systems, while contributing to groundbreaking research through publications and collaborations with esteemed partners like ETH Zurich.

Microsoft’s mission is to empower every individual and organization on the planet to achieve more. We cultivate a collaborative environment with a growth mindset, driving innovation to empower others, and striving to meet our shared objectives. Each day, we build upon our core values of respect, integrity, and accountability to foster a culture of inclusivity where everyone can thrive both at work and beyond.

Responsibilities

• Design and implement innovative foundation models and algorithms for general-purpose embodied agents.
• Develop high-performance machine learning pipelines and optimize data and learning stacks for scalability, efficiency, and performance.
• Optimize and deploy AI models on robotic hardware.
• Collaborate with Microsoft research and engineering teams to translate cutting-edge research into tangible real-world outcomes.
• Facilitate the team's rapid advancement, with success evaluated through both the enhancement of internal capabilities and significant contributions to the scientific community.
• Collaborate with leading academic partners like ETH Zurich to advance pioneering research at scale, with opportunities for co-authoring papers in top-tier venues, presenting at workshops, and mentoring students.

Qualifications

Preferred Qualifications:

• A PhD in Robotics, Machine Learning, or a related field, OR a minimum of 3 years of relevant industry experience.
• Proven coding, debugging, and engineering skills in programming languages such as Python or C++.
• Hands-on experience with modern deep learning frameworks (e.g., PyTorch, TensorFlow, JAX).
• A self-motivated team player with problem-solving skills and a desire to learn.
• Ability to convey complex technical concepts to diverse audiences.

Other Requirements:

• Candidates must meet Microsoft, customer, and/or government security screening requirements for this role. These include, but are not limited to, the Microsoft Cloud Background Check, which must be successfully completed upon hire/transfer and every two years thereafter.

Additional Preferred Qualifications:

• Experience in any of the following areas:
• Foundation Models: Hands-on training experience in topics such as LLMs, Large Vision-Language Models (VLMs), Video Generative Models and Diffusion Algorithms, or Action-based Transformers and Vision Language Action models (VLAs).
• Large-Scale ML Systems: Working knowledge of large-scale machine learning compute systems.
• Robotics: Hands-on training in robot learning techniques, such as reinforcement learning, imitation learning, and classical control methods.
• A solid understanding of robot kinematics, dynamics, and sensors.
• Familiarity with control algorithms like PID, Model Predictive Control (MPC), and whole-body control.
• A proven track record of impact, either through first-author research publications at top-tier machine learning or robotics conferences (e.g., CoRL, RSS, NeurIPS, ICML, ICLR, CVPR) or through contributions to successful industry initiatives.

Apply online using the form below. Please note that only applications matching the job profile will be considered.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws and regulations. If you require assistance with religious accommodations or reasonable accommodations due to a disability during the application process, please refer to our policies on requesting accommodations.