Overview
The Spatial AI Lab is an integral part of the Applied Sciences Group, a Microsoft research and development organization committed to pioneering next-generation human-computer interaction technologies. We leverage cutting-edge AI advancements and explore innovative hardware capabilities and device form factors. Our team comprises seasoned scientists and engineers with extensive expertise in computer vision and multi-modal AI, particularly focusing on spatial and embodied AI.
As a Scientist specializing in Multimodal Foundation Models & Robotics, you will engage in research at the exciting crossroads of large-scale generative modeling and embodied AI, specifically with an emphasis on robotics. Your primary objective will be to develop the core intelligence for a new generation of agents, training multimodal foundation models that enable them to perceive intricate environments, reason through tasks, and operate fluidly across both the physical and digital realms. This role offers a valuable opportunity to enhance your skills in training embodied foundation models, deploying algorithms on robotic hardware and large-scale AI systems, and contributing to groundbreaking research through publications and collaborations with esteemed partners like ETH Zurich.
Microsoft’s mission is to empower every individual and organization on the planet to achieve more. We come together with a growth mindset, innovating to empower others, and collaborating to realize our shared aspirations. We uphold values of respect, integrity, and accountability, creating a culture of inclusion where everyone can thrive both at work and beyond.
Responsibilities
- Design and implement innovative foundation models and algorithms for general-purpose embodied agents.
- Develop high-performance machine learning pipelines and optimize data and learning stacks for scalability, efficiency, and performance.
- Optimize and deploy AI models on robotic hardware.
- Collaborate across Microsoft research and engineering teams to translate cutting-edge research into real-world impact.
- Drive the team’s rapid progress, measuring success by advancements in internal capabilities and impactful contributions to the scientific community.
- Engage with top academic partners like ETH Zurich to promote pioneering research at scale, including opportunities to co-author works in premier venues, present at workshops, and mentor students.
Qualifications
Preferred Qualifications:
- A PhD in Robotics, Machine Learning, or a related field, OR 3+ years of relevant industry experience.
- Demonstrated coding, debugging, and engineering skills in programming languages such as Python or C++.
- Hands-on experience with modern deep learning frameworks (e.g., PyTorch, TensorFlow, Jax).
- Self-motivated team player, problem solver, and eager to learn.
- Ability to present complex technical concepts to a diverse audience.
Other Requirements:
- Meeting Microsoft, customer, and/or government security screening requirements is necessary for this role. This includes, but is not limited to, passing the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Additional Preferred Qualifications:
- Hands-on training experience in foundation models, especially in areas like Large Language Models (LLMs), large vision-language models (VLMs), video generative models and diffusion algorithms, or action-based transformers and Vision Language Action models (VLAs).
- Experience with large-scale machine learning compute systems.
- Hands-on training experience in robot learning techniques, including reinforcement learning and imitation learning, as well as classical control methods.
- Solid understanding of robot kinematics, dynamics, and sensors.
- Familiarity with control algorithms such as PID, model predictive control (MPC), and whole-body control.
- A proven track record of impact, demonstrated by first-author research publications at top-tier machine learning or robotics conferences or contributions to successful industry initiatives.
How to Apply
Apply online using the form below. Only applications matching the job profile will be considered.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations, and ordinances.