AI Applied Scientist / AI Applied Scientistess

Overview

The Spatial AI Lab is a vital part of the Applied Sciences Group, a Microsoft research and development organization focused on pioneering next-generation human-computer interaction technologies. We leverage the latest advancements in AI while exploring new hardware capabilities and diverse device form factors. Our talented team of scientists and engineers possesses deep expertise in areas such as computer vision, multimodal AI, and spatial and embodied AI.

In this role, you will contribute to the development of intelligent systems for new types of agents by training and refining multimodal AI models. You will have the opportunity to enhance your skills in building and utilizing AI models for Microsoft products and large-scale AI systems. Additionally, you'll be engaged in cutting-edge research alongside esteemed partners like ETH Zurich, with opportunities to publish in prestigious venues, present at workshops, and mentor aspiring students.

At Microsoft, our mission is to empower every individual and organization on the planet to achieve more. As a team, we embrace a growth mindset, drive innovation to empower others, and collaborate toward our shared objectives. We uphold our values of respect, integrity, and accountability daily, fostering a culture of inclusion where everyone can excel both at work and beyond.

Responsibilities

• Research novel machine learning algorithms and models.
• Engage in pre and/or post-training of foundational multimodal models.
• Develop data and learning solutions that emphasize scalability, efficiency, and performance.
• Curate training and evaluation datasets/benchmarks.
• Optimize models for CPUs, GPUs, and NPUs, integrating them into products.
• Collaborate with various Microsoft research and engineering teams.

Qualifications

Required Qualifications:

• A PhD in Machine Learning or Computer Vision, or 3+ years of relevant industry experience.
• Strong programming skills in languages such as Python and/or C++.
• Hands-on experience with contemporary deep learning frameworks (e.g., PyTorch, TensorFlow, JAX).
• Self-motivated, collaborative team player, problem solver, and eager to learn.
• Ability to communicate complex technical concepts to a diverse audience.

Preferred Qualifications:

• Experience in one or more of the following areas:
• Hands-on experience with multimodal models, including:
• Pre and/or post-training of large vision-language models.
• Techniques such as pruning, distillation, and fine-tuning.
• Large Language Models (LLMs);
• Large Vision-Language Models (VLMs);
• Video generative models and diffusion algorithms;
• Action-based transformers and Vision Language Action models (VLAs).
• Experience with large-scale machine learning compute systems.
• Publication track record of impact through research publications at top-tier machine learning or computer vision conferences (NeurIPS, ICML, CVPR, ECCV, ICCV) or contributions to successful industry initiatives.

To apply, use the form below. Please note that only applications matching the job profile will be considered.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations, and ordinances. If you require assistance with religious accommodations and/or reasonable accommodations due to a disability during the application process, please refer to our resources on requesting accommodations.