Postdoctoral Researcher / Postdoctoral Researcheress

Postdoctoral Researcher - OCCL

100%, Singapore, fixed-term

The Singapore-ETH Centre was established in 2010 by ETH Zurich - The Swiss Federal Institute of Technology and Singapore's National Research Foundation (NRF), as part of the NRF's CREATE campus. As ETH Zurich's only research centre outside of Switzerland, the centre has strengthened the research capacity of ETH Zurich to develop sustainable solutions to global challenges in Switzerland, Singapore, and the surrounding regions.

Situated in a rapidly urbanising region, the Singapore-ETH Centre aims to provide practical solutions to pressing challenges of urban sustainability, resilience, and health through its programmes: Future Cities Lab Global (FCL Global) and Future Health Technologies (FHT).

The centre serves as an intellectual hub for research, bringing together principal investigators and researchers from diverse disciplines and backgrounds. To promote the exchange of ideas and expertise, our researchers actively collaborate with universities and research institutes while engaging with industry and government agencies to translate knowledge into practical solutions to real-world problems.

Project Background

The current era of artificial intelligence is driven by advances in computational power and infrastructure. As models scale to unprecedented sizes, their capabilities are enhanced through strategies such as reinforcement learning (RL) and innovative frameworks like the "graph of thoughts." We are firmly in the "Age of Computation," where breakthroughs in AI are synonymous with the ability to harness and optimize massive computational resources. However, this rapid growth presents a challenge: energy limitations. As new power plants are constructed globally to meet AI workload demands, it underscores the urgent need for efficiency to ensure these advancements benefit humanity sustainably. In Singapore, such resources may be scarce and hinder the country's researchers' ability to advance in this crucial field.

Our collaborative efforts with the A*STAR Institute of High Performance Computing (IHPC) and other partners in Singapore, such as NTU, could be pivotal in this field, driving the development and implementation of innovative AI methods and saving millions of dollars in compute time while accelerating scientific productivity. To enhance the efficacy of AI for Science models, it is imperative to integrate simulations that encode prior scientific knowledge within these AI frameworks. Our approach involves close collaboration with A*STAR / IHPC experts, who bring extensive experience in high-performance computing and AI-driven scientific research, to push the boundaries of what AI can achieve in scientific domains.

Job Description

The Postdoctoral Researcher will co-lead the development of a novel open-source accelerator communication library (OCCL). This communication library will support both point-to-point and collective communication calls, enabling communication initiated by the host and within accelerator device kernels. It should accommodate various devices and network substrates, including NVLINK and next-generation ethernet networks.

• Co-lead the design and development of an open-source accelerator communication library (OCCL) supporting point-to-point and collective communication for distributed AI workloads.
• Design and implement communication primitives and algorithms optimized for machine learning training and inference workloads.
• Investigate and optimize communication patterns for large-scale deep learning workloads, improving efficiency through scheduling and computation overlap.
• Ensure the library is configurable and portable across diverse hardware platforms and network substrates.
• Evaluate and optimize the communication library on GPU clusters and large-scale computing systems.
• Collaborate with researchers and engineers at partner institutions to integrate OCCL within the broader FastTrackAI software ecosystem.
• Maintain effective communication and collaboration with supervisors, research staff, and external partners in Singapore and Zurich.
• Prepare and publish key scientific outputs, documenting research outcomes and system developments.
• Contribute to the co-supervision of MSc and BSc students working on related research topics.

Profile

• PhD in Computer Science or a related field.
• Strong background in computer science, parallel computing, compilers, performance optimization, and high-performance computer systems.
• Proficient in C and C++.
• Knowledge of existing high-level communication libraries, like MPI and NCCL.
• Experience or knowledge of modern communication technologies in HPC and ML environments, such as UCX, NVLINK, InfiniBand, UltraEthernet, or related frameworks.
• Prior knowledge of communication optimization for large-scale ML workloads is essential, along with any related publications.
• Experience managing larger software engineering projects is required.
• Ability to work independently while communicating effectively with remote colleagues.
• Proficiency in written and spoken English.

Workplace

What We Offer

• Accredited with 5 Tripartite Standards by Tripartite Alliance for Fair & Progressive Employment Practices (TAFEP), Singapore.
• A diverse workplace with 32 nationalities, offering ample opportunities for mutual learning.
• Positive and inclusive working environment.
• 25 days of annual leave for fixed-term contracts.
• 1 day of Birthday Leave.
• Annual dental benefits.
• Support for your physical and mental wellness.
• Comprehensive healthcare insurance coverage.
• Flexible hybrid work arrangement (up to 2 days per week from home).
• Abundant networking opportunities across various disciplines.
• Accredited with NS mark certification.

The Singapore-ETH Centre is an equal opportunity and family-friendly employer. All candidates will be evaluated based on their merits and qualifications, without regard to gender, race, age, or religion.

Valuing Diversity and Sustainability

In line with our values, ETH Zurich promotes an inclusive culture, equality of opportunity, and diversity, respecting the rights and dignity of all staff and students. Sustainability is a core value for us, and we continuously work towards a climate-neutral future.

Curious? So Are We.

We look forward to your application! Apply online using the form below. Only applications matching the job profile will be considered.