Postdoctoral Researcher / Postdoctoral Researcher

Postdoctoral Researcher - OCCL

100%, Singapore, fixed-term

The Singapore-ETH Centre was established in 2010 by ETH Zurich - The Swiss Federal Institute of Technology and Singapore's National Research Foundation (NRF), as part of the NRF's CREATE campus. As ETH Zurich's only research centre outside of Switzerland, the centre has strengthened the research capacity of ETH Zurich to develop sustainable solutions to global challenges in Singapore and beyond.

Set in a rapidly urbanising region, the Singapore-ETH Centre aims to provide practical solutions to some of the most pressing challenges in urban sustainability, resilience, and health through its programmes: Future Cities Lab Global (FCL Global) and Future Health Technologies (FHT).

Serving as an intellectual hub for research, the centre brings together principal investigators and researchers from diverse disciplines. We actively collaborate with universities, research institutes, industry, and government agencies to translate knowledge into practical solutions for real-world challenges.

Project Background

The current era of artificial intelligence is predominantly driven by advances in computational power and infrastructure. As models scale to unprecedented sizes, their capabilities are enhanced through strategies such as reinforcement learning (RL) and innovative frameworks like the "graph of thoughts." We are firmly in the "Age of Computation," where breakthroughs in AI are synonymous with optimizing massive computational resources. However, this rapid growth in computational demands faces a critical challenge: energy limitations. The construction of new power plants worldwide to meet AI workloads underscores the urgent need for efficiency to ensure these advancements benefit humanity sustainably. In Singapore, such resources may be scarce, hindering researchers' ability to progress in this vital field.

Our collaborative efforts with the A*STAR Institute of High Performance Computing (IHPC) and other partners in Singapore, such as NTU, could significantly drive the development of innovative AI methods, saving millions in compute time while accelerating scientific productivity. By integrating simulations that encode prior scientific knowledge within AI frameworks, we aim to create new models imbued with robust prior knowledge defined by fundamental equations and conservation laws. Our approach involves close collaboration with A*STAR / IHPC experts, who bring extensive experience in high-performance computing and AI-driven scientific research, ensuring that simulations and AI methodologies are combined to produce highly accurate and reliable models.

Job Description

The Postdoctoral Researcher will co-lead the development of a novel open-source accelerator communication library (OCCL). This library will support point-to-point and collective communication calls, allowing communication initiated by the host as well as within accelerator device kernels. It will support a wide range of devices and network substrates such as NVLINK and next-generation ethernet networks.

• Co-lead the design and development of an open-source accelerator communication library (OCCL) supporting point-to-point and collective communication for distributed AI workloads.
• Design and implement communication primitives and algorithms optimized for machine learning training and inference workloads, supporting communication initiated by both host applications and accelerator device kernels.
• Investigate and optimize communication patterns for large-scale deep learning workloads, including techniques for improving efficiency through communication scheduling and overlap with computation.
• Ensure the communication library is configurable and portable across diverse hardware platforms and network substrates, including modern high-performance interconnect technologies used in HPC and ML environments.
• Evaluate and optimize the communication library and associated software components on GPU clusters and large-scale computing systems, ensuring performance scalability, robustness, and usability across heterogeneous computing architectures.
• Collaborate with researchers and engineers at partner institutions in Singapore and Zurich to integrate OCCL with the broader FastTrackAI software ecosystem.
• Maintain effective communication and collaboration with supervisors, research staff, and external partners distributed across Singapore and Zurich.
• Prepare and publish key scientific outputs, including papers documenting research outcomes and system developments.
• Contribute to the co-supervision of MSc and BSc students working on related research topics.

Profile

• PhD in Computer Science or a related field.
• Strong background in computer science, parallel computing, compilers, performance optimization, and high-performance computer systems. Excellent knowledge of C and C++ is required.
• Good working knowledge of existing high-level communication libraries, such as MPI and NCCL.
• Experience and/or knowledge of modern communication and network technologies used in HPC and ML environments.
• Prior knowledge of communication optimization for large-scale ML training and inference workloads is essential. Publications in distributed ML systems or HPC systems are highly desirable.
• Experience in managing and executing larger software engineering projects.
• Ability to work independently and communicate effectively with remote colleagues.
• Proficient in written and spoken English.

Workplace

We Offer

• Accredited with 5 Tripartite Standards by Tripartite Alliance for Fair & Progressive Employment Practices (TAFEP) Singapore.
• A diverse workplace with 32 nationalities, offering ample opportunities for mutual learning.
• Positive and inclusive working environment.
• 25 days of annual leave for fixed-term contracts.
• 1 day of Birthday Leave.
• Annual dental benefits.
• Comprehensive healthcare insurance coverage.
• Flexible hybrid work arrangement (up to 2 days per week from home).
• Abundant networking opportunities across various disciplines.
• Accredited with NS mark certification.

The Singapore-ETH Centre is an equal opportunity and family-friendly employer. All candidates will be evaluated on their merits and qualifications, without regard to gender, race, age, or religion.

We Value Diversity and Sustainability

In line with our values, ETH Zurich encourages an inclusive culture. We promote equality of opportunity, value diversity, and nurture a working and learning environment in which the rights and dignity of all our staff and students are respected. Sustainability is a core value for us; we consistently work towards a climate-neutral future.

Curious? So Are We.

We look forward to receiving your online application using the form below. Only applications matching the job profile will be considered.