Postdoctoral Researcher / Postdoctoral Researcheress

Postdoctoral Researcher - OCCL

100%, Singapore, fixed-term

The Singapore-ETH Centre was established in 2010 by ETH Zurich - The Swiss Federal Institute of Technology and Singapore's National Research Foundation (NRF), as part of the NRF's CREATE campus. As ETH Zurich's only research centre outside of Switzerland, the centre has significantly enhanced the research capacity of ETH Zurich, aiming to develop sustainable solutions to global challenges in Singapore, Switzerland, and the surrounding regions.

Situated in a rapidly urbanizing region, the Singapore-ETH Centre is dedicated to providing practical solutions to some of the most pressing challenges in urban sustainability, resilience, and health through its programmes: Future Cities Lab Global (FCL Global) and Future Health Technologies (FHT).

Our centre serves as an intellectual hub for research, uniting principal investigators and researchers from diverse disciplines. To foster the exchange of ideas and expertise, our researchers actively collaborate with universities, research institutes, industry, and government agencies to translate knowledge into practical solutions for real-world problems.

Project Background

The current era of artificial intelligence is predominantly driven by advances in computational power and infrastructure. As models grow to unprecedented sizes, their capabilities are enhanced through strategies such as reinforcement learning (RL) and innovative frameworks like the "graph of thoughts." We are firmly in the "Age of Computation," where breakthroughs in AI are reliant on the ability to leverage and optimize massive computational resources. However, this rapid growth is accompanied by significant challenges, particularly regarding energy limitations. The construction of new power plants worldwide to meet AI demands highlights the urgent need for efficiency, ensuring these advancements benefit humanity sustainably. In Singapore, such resources may be scarce, potentially hindering researchers' progress in this critical field.

Our collaborative efforts with the A*STAR Institute of High Performance Computing (IHPC) and other partners in Singapore, such as NTU, are pivotal in developing and implementing innovative AI methods that could save millions in compute time while accelerating scientific productivity. To enhance the efficacy of AI for Science models, it is essential to integrate simulations that encode prior scientific knowledge within these AI frameworks. This integration aims to create new models imbued with robust prior knowledge, defined by fundamental equations and conservation laws. Our approach involves close collaboration with experts from A*STAR / IHPC, who bring extensive experience in high-performance computing and AI-driven scientific research. Together, we strive to push the boundaries of what AI can achieve in scientific domains, ensuring that simulations and AI methodologies are effectively combined to produce highly accurate and reliable models.

Job Description

The Postdoctoral Researcher will co-lead the development of a novel open-source accelerator communication library (OCCL). This library will support both point-to-point and collective communication calls, accommodating communication initiated by the host as well as communication originating within accelerator device kernels. It will also support a wide range of devices and network substrates, such as NVLINK and next-generation Ethernet networks.

• Co-lead the design and development of an open-source accelerator communication library (OCCL) supporting point-to-point and collective communication for distributed AI workloads.
• Design and implement communication primitives and algorithms optimized for machine learning training and inference workloads, supporting communication initiated by both host applications and accelerator device kernels.
• Investigate and optimize communication patterns for large-scale deep learning workloads, including techniques for improving efficiency through communication scheduling and overlap with computation.
• Ensure the communication library is configurable and portable across diverse hardware platforms and network substrates, including modern high-performance interconnect technologies used in HPC and ML environments such as UCX, NVLINK, InfiniBand, UltraEthernet, and related networking frameworks.
• Evaluate and optimize the communication library and associated software components on GPU clusters and large-scale computing systems, ensuring performance scalability, robustness, and usability across heterogeneous computing architectures.
• Collaborate with researchers and engineers at partner institutions in Singapore and Zurich to integrate OCCL with the broader FastTrackAI software ecosystem.
• Maintain effective communication and collaboration with supervisors, research staff, and external partners distributed across Singapore and Zurich, ensuring alignment of research objectives and deliverables.
• Prepare and publish key scientific outputs, including papers documenting research outcomes and system developments.
• Contribute to the co-supervision of MSc and BSc students working on related research topics.

Profile

• PhD in Computer Science or a related field.
• A strong background in computer science, parallel computing, compilers, performance optimization, and high-performance computer systems.
• Excellent knowledge of C and C++ is required.
• A good working knowledge of the design principles of existing high-level communication libraries, such as MPI and NCCL.
• Experience and/or knowledge of modern communication and network technologies used in HPC and ML environments, such as UCX, NVLINK, InfiniBand, UltraEthernet, or related frameworks.
• Prior knowledge of communication optimization for large-scale ML training and inference workloads is essential; candidates with publications in distributed ML systems or HPC systems are highly desirable.
• Prior experience in managing and executing larger software engineering projects, as the aim of this project is to build a software product, not just a prototype.
• The team working on this subject is distributed across Singapore and Zurich; thus, candidates must be able to work independently and communicate effectively with remote colleagues.
• Proficiency in written and spoken English is a must.

Workplace

We Offer

• Accredited with 5 Tripartite Standards by Tripartite Alliance for Fair & Progressive Employment Practices (TAFEP) Singapore.
• A diverse workplace with 32 nationalities, providing ample opportunities for mutual learning.
• A positive and inclusive working environment.
• 25 days of annual leave for fixed-term contracts.
• 1 day of Birthday Leave.
• Annual dental benefits.
• Commitment to being a supportive employer prioritizing physical and mental wellness.
• Comprehensive healthcare insurance coverage.
• Flexible hybrid work arrangement (up to 2 days per week from home).
• Abundant networking opportunities across various disciplines.
• Accredited NS mark certification.

The Singapore-ETH Centre is an equal opportunity and family-friendly employer. All candidates will be evaluated on their merits and qualifications, without regard to gender, race, age, or religion.

We Value Diversity and Sustainability

In line with our values, ETH Zurich encourages an inclusive culture. We promote equality of opportunity, value diversity, and nurture an environment in which the rights and dignity of all our staff and students are respected. Visit our Equal Opportunities and Diversity website to learn how we ensure a fair and open environment that allows everyone to grow and flourish. Sustainability is a core value for us—we are consistently working towards a climate-neutral future.

Curious? So Are We.

We look forward to receiving your online application using the form below. Applications matching the job profile will be considered.

• A cover letter detailing your motivation for the project and how your background aligns with the position.
• Your CV, including the names and contact information of 2 references.
• A copy of your university transcripts as PDFs.
• Reference or recommendation letters may also be included.

For further information about the SEC, please visit our website. For any inquiries, contact Mrs. Iva Kabosch at iva.kabosch@inf.ethz.ch.