Introduction
A career in IBM Consulting embraces long-term relationships and close collaboration with clients across the globe.
In this role, you will engage with visionaries from various industries to enhance the hybrid and AI journey for some of the most innovative and valuable companies in the world. Your ability to drive impact and facilitate meaningful change for clients is supported by our strategic partner ecosystem and robust technology platforms across the IBM portfolio, including IBM Software and Red Hat.
At IBM Consulting, curiosity and a relentless pursuit of knowledge are foundational to success. You will be encouraged to challenge the norm, explore ideas beyond your immediate responsibilities, and devise creative solutions that lead to groundbreaking impacts for our extensive network of clients. Our culture promotes evolution and empathy, focusing on your long-term career growth and providing ample development opportunities in an environment that values your unique skills and experiences.
In this role, you'll be part of one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a diverse range of public and private sector clients around the world. Our delivery centers provide locally based skills and technical expertise that drive innovation and nurture the adoption of new technologies.
Your Role and Responsibilities
We are seeking a Lead AutoGen Engineer with extensive experience in Autogen who has advanced beyond simply building Retrieval-Augmented Generation (RAG) pipelines. This role focuses on designing systems that ensure agentic AI operates reliably in regulated, high-stakes environments for both client-facing and internal platforms.
This is a hands-on technical leadership position ideal for someone who understands the limitations of naive retrieval against complex regulatory language, has built agentic workflows from scratch, and approaches Large Language Model (LLM) outputs with a systems engineering mindset concerning correctness guarantees. You will design and deliver production-grade agentic systems, not merely as a research endeavor, but as engineering deliverables that function effectively in compliance-driven environments. The challenges you will tackle do not have off-the-shelf solutions, and you will be expected to make architectural decisions, iterate on designs as needed, and communicate effectively with both technical teams and enterprise stakeholders.
What You Will Do
- Design and deliver RAG systems for complex, document-heavy domains, defining ingestion strategies, retrieval architecture, and generation-side optimization tailored to content types and use cases.
- Architect multi-agent orchestration systems coordinating specialized agents utilizing autogen and other frameworks across parallel and sequential workflows, with structured quality evaluation and targeted correction loops integrated into the pipeline.
- Build LLM routing and evaluation infrastructure by selecting appropriate models for tasks, optimizing generation parameters, and ensuring complete auditability of outputs in regulated environments.
- Lead end-to-end technical delivery: from problem framing and system design through implementation, quality assurance, and stakeholder communication.
- Work across regulated industries, including life sciences, insurance, and financial services, understanding compliance, traceability, and domain accuracy at the implementation level.
- Evaluate and apply fine-tuning approaches where retrieval-based solutions fall short, exercising sound judgment regarding their appropriateness.
- Mentor engineers and establish technical standards for agentic AI development within the practice.
- Collaborate with client stakeholders to translate complex domain requirements into functional system behaviors.
What We Offer
- Individual career path customization
- Access to extensive training and certification opportunities
- A culture of knowledge sharing
- An environment that encourages the contribution of your ideas
- The chance to work on projects within one of the largest IT companies
Required Technical and Professional Expertise
- Proven experience (8+ years) in building and iterating on production-grade agentic systems across the full stack—ingestion, retrieval, orchestration, generation, and quality assurance.
- Deep understanding of statistics, probability, data science, machine learning, and transformer architectures.
- Strong expertise in multi-agent frameworks and experience designing orchestration patterns, parallel agent architectures, feedback loops, and structured output pipelines.
- Thorough understanding of data ingestion and RAG pipeline designs across diverse content types, retrieval strategies, and generation optimization techniques.
- Significant experience delivering agentic systems end-to-end in production pipelines within regulated industries.
- Ability to integrate various LLM providers with routing logic, audit logging, and parameter optimization for enterprise contexts.
- Proficiency in prompt and context engineering.
- Experience integrating agentic solutions with cloud platforms such as Azure OpenAI, IBM Watsonx, and AWS, ensuring governance, safety, and monitoring.
- Proficient in Python and related engineering tools; experience with cloud platforms including AWS and GCP.
- A track record of delivering agentic systems with measurable operational impacts for enterprise clients in regulated industries.
- Advanced database skills across SQL (MySQL, SQL Server), NoSQL (MongoDB, Neo4j), and Vector databases (CosmosDB, Azure AI Search, FAISS).
- Ability to lead small technical teams, set direction, and maintain high delivery quality across complex engagements.
- Strong communication skills to present architectural decisions and system behaviors to non-technical audiences, including clinical, regulatory, and business stakeholders.
- Language proficiency in Hindi and English to facilitate coordination with other teams involved in the engagement.
Preferred Technical and Professional Experience
- Experience with clinical or regulatory document workflows—pharmaceutical submissions, compliance reporting, or large-scale structured document generation.
- Familiarity with IBM's agentic asset portfolio.
- Knowledge of Model Context Protocol (MCP) and emerging agentic interoperability standards, along with related skills and tools.
- Experience with multi-agent system design, demonstrating the application of agentic architecture across multiple domains.
Apply online using the form below. Please note that only applications matching the job profile will be considered.