Introduction
A career in IBM Consulting fosters long-term relationships and close collaboration with clients across the globe. You'll engage with visionaries in multiple industries to enhance the hybrid and AI journey for the most innovative and valuable companies worldwide. Your ability to create impactful change is supported by our strategic partner ecosystem and robust technology platforms throughout the IBM portfolio, including IBM Software and Red Hat.
Curiosity and a relentless quest for knowledge are foundational to success in IBM Consulting. In your role, you’ll be encouraged to challenge the status quo, explore ideas beyond your immediate responsibilities, and develop creative solutions that lead to groundbreaking results for a diverse network of clients. Our culture of evolution and empathy focuses on long-term career growth and development opportunities within an environment that values your unique skills and experiences.
As part of this role, you will work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), delivering deep technical and industry expertise to a wide array of public and private sector clients around the globe. Our delivery centers provide localized skills and technical expertise to drive innovation and the adoption of new technology.
Your Role and Responsibilities
We are seeking a Lead AutoGen Engineer with extensive experience in Autogen who has advanced beyond building RAG pipelines to design systems that ensure agentic AI reliability in regulated, high-stakes environments for both client-facing and internal platforms. This role is perfect for someone who has grappled with the challenges of naive retrieval against complex regulatory language, built an agentic workflow from the ground up, and approaches LLM outputs with the same level of scrutiny as a systems engineer designing correctness guarantees.
This is a hands-on technical leadership position for someone who designs and constructs production-grade agentic systems—not merely as a research exercise, but as deliverables that function reliably in compliance-driven, high-stakes environments. The problems you will encounter do not have off-the-shelf solutions, requiring you to make architectural decisions, iterate designs as necessary, and clearly communicate these decisions to both technical teams and enterprise stakeholders.
What You Will Do
- Design and deliver RAG systems for complex, document-heavy domains, defining ingestion strategy, retrieval architecture, and generation-side optimization according to content type and use case.
- Architect multi-agent orchestration systems to coordinate specialized agents using autogen and other frameworks across parallel and sequential workflows, integrating structured quality evaluation and targeted correction loops into the pipeline.
- Construct LLM routing and evaluation infrastructure, selecting models per task, optimizing generation parameters, and ensuring full auditability of outputs for regulated delivery environments.
- Lead end-to-end technical delivery: from problem framing and system design through implementation, quality assurance, and stakeholder communication.
- Collaborate across regulated industries including life sciences, insurance, and financial services, understanding compliance, traceability, and domain accuracy at the implementation level.
- Assess and apply fine-tuning approaches when retrieval-based solutions are insufficient, exercising judgment to determine when each is appropriate.
- Mentor engineers and establish technical standards for agentic AI development within the practice.
- Work with client stakeholders to translate complex domain requirements into functional system behaviors.
What We Offer
- Individual career path opportunities
- Access to a wide range of training and certification offerings
- A culture of knowledge sharing
- An environment where your ideas are valued and encouraged
- The chance to work on projects with one of the largest IT companies
Required Technical and Professional Expertise
- Proven experience (8+ years) in building and iterating on production-grade agentic systems across the full stack—ingestion, retrieval, orchestration, generation, and quality assurance.
- Deep understanding of statistics, probability, data science, machine learning, and transformer architectures.
- Strong expertise in multi-agent frameworks, including designing orchestration patterns, parallel agent architectures, and structured output pipelines.
- Thorough comprehension of data ingestion and RAG pipeline designs across various content types, retrieval strategies, and generation optimization techniques.
- Extensive experience delivering agentic systems to production pipelines within regulated industries.
- Experience integrating multiple LLM providers with routing logic, audit logging, and parameter optimization for enterprise and regulated contexts.
- Advanced skills in prompt and context engineering.
- Expertise in integrating agentic solutions with cloud platforms such as Azure OpenAI, IBM Watsonx, and AWS while ensuring governance, safety, and monitoring.
- Proficiency in Python and relevant engineering tools; experience with cloud platforms such as AWS and GCP.
- Proven track record of impacting operational efficiency for enterprise clients in regulated industries.
- Advanced database skills across SQL (MySQL, SQL Server), NoSQL (MongoDB, Neo4j), and VectorDBs (CosmosDB, Azure AI Search, FAISS).
- Ability to lead small technical teams, establish direction, and maintain delivery quality across complex engagements.
- Strong communication skills—capable of presenting architectural decisions and system behaviors to non-technical audiences, including clinical, regulatory, and business stakeholders.
- Language proficiency in Hindi and English: professional proficiency is required for coordination with other teams embedded in the engagement.
Preferred Technical and Professional Experience
- Experience with clinical or regulatory document workflows—pharmaceutical submissions, compliance reporting, or large-scale structured document generation.
- Experience in working with IBM's agentic asset portfolio.
- Familiarity with Model Context Protocol (MCP) and emerging agentic interoperability standards, skills, and tools.
- Multi-agent system design demonstrating breadth of agentic architecture application beyond a single domain.
Apply online using the form below. Please note, only applications matching the job profile will be considered.