AI Testing Engineer / AI QA Engineer | Remote | Contract until EOY 2026
We are seeking an experienced AI Testing Engineer or AI QA Engineer to join a long-term AI transformation program. In this role, you will contribute to the development of high-quality AI-powered applications tailored for enterprise users.
This is an excellent opportunity for QA professionals eager to delve deeper into Generative AI, LLMs, chatbot testing, prompt validation, and AI quality assurance while working on a fully remote international project.
Responsibilities
- Test AI-powered applications and business workflows
- Validate AI-generated responses for accuracy, relevance, and completeness
- Design and execute functional, integration, and regression test scenarios
- Perform prompt validation across multiple business use cases
- Identify hallucinations, inconsistencies, bias, and incorrect AI responses
- Test APIs, backend integrations, and connected enterprise systems
- Validate authentication, permissions, and role-based access
- Conduct Responsible AI, security, and prompt injection testing
- Log and manage defects using Jira or Azure DevOps
- Work closely with developers, AI engineers, business analysts, and product owners
- Support release testing and quality sign-off activities
Required Skills
- 3-6+ years of experience in Software Testing / QA
- Strong functional, integration, and regression testing experience
- Experience designing test cases and executing end-to-end testing
- Understanding of AI concepts including:
- Large Language Models (LLMs)
- Prompt testing
- AI response validation
- Hallucinations
- Context handling
- Knowledge retrieval
- Experience with Jira, Azure DevOps, or similar defect management tools
- Strong analytical and communication skills
Nice to Have
- Experience in chatbot, NLP, or Generative AI testing
- Familiarity with Azure OpenAI or Microsoft Copilot Studio
- Experience with Azure AI Services and Power Platform
- Knowledge of Postman / Swagger
- Understanding of RAG (Retrieval-Augmented Generation) and prompt engineering
- Experience with Selenium or Playwright
- Knowledge of security testing and Responsible AI principles
Project Details
- ASAP start
- Contract until the end of 2026 with strong extension potential
- Fully remote
- EU-based consultants only
Apply online using the form below. Please note that only applications matching the job profile will be considered.
Work locationPoland, Warsaw, Switzerland