AI Agentic Studio QA
Coditude · IT Services & Consulting
- Pune, India
- On-site
- Posted today
About the job
Experience: 4+ years
Role Overview
Coditude is looking for an AI Agentic Studio QA professional with around 4 years of experience in quality assurance
and test automation. The successful candidate will develop robust test strategies, maintain automated coverage for
web applications and APIs, and help validate AI-enabled workflows involving large language models (LLMs),
multi-agent systems, retrieval-augmented generation (RAG), tool calling, MCP, embeddings, and vector databases.
Key Responsibilities
Design test strategies and detailed test cases for complex features and workflows.
Perform manual and automated testing to identify, document, track, and verify bugs and defects.
Create, maintain, and improve automated test suites for functional, integration, web, and API testing.
Participate in code reviews and provide constructive feedback on test automation code.
Collaborate with developers and product managers to investigate issues, debug failures, and clarify
requirements.
Participate in Agile/Scrum ceremonies, communicate testing progress, and discuss defects, risks, and open
issues.
Validate AI-driven functionality, including prompt behavior, agent workflows, RAG, tool calling, and output quality.
Required Skills & Qualifications
Proficiency in Java programming and Git version control.
Hands-on experience with web test automation using Selenium WebDriver and Java.
Experience in API testing and automation, with working knowledge of Postman and REST Assured.
Experience with the TestNG testing framework.
Working knowledge of Maven and IntelliJ IDEA.
Experience with or knowledge of Jenkins and CI/CD workflows.
Understanding of Docker and containerization concepts.
Understanding of LLM testing concepts, including multi-agent systems, RAG, tool calling, and MCP.
Knowledge of testing embeddings and vector databases.
Experience with prompt engineering and prompt/output validation.
Understanding of Agile/Scrum methodologies and familiarity with Jira and Wiki applications.