We are looking for an experienced QA Engineer to ensure the quality and reliability of AI agent-driven workflows and data-driven applications . The idóneo candidate will have strong QA/testing experience along with hands-on exposure to Generative AI, AI agents, and AI evaluation .
Key Responsibilities
- Test and validate AI agent-driven workflows and data-driven applications .
- Design and execute test cases for AI-powered applications and workflows.
- Use AI tools to automate test-case generation and execution .
- Evaluate AI agents for accuracy, reliability, consistency, and overall quality.
- Work with AI agent evaluation frameworks and testing methodologies.
- Create and maintain golden sets / evaluation datasets for AI agent evaluation.
- Identify, document, and troubleshoot defects and quality issues.
- Collaborate with development and AI/ML teams to improve application quality.
- Perform functional, regression, integration, and automated testing.
Required Skills
- Strong experience in QA / Software Testing .
- Experience testing AI/ML, GenAI, LLM, or AI agent-based applications .
- Experience with AI agent evaluation and evaluation frameworks.
- Experience using AI tools for test automation or test-case generation .
- Experience working with golden sets / golden datasets .
- Strong understanding of test automation and QA methodologies.
- Experience with data validation and data quality .
- Strong analytical and problem-solving skills.
Preferred
- Experience with Agentic AI / LLM applications .
- Experience with AI evaluation, benchmarking, or model quality testing.
- Python or scripting experience for test automation.