Job Overview
We are looking for an experienced QA Engineer to ensure the quality and reliability of AI agent-driven workflows and data-driven applications. The idóneo candidate will have strong QA/testing experience along with hands-on exposure to Generative AI, AI agents, and AI evaluation.
Key Responsibilities
• Test and validate AI agent-driven workflows and data-driven applications.
• Design and execute test cases for AI-powered applications and workflows.
• Use AI tools to automate test-case generation and execution.
• Evaluate AI agents for accuracy, reliability, consistency, and overall quality.
• Work with AI agent evaluation frameworks and testing methodologies.
• Create and maintain golden sets / evaluation datasets for AI agent evaluation.
• Identify, document, and troubleshoot defects and quality issues.
• Collaborate with development and AI/ML teams to improve application quality.
• Perform functional, regression, integration, and automated testing.
Required Skills
• Strong experience in QA / Software Testing.
• Experience testing AI/ML, GenAI, LLM, or AI agent-based applications.
• Experience with AI agent evaluation and evaluation frameworks.
• Experience using AI tools for test automation or test-case generation.
• Experience working with golden sets / golden datasets.
• Strong understanding of test automation and QA methodologies.
• Experience with data validation and data quality.
• Strong analytical and problem-solving skills.
Preferred
• Experience with Agentic AI / LLM applications.
• Experience with AI evaluation, benchmarking, or model quality testing.
• Python or scripting experience for test automation.