Overview

QA Engineer (EST hours) ID35731 at AgileEngine

What you will do

- Design and execute both automated and manual end-to-end test strategies across all layers of the testing pyramid;
- Validate AI model performance, including accuracy, confidence thresholds, and fallback behavior;
- Automate quality processes from data ingestion to extraction and classification, with a focus on speed, repeatability, and resilience;
- Test and validate integration points between AI components and core business logic;
- Support and enhance CI/CD pipelines by maintaining test infrastructure and defining quality gates, automated scripts, and synthetic data;
- Define and track quality metrics that matter to the business (e.g., turnaround time, confidence scores, correction rates);
- Stay on the cutting edge—continuously learn and apply the latest AI and QA practices to make the impossible possible for our customers.

MUST HAVES

- Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent experience;
- 3+ years of experience in QA, Test Engineering, or related roles with a strong grasp of QA methodologies;
- Solid understanding of SDLC, Agile methodologies, and software quality principles;
- Hands-on experience with automation frameworks like Pytest, Selenium, Cypress, Postman, etc.;
- Comfortable working with REST APIs, data pipelines, and backend services;




- Familiarity with cloud platforms (AWS or Azure) and CI/CD tools;
- Detail-oriented mindset with a sharp eye for edge cases and a strong sense of ownership;
- Quick, proactive learner—especially important in the fast-evolving world of AI;
- Upper-Intermediate English level;

NICE TO HAVES

- Experience testing AI/ML systems in production environments;
- Familiarity with GenAI model evaluation metrics;
- Experience setting up monitoring/alerting for model drift, workflow failures, or performance issues.

PERKS AND BENEFITS

- Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
- A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
- Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.

Seniority level

- Mid-Senior level

Employment type

- Full-time

Industries

- IT Services and IT Consulting

#J-18808-Ljbffr

📌 QA Engineer (EST hours) (León)
🏢 Agileengine
📍 León