Join to apply for the QA Engineer (EST hours) ID35731 role at AgileEngine 2 weeks ago Be among the first 25 applicants Join to apply for the QA Engineer (EST hours) ID35731 role at AgileEngine AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! WHAT YOU WILL DO -Design and execute both automated and manual end-to-end test strategies across all layers of the testing pyramid; - Validate AI model performance, including accuracy, confidence thresholds, and fallback behavior; - Automate quality processes from data ingestion to extraction and classification, with a focus on speed, repeatability, and resilience; - Test and validate integration points between AI components and core business logic; - Support and enhance CI/CD pipelines by maintaining test infrastructure and defining quality gates, automated scripts, and synthetic data; - Define and track quality metrics that matter to the business (e.g., turnaround time, confidence scores, correction rates); - Stay on the cutting edge—continuously learn and apply the latest AI and QA practices to make the impossible possible for our customers. MUST HAVES -Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent experience; - 3+ years of experience in QA, Test Engineering, or related roles with a strong grasp of QA methodologies; - Solid understanding of SDLC, Agile methodologies, and software quality principles; - Hands-on experience with automation frameworks like Pytest, Selenium, Cypress, Postman, etc.; - Comfortable working with REST APIs, data pipelines, and backend services; - Familiarity with cloud platforms (AWS or Azure) and CI/CD tools; - Detail-oriented mindset with a sharp eye for edge cases and a strong sense of ownership; - Quick, proactive learner—especially important in the fast-evolving world of AI; - Upper-Intermediate English level. NICE TO HAVES - Experience testing AI/ML systems in production environments; - Familiarity with GenAI model evaluation metrics; - Experience setting up monitoring/alerting for model drift, workflow failures, or performance issues. PERKS AND BENEFITS - Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps. - Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities. - A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands. - Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive. Seniority level - Seniority level Mid-Senior level Employment type - Employment type Full-time Job function - Industries IT Services and IT Consulting Referrals increase your chances of interviewing at AgileEngine by 2x Sign in to set job alerts for “Quality Assurance Engineer” roles. Medellin, Antioquia, Colombia 6 months ago Medellin, Antioquia, Colombia 6 months ago Medellin, Antioquia, Colombia 6 months ago Medellin, Antioquia, Colombia 5 months ago Full Stack Engineer ID38918 ($2,500 signing bonus) Medellin, Antioquia, Colombia 2 months ago Junior Android & Kotlin Developer - Remote Work | REF#281827 Medellin, Antioquia, Colombia 6 months ago Mobile Engineer ID36666 ($2,500 signing bonus) Medellin, Antioquia, Colombia 3 weeks ago Medellin, Antioquia, Colombia 1 month ago Android Trainee - Remote Work | REF#281935 Medellin, Antioquia, Colombia 6 months ago Medellin, Antioquia, Colombia 2 weeks ago Medellin, Antioquia, Colombia 1 month ago Medellin, Antioquia, Colombia 1 month ago Medellin, Antioquia, Colombia 6 months ago Medellin, Antioquia, Colombia 23 hours ago Medellin, Antioquia, Colombia 4 weeks ago Medellin, Antioquia, Colombia 2 weeks ago Fullstack Developer (Senior) - Python (Flask) + React - Remote, Latin America Medellin, Antioquia, Colombia 2 weeks ago Medellin, Antioquia, Colombia 2 weeks ago Medellin, Antioquia, Colombia 6 months ago Medellin, Antioquia, Colombia 2 weeks ago Medellin, Antioquia, Colombia 2 weeks ago Site Reliability Engineer - Remote Work | REF#282114 Medellin, Antioquia, Colombia 4 months ago Lead Backend Engineer - Golang and Node.js Medellin, Antioquia, Colombia 2 weeks ago Site Reliability Engineer (Middle) ID38916 Senior Backend Engineer - Golang and Node.js Medellin, Antioquia, Colombia 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr