Perform Bogota, D.C., Capital District, Colombia Join or sign in to find your next job Join to apply for the Automation Agent Engineer (SDET + RAG/Prompt Engineering) role at Perform Perform Bogota, D.C., Capital District, Colombia 3 days ago Be among the first 25 applicants Join to apply for the Automation Agent Engineer (SDET + RAG/Prompt Engineering) role at Perform Get AI-powered advice on this job and more exclusive features. We're looking for a forward-thinking Automation Agent Engineer —part seasoned SDET, part prompt engineer—who’s excited to bridge the gap between classic QA automation and AI-assisted workflows. In this hybrid role, you’ll help develop and refine a mini-RAG system that transforms manual test cases into intelligent, LLM-generated test skeletons. You'll shape how context is retrieved, how prompts are designed, and how generated test code aligns with standards for our Java-based automation stack (RestAssured, Selenium, Cucumber, Screenplay). This is a hands-on, highly collaborative role where your decisions will directly affect the quality, consistency, and scalability of our AI-enabled testing pipeline. What You’ll Do - Design and refine prompt templates and few-shot examples to guide the LLM toward generating high-quality test code. - Collaborate on RAG logic , including chunking strategies, metadata filters, and reranker tuning for optimal context retrieval. - Help convert manual test cases into structured test skeletons , normalizing them to project standards. - Build evaluation loops to validate generated code—ensuring compliance with naming, format, assertions, lint rules, and compile/run requirements. - Review and land autoscripted code with proper guardrails , documentation, and handoff to the SDET team. - Optimize token usage and latency while maintaining test fidelity in collaboration with the AI and QA teams. What You Bring - 5+ years of experience in QA automation with strong skills in Java , RestAssured , Selenium , Cucumber , and ideally the Screenplay pattern. - Hands-on knowledge of prompt engineering , including few-shot prompting and structured output design. - Working understanding of RAG concepts (embeddings, retrievers, rerankers) and how they apply to software development workflows. - Familiarity with CI pipelines (Jenkins), Git workflows, and code review best practices. It is an asset if you have: - Experience with LangChain , ChromaDB , or other local retrieval systems. - Understanding of LLMs like Claude 4 Sonnet and how to manage token/cost trade-offs. - Ability to build small tools such as static analyzers, linters, or rule-based code evaluators. Seniority level - Seniority level Not Applicable Employment type - Employment type Other Job function - Job function Sales and Business Development Referrals increase your chances of interviewing at Perform by 2x Get notified about new Agent jobs in Bogota, D.C., Capital District, Colombia . Software Development Engineer in Test (Windows) Bogota, D.C., Capital District, Colombia 3 weeks ago Bogota, D.C., Capital District, Colombia 1 month ago Bogota, D.C., Capital District, Colombia 2 weeks ago Bogota, D.C., Capital District, Colombia 1 week ago Bogota, D.C., Capital District, Colombia 3 months ago Bogota, D.C., Capital District, Colombia 2 months ago Python Software Engineer - Ubuntu Hardware Certification Team Bogota, D.C., Capital District, Colombia 4 months ago Distributed Systems Software Engineer, Python / Go Bogota, D.C., Capital District, Colombia 4 months ago Bogota, D.C., Capital District, Colombia 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr