Graduate AI Test Automation Engineer - Python & LLM Testing

Camstgroup; Greater London; On-site; GBP 30,000 - GBP 40,000; Full time

Job summary

A QA and software testing company in Greater London is seeking a Graduate AI Test Automation Engineer. This role entails developing Python-based automation tools and collaborating on an innovative testing framework for generative AI agents. The ideal candidate is on track to complete a degree in Computer Science or a related field and has a keen interest in AI-driven software testing. Join a cutting-edge project aimed at shaping AI testing standards, with great opportunities for career progression.

Qualifications

• On track to complete a Bachelor's or Master's degree in a relevant field.
• Strong interest in AI-driven software testing and development.
• Proficient in Python and data libraries.
• Familiarity with LLMs and testing tools would be a major asset.
• Initial experience with datasets and evaluation metrics is beneficial.

Responsibilities

• Develop and maintain Python-based test automation tools.
• Collaborate on framework design and third-party tool integration.
• Define and implement test strategies for LLM behavior validation.
• Support continuous testing, benchmarking, and KPI tracking.

Skills

Python

Data libraries

AI-driven software testing

Collaborative problem solving

Education

Bachelor's or Master's degree in Computer Science, AI, or related field (2.1 minimum grade)

Tools

PyTest

Playwright

Job description

A QA and software testing company in Greater London is seeking a Graduate AI Test Automation Engineer. This role entails developing Python-based automation tools and collaborating on an innovative testing framework for generative AI agents. The ideal candidate is on track to complete a degree in Computer Science or a related field and has a keen interest in AI-driven software testing. Join a cutting-edge project aimed at shaping AI testing standards, with great opportunities for career progression.