Senior AI QA Engineer - Validation & Observability

Hitachi Digital LLC; Birmingham; On-site; GBP 60,000 - 70,000; Full time

Job summary

A leading technology firm in Birmingham is seeking an AI QA Specialist to design and execute test strategies for AI systems. The ideal candidate will validate model outputs and ensure compliance with governance standards. Responsibilities include developing QA frameworks and building automated test suites. Candidates should have a strong programming background in Python and at least five years of experience in QA, specifically with AI and ML systems. This role emphasizes collaboration and continuous improvement.

Benefits

Flexible work arrangements

Industry-leading benefits

Support for holistic health and wellbeing

Qualifications

• 5+ years in QA or testing; 2+ years with AI/ML systems.
• Hands-on experience with LLMs and Agentic AI frameworks.
• Familiar with data governance frameworks and compliance standards.

Responsibilities

• Design and execute test strategies for AI systems.
• Validate AI model outputs for accuracy and compliance.
• Build automated test suites for AI workflows.

Skills

Python programming

AI/ML systems

Test automation tools

Analytical skills

Collaboration

Education

Bachelor’s or Master’s in Computer Science, AI/ML

Tools

GCP services (Vertex AI, IAM)

Evaluation harnesses

Job description

A leading technology firm in Birmingham is seeking an AI QA Specialist to design and execute test strategies for AI systems. The ideal candidate will validate model outputs and ensure compliance with governance standards. Responsibilities include developing QA frameworks and building automated test suites. Candidates should have a strong programming background in Python and at least five years of experience in QA, specifically with AI and ML systems. This role emphasizes collaboration and continuous improvement.