Intermediate AI Software Quality Assurance (QA)

Delta Controls Inc.; England; Hybrid; GBP 66,000 - 82,000; Full time

Job summary

A leading building controls manufacturer in the United Kingdom seeks an Intermediate AI Software Quality Assurance (QA) professional. The role focuses on ensuring the reliability of AI-driven platforms through rigorous testing of multi-agent services and collaborative quality assurance processes. Candidates should have strong skills in Python scripting and BDD frameworks. This full-time position offers a competitive salary range of $90,000 - $110,000 and hybrid work arrangements, ensuring a balance between remote and in-office work.

Benefits

Employee & safety centric culture

Flexible hours

Competitive total compensation

Wellness - onsite fitness center

Regular company events

Qualifications

• 3+ years of QA or software engineering experience.
• Experience with LLMs, model inference workflows, or prompt evaluation.
• Strong analytical thinker with excellent attention to detail.

Responsibilities

• Develop and maintain test plans for LLM-driven features.
• Design and execute functional, integration, and regression tests.
• Collaborate with developers to define quality criteria.

Skills

Python scripting

Experience with BDD frameworks

Analytical thinking

Clear communication

Tools

Pytest-BDD

Playwright

Job description

Intermediate AI Software Quality Assurance (QA)

About Delta Intelligent Building Technologies (Canada) Inc. (formerly known as Delta Controls)

Delta Intelligent Building Technologies (Canada) Inc. is a leading building controls manufacturer. For over three decades, we have provided innovative building automation solutions for commercial, healthcare, education, and leisure facilities.

Job Summary

We are seeking an Intermediate AI Software QA to ensure the reliability of our AI-driven platforms.

In this role, you will test multi-agent, LLM-based services, validate retrieval and embedding pipelines, and work with AWS Bedrock and serverless integrations, while building Python-based automated backend tests. You will collaborate with developers on quality criteria, troubleshoot APIs and cloud infrastructure, and contribute to test and release documentation.

Responsibilities

• Develop and maintain test plans for multi-agent, LLM-driven features and workflows
• Design and execute functional, integration, end-to-end, and regression tests for cloud-based AI services
• Validate retrieval pipelines, embeddings, knowledge-base updates, and AWS Bedrock/serverless integrations
• Build automated test suites (Python preferred) for backend workflows and microservices
• Collaborate with developers to define quality criteria, ensure testability, and troubleshoot APIs, agents, and cloud infrastructure
• Contribute to documentation for test cases, quality processes, and release readiness

Required Skills / Qualification

• 3+ years of QA or software engineering experience
• Strong proficiency in Python scripting and experience working with BDD frameworks and tools including Pytest-BDD, Playwright, and Gherkin (or similar)
• Experience with LLMs, model inference workflows, or prompt evaluation
• Familiarity with RAG concepts, retrieval pipelines, embeddings, or vector search
• Strong analytical thinker with excellent attention to detail
• Clear communicator, comfortable working independently
• Cloud Experience (Asset): Exposure to AWS Lambda or serverless applications, experience testing services integrated with AWS Bedrock, familiarity with cloud databases such as DynamoDB or Aurora, knowledge of S3, CloudWatch, IAM, and distributed service debugging; experience with Terraform or CloudFormation is a plus

No prior AI or AWS experience? Candidates eager to learn will be supported and gain hands-on exposure in production.

Work Location: Hybrid (In-office 3 days per week, subject to change)
City: Surrey
Type: Full-time, Permanent
Salary: $90,000 - $110,000
This range reflects the minimum and maximum target payable for the base salary of new hires across all Canadian locations. Actual compensation may vary outside this range and is dependent on various factors.

Why work for us?

We provide fantastic opportunities to individuals passionate about business and technology. Delta Electronics products are the most energy efficient power products in the industry and our company is perfect for those who want to create, design and build sustainable solutions using massively scalable, big-data architecture, with a strong focus on building automation. Here are some of the Delta perks you’ll receive from day 1!

• Employee & safety centric culture with the possibility of remote work
• Flexible hours and scheduling available
• Competitive total compensation along with generous vacation allowances
• Vacation leaves
• Wellness - onsite fitness center & company reimbursement for personal gym memberships
• Internal Recognition
• Transit accessible with free onsite parking
• Regular company events such as "Food Truck Fridays", Lunch & Learn and other planned activities