Intermediate AI Software Quality Assurance (QA)

Delta Controls Inc.; England; Hybrid; GBP 48,000 - 59,000; Full time

Job summary

A leading building automation firm in Surrey is seeking an Intermediate AI Software Quality Assurance professional to ensure reliability in AI-driven platforms. The role involves testing multi-agent services, validating retrieval pipelines, and building automated backend tests in Python. Candidates should have extensive QA experience, strong Python skills, and the ability to work independently. This full-time position offers a hybrid work model in a supportive environment focused on continuous learning.

Benefits

Employee-centric culture

Flexible hours

Competitive total compensation

Wellness benefits

Regular company events

Qualifications

• 3+ years of QA or software engineering experience.
• Strong proficiency in Python scripting and working with BDD frameworks.
• Experience with LLMs and model inference workflows.

Responsibilities

• Develop and maintain test plans for AI features.
• Design and execute functional and regression tests.
• Build automated test suites for backend workflows.

Skills

QA or software engineering experience

Python scripting

Experience with BDD frameworks

Experience with LLMs

Analytical thinker

Clear communicator

Tools

Pytest-BDD

Playwright

Terraform

CloudFormation

Job description

Intermediate AI Software Quality Assurance (QA)

About Delta Intelligent Building Technologies (Canada) Inc. (formerly known as Delta Controls)

Delta Intelligent Building Technologies (Canada) Inc. is a leading building controls manufacturer. For over three decades, we have provided innovative building automation solutions for commercial, healthcare, education, and leisure facilities.

Job Summary

We are seeking an Intermediate AI Software QA to ensure the reliability of our AI-driven platforms.

In this role, you will test multi-agent, LLM-based services, validate retrieval and embedding pipelines, and work with AWS Bedrock and serverless integrations, while building Python-based automated backend tests. You will collaborate with developersLegend on quality criteria, troubleshoot APIs and cloud infrastructure, and contribute to test and release documentation.

Responsibilities

• Develop and maintain test plans for multi-agent, LLM-driven features and workflows
• Design and execute functional, integration, end-to-end, and regression tests for cloud-based AI services
• Validate retrieval pipelines, embeddings, knowledge-base updates, and AWS Bedrock/serverless integrations
• Build automated test suites (Python preferred) for backend workflows and microservices
• Collaborate with developers to define quality criteria, ensure testability, and troubleshoot APIs, agents, and cloud infrastructure
• Contribute to documentation for test cases, quality processes, and release readiness

Required Skills / Qualification

• 3+ years of QA or software engineering experience
• Strong proficiency in Python scripting and experience working with BDD frameworks and tools including Pytest-BDD, Playwright, and Gherkin (or similar)
• Experience with LLMs, model inference workflows, or prompt evaluation
• Familiarity with RAG concepts, retrieval pipelines, embeddings, or vector search
• Strong analytical thinker with excellent attention to detail
• Clear communicator, comfortable working independently
• Cloud Experience (Asset): Exposure to AWS Lambda or serverless applications, experience testing services integrated with AWS Bedrock, familiarity with cloud databases such as DynamoDB or Aurora, knowledge of S3, CloudWatch, IAM, and distributed service debugging; experience with Terraform or CloudFormation is a plus

No prior AI or AWS experience? Candidates eager to learn will be supported and gain hands-on exposure in production.

Work Location: Hybrid (In-office 3 days per week, subject to change)
City: Surrey
Type: Full-time, Permanent
Salary: $90,000 - $110,000

This range reflects the minimum and maximum target payable for the base salary of new hires across all Canadian locations. Actual compensation may vary outside this range and is dependent on various factors.

Why work for us?

We provide fantastic opportunities to individuals passionate about business and UNC. Delta Electronics products are the most energy efficient power products in the industry and our company is perfect for those who want to create, design and build sustainable solutions using massively scalable, big-data architecture, with a strong focus on building automation.

• Employee & safety centric culture with the possibility of remote work
• Flexible hours and scheduling available
• Competitive total compensation along with generous vacation allowances
• Vacation leaves
• Wellness - onsite fitness center & company reimbursement for personal gym memberships
• Internal Recognition
• Transit accessible with free onsite parking
• Regular company events such as "Food Truck Fridays", Lunch & Learn and other planned activities