Staff Software Engineer, AI Inference at Scale

Applied Intuition Inc.; Greater London; Hybrid; GBP 80,000 - GBP 100,000; Full time

Job summary

A leading AI technology company in Greater London is seeking a Staff Software Engineer to enhance inference systems for AI models serving millions. Candidates should have strong experience in performance optimization and distributed systems. The role includes optimizing request routing and managing multi-accelerator deployments. The firm offers competitive benefits, a flexible work environment, and values diverse perspectives. Applicants are encouraged to apply even if they do not meet every requirement.

Benefits

Competitive compensation

Flexible working hours

Generous vacation and parental leave

Qualifications

• Significant software engineering experience, particularly with distributed systems.
• Results-oriented with a bias towards flexibility and impact.
• Ability to work beyond defined job descriptions.

Responsibilities

• Identifying infrastructure blockers to optimize service delivery.
• Working across distributed systems to enhance inference capabilities.
• Contributing to intelligent routing algorithms and autoscaling resources.

Skills

Performance optimization

Distributed systems

Large-scale service orchestration

Intelligent request routing

Kubernetes

Python

Rust

Education

Bachelor’s degree in a related field

Job description

A leading AI technology company in Greater London is seeking a Staff Software Engineer to enhance inference systems for AI models serving millions. Candidates should have strong experience in performance optimization and distributed systems. The role includes optimizing request routing and managing multi-accelerator deployments. The firm offers competitive benefits, a flexible work environment, and values diverse perspectives. Applicants are encouraged to apply even if they do not meet every requirement.