Senior Data Engineer

Igbaffiliate; United Kingdom; Hybrid; GBP 60,000 - GBP 80,000; Full time

Job summary

A leading digital comparison service in the United Kingdom seeks a Senior Data Engineer to design and implement robust, scalable real-time data pipelines. The ideal candidate will have extensive experience in data engineering, proficiency with cloud platforms like AWS, and strong programming skills in languages such as Python or Java. With a focus on team collaboration and a fast-paced work environment, this role offers a range of benefits, including a company bonus scheme and hybrid working conditions.

Benefits

Company Bonus Scheme

Hybrid Working (3 days in office)

Private Health Care (Bupa)

Travel Insurance

Market Leading Training Programme

Recognition & Reward Scheme

Annual Company Conference

Regular Happy Hour / Team Lunches

Free Coffee, Drinks & Snacks

Qualifications

• Hands-on experience in data engineering with a proven track record.
• Experience with cloud platforms for real-time data ingestion and storage.
• Proficiency in programming languages like Python or Java.
• Strong understanding of database technologies and data modeling.

Responsibilities

• Design, develop, and maintain scalable real-time data pipelines.
• Integrate various data sources for seamless data flow.
• Build efficient and fault-tolerant data ingestion processes.
• Monitor and improve data pipeline performance.

Skills

Data engineering experience

Real-time data pipelines

Cloud platforms (AWS, GCP, Azure)

Programming (Python, Java, Scala)

Database technologies (SQL, NoSQL)

Data pipeline orchestration tools

Team collaboration

Adaptability to fast-paced environments

Excellent English skills

Job description

Senior Data Engineer - Our Company At Quantum, we connect global brands with high-intent consumers. We turn intent into action and complexity into clarity. Our Mission is clear, to help smarter, faster buying decisions.

Our vision, to be the world’s most used digital comparison service, delivering value and simplicity to millions.

We drive growth through data-driven affiliate marketing built for performance from day one. Every campaign is measurable, optimised in real time, and designed to scale.

With in-house tech, full-stack analytics, and a compliance-first mindset, we give our partners an edge. We drive confident decisions and growth in regulated and high-growth sectors. We’ve helped ambitious brands grow faster, smarter, and globally.

The Role

Our Technology team is growing! We’re looking for a highly skilled and experienced Senior Data Engineer to design and build a robust, scalable, and high-performance real-time data backbone.

In this role you will lead the design, development, and implementation of a real-time data backbone. This position focuses on building and maintaining scalable, high-performance data pipelines that support real-time data processing and analytics. You will work closely with various teams to ensure the infrastructure meets the business's growing data needs while leveraging modern technologies for efficient data ingestion, storage, and analysis.

Key Responsibilities

• Design, develop, and maintain scalable real-time data pipelines and infrastructure.
• Integrate various data sources and ensure seamless real-time data flow across the organisation.
• Build efficient, fault-tolerant, and highly available data ingestion processes.
• Monitor and improve data pipeline performance and scalability for low-latency and high-throughput.
• Work closely with cross-functional teams, including software engineers, data scientists, and business stakeholders, to ensure data infrastructure aligns with business objectives.

About You

• Hands-on experience in data engineering with a proven track record of building and managing real-time data pipelines across a track record of multiple initiatives.
• Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage.
• Programming skills in Python, Java, Scala, or a similar language.
• Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling.
• Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes).
• You thrive when working as part of a team.
• Comfortable in a fast-paced environment.
• Have excellent written and verbal English skills.
• Last but not least, you’ll have no ego!

What You’ll Get

• Company Bonus Scheme
• Hybrid Working (3 days in office)
• Private Health Care (Bupa)
• Travel Insurance
• Market Leading Training Programme
• Recognition & Reward Scheme
• Annual Company Conference (previous destinations Vienna, Bologna, Dubrovnik and Thessaloniki)
• Regular Happy Hour / Team Lunches
• Free Coffee, Drinks & Snacks

What’s the next step?

Our hiring process ensures we’re recruiting the right people for the role. We ensure that people are as suitable for us as we are for them.

If you like the sound of what we’re all about at Quantum and want to join a team where you can make an impact, please apply or contact us at [e-mail].