Senior Data Engineer — Real-Time Pipelines (Spark/Kafka)

Parkopedia; City of London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading connected car services provider is seeking a skilled Senior Data Engineer to join their Data Science team in London. In this role, you will lead the design and development of scalable data pipelines, focusing on big data processing and machine learning model integration. The ideal candidate will have strong Python skills, cloud deployment experience (preferably AWS), and a collaborative spirit to work effectively in a team. This position offers hybrid working and a range of great benefits.

Benefits

Flexible working - hybrid model

Paid Leave for Charity events

25 Days holiday entitlement

Enhanced Workplace Pension Scheme

Private Medical Health Insurance

On-site wellbeing programmes

Discounted gym membership

Mental health support platform access

Enhanced Maternity and Paternity offering

Qualifications

• Proven experience as a software or data engineer in complex production environments.
• High proficiency in Python including software development standards.
• Strong command of Linux and cloud deployments like AWS.

Responsibilities

• Lead the design, development, and enhancement of data pipelines.
• Develop scalable big data processing and real-time data streaming systems.
• Mentor junior engineers and promote best practices.

Skills

Python

Apache Spark

Kafka

Linux

Docker

Tools

AWS

Apache Airflow

Snowflake

Databricks

Job description

A leading connected car services provider is seeking a skilled Senior Data Engineer to join their Data Science team in London. In this role, you will lead the design and development of scalable data pipelines, focusing on big data processing and machine learning model integration. The ideal candidate will have strong Python skills, cloud deployment experience (preferably AWS), and a collaborative spirit to work effectively in a team. This position offers hybrid working and a range of great benefits.