Lead Data Engineer — Real-Time, Cloud & Big Data

Lloyds Bank plc; Bristol; On-site; GBP 75,000 - 95,000; Full time

Job summary

A leading financial institution is seeking a Principal Data Engineer to join their Personalised Experiences and Communications Platform. The ideal candidate will have expertise in large-scale data processing systems, a strong knowledge of cloud platforms like GCP, Azure, or AWS, and experience with real-time streaming technologies such as Kafka. This role offers an inclusive environment and a benefits package that adapts to individual lifestyles, as they focus on innovation in finance while delivering exceptional service to customers.

Benefits

Generous pension contribution of up to 15%

Discounted shopping benefits

Focus on diversity and inclusion initiatives

Qualifications

• 5+ years of experience designing and supporting distributed systems.
• Proven experience with automation and CI/CD best practices.
• Strong working experience with operational data stores and data lakes.

Responsibilities

• Deliver top-quality data capabilities within multi-functional engineering teams.
• Design and build large-scale data processing systems in production.
• Amplify your impact by shaping the future of finance.

Skills

Large-scale data processing systems

Good knowledge of containers (Docker, Kubernetes)

Experience with cloud platforms (GCP, Azure, AWS)

Real Time streaming (Kafka)

Core programming concepts

Cloud storage and networking

Education

Certification in GCP (Cloud Architect, Cloud Developer, Professional Data Engineer)

Certification in Apache Kafka (CCDAK)

Tools

Python

SQL

Java

Scala

Go

Spark

Flink

Beam

Hadoop

Job description

A leading financial institution is seeking a Principal Data Engineer to join their Personalised Experiences and Communications Platform. The ideal candidate will have expertise in large-scale data processing systems, a strong knowledge of cloud platforms like GCP, Azure, or AWS, and experience with real-time streaming technologies such as Kafka. This role offers an inclusive environment and a benefits package that adapts to individual lifestyles, as they focus on innovation in finance while delivering exceptional service to customers.