Lead AWS Data Engineer: Build Scalable Data Pipelines

London Stock Exchange Group; City of London; On-site; GBP 100,000 - 125,000; Full time

Job summary

A global financial market infrastructure firm in London is seeking a Lead Software Data Engineer to develop data solutions. You will work in an AWS environment, building scalable data pipelines and collaborating with product teams. Ideal candidates will have strong skills in Python and experience with Apache Spark and AWS. Join this dynamic team and make a significant impact in the financial industry.

Benefits

Healthcare

Paid volunteering days

Wellbeing initiatives

Qualifications

• Experience in data engineering basics: batch processing, ETL pipelines.
• Strong understanding of AWS architecture and services.
• Ability to write clean, maintainable, and testable code.

Responsibilities

• Design scalable, testable data pipelines using Python.
• Orchestrate workflows with AWS tools like Glue and Lambda.
• Collaborate with teams to translate requirements into solutions.

Skills

Python

Apache Spark

AWS

Agile teamwork

Tools

Apache Iceberg

PostgreSQL

CI/CD tools

Job description

A global financial market infrastructure firm in London is seeking a Lead Software Data Engineer to develop data solutions. You will work in an AWS environment, building scalable data pipelines and collaborating with product teams. Ideal candidates will have strong skills in Python and experience with Apache Spark and AWS. Join this dynamic team and make a significant impact in the financial industry.