Senior Data Engineer - Cloud-Native Data Platform (Hybrid)

Direct Line Group; Greater London; Hybrid; GBP 70,000 - 90,000; Full time

Job summary

A leading insurance provider is seeking a Senior Data Engineer to develop and maintain robust cloud-based data platform solutions in London. In this role, you will lead collaboration with cross-functional teams, design data transformation solutions, and implement performance monitoring. The ideal candidate will have substantial experience in data engineering, expertise in AWS services, and proficiency in Python. The company offers a hybrid working model, competitive benefits, and a commitment to diversity and inclusion.

Benefits

50% off home, motor, and pet insurance

Optional Health and Dental insurance

Up to 10% AIP Bonus

EV car scheme

Generous holidays

Employee discounts and cashback

Qualifications

• 5+ years of experience in data engineering with ETL/ELT methodologies.
• Expertise in AWS services for cloud data management.
• Strong proficiency in Python for data processing tasks.

Responsibilities

• Develop and maintain cloud-based data platform solutions within AWS.
• Lead collaborations with cross-functional teams for data solutions.
• Design data transformation solutions and maintain documentation.
• Monitor data systems for performance and implement quality checks.
• Enforce security protocols for data protection and compliance.

Skills

Data transformation using ETL/ELT

Apache Spark

Advanced SQL techniques

AWS cloud services (Glue, S3, KMS, etc.)

Python programming

Unix/Linux operating environment

Agile development processes

Test-Driven Development (TDD)

DevOps practices

Clustered systems management

Tools

PostgreSQL

MySQL

Amazon Redshift

Job description

A leading insurance provider is seeking a Senior Data Engineer to develop and maintain robust cloud-based data platform solutions in London. In this role, you will lead collaboration with cross-functional teams, design data transformation solutions, and implement performance monitoring. The ideal candidate will have substantial experience in data engineering, expertise in AWS services, and proficiency in Python. The company offers a hybrid working model, competitive benefits, and a commitment to diversity and inclusion.