Senior Data Engineer – AI Platform & Scalable Pipelines

Elsevier; Greater London; Hybrid; GBP 80,000 - GBP 100,000; Full time

Job summary

A leading global information company in Greater London is seeking a Principal Data Engineer. This role involves designing and building scalable applications and data pipelines using technologies like Java, Python, Spark, and Airflow. The successful candidate should have strong experience in server-side applications, ETL processes, and a collaborative mindset. Benefits include a comprehensive pension plan, generous vacation, and flexible working hours, promoting a healthy work-life balance.

Benefits

Comprehensive Pension Plan

Flexible working hours

Generous vacation entitlement

Employee Assistance Program

Qualifications

• Strong commercial software engineering experience delivering server-side applications.
• Good experience in ETL processes.
• Excellent programming skills with Java and Python.

Responsibilities

• Design, prototype, and build robust and scalable applications.
• Create data pipelines for bulk data ingestion.
• Build cloud infrastructure in AWS to host and monitor services.

Skills

Java

Python

ETL

Spark

Airflow

Database systems

Tools

AWS

Data Lake

Delta Lake

Iceberg

Job description

A leading global information company in Greater London is seeking a Principal Data Engineer. This role involves designing and building scalable applications and data pipelines using technologies like Java, Python, Spark, and Airflow. The successful candidate should have strong experience in server-side applications, ETL processes, and a collaborative mindset. Benefits include a comprehensive pension plan, generous vacation, and flexible working hours, promoting a healthy work-life balance.