Senior Data Engineer: Scalable Refinery Data Pipelines & APIs

AnaVation LLC; Greater London; On-site; GBP 60,000 - GBP 90,000; Full time

Job summary

A global data solutions firm in Greater London is seeking a Senior Data Engineer to join a dynamic product team. This role requires designing and evolving data pipelines that support analytics and customer-facing products. You will be responsible for data ingestions, transformations, and leading quality improvements in a collaborative environment. The ideal candidate possesses strong programming skills and familiarity with tools like Kafka and Kubernetes. Embrace this opportunity for growth and innovation.

Benefits

Inclusive work environment

Opportunity for innovation

Continuous learning and development

Qualifications

• Deliver high-quality, well-tested, and maintainable code.
• Own significant parts of the data platform from ingestion to production delivery.
• Contribute to and improve CI/CD pipelines, automation, and operational tooling.

Responsibilities

• Design, build, and evolve batch and streaming data pipelines.
• Own data ingestion, transformation, validation, and workflows.
• Drive improvements in pipeline reliability and monitoring.

Skills

High-quality code delivery

End-to-end data platform ownership

Architectural contributions

CI/CD pipeline improvement

Metrics and logging

Incident response

Code review and mentorship

Tools

Kafka

Spark

Kubernetes

Elasticsearch

Job description

A global data solutions firm in Greater London is seeking a Senior Data Engineer to join a dynamic product team. This role requires designing and evolving data pipelines that support analytics and customer-facing products. You will be responsible for data ingestions, transformations, and leading quality improvements in a collaborative environment. The ideal candidate possesses strong programming skills and familiarity with tools like Kafka and Kubernetes. Embrace this opportunity for growth and innovation.