Data Engineer - Hybrid: Build Resilient Data Pipelines

Advantage Smollan Limited; Winnersh; Hybrid; GBP 48,000; Full time

Job summary

A leading retail solutions partner in the UK seeks a Data Engineer to oversee the entire data lifecycle. This role involves creating reliable data pipelines and optimizing performance within the Azure ecosystem, while working collaboratively in a hybrid environment. Required qualifications include proficiency in Python and experience with data engineering in a commercial context. The position offers competitive salary, benefits, and career growth opportunities.

Benefits

Pension (4%)

Life Assurance

Electric Vehicle Scheme

GymFlex

WeCare ERP

Perkbox

Taste Card

Qualifications

• Data Engineering experience in a commercial business.
• Hands-on experience with Azure Stack: Synapse, Azure SQL, Databricks.
• Proficient with CI/CD tools and practices.

Responsibilities

• Own the full data lifecycle from ingestion to serving.
• Create robust data pipelines from APIs and databases.
• Work within the Azure ecosystem for performance optimization.
• Monitor data pipelines and define metrics/alerts.
• Maintain CI/CD pipelines for versioning and security.

Skills

Proficiency in Python

Experience with Spark

CI/CD with Azure DevOps

Understanding of geospatial data processing

Tools

Azure SQL

Synapse

Databricks

Docker

Terraform

Job description

A leading retail solutions partner in the UK seeks a Data Engineer to oversee the entire data lifecycle. This role involves creating reliable data pipelines and optimizing performance within the Azure ecosystem, while working collaboratively in a hybrid environment. Required qualifications include proficiency in Python and experience with data engineering in a commercial context. The position offers competitive salary, benefits, and career growth opportunities.