Senior Data Engineer

Data Freelance Hub; Greater London; Hybrid; GBP 70,000 - GBP 90,000; Full time

Job summary

A leading data consultancy is seeking a Senior Data Engineer for a hybrid role based in London. The ideal candidate will have at least 7 years of experience in data engineering, with strong expertise in Informatica, Azure Databricks, and SQL. Responsibilities include building data pipelines, designing data models, and ensuring data quality frameworks are in place. This position offers the opportunity to work closely with business and analytics teams to deliver robust solutions in a dynamic environment.

Qualifications

• 7+ years of experience in data engineering within enterprise environments.
• Strong hands-on experience with Informatica, Azure Databricks, and SQL.
• Proficiency in Python (or Scala) for data engineering tasks.

Responsibilities

• Build and maintain data pipelines using Informatica and Azure Databricks.
• Design and optimize data lake models ensuring performance and governance.
• Prepare clean datasets for BI consumption in tools like Power BI.

Skills

Informatica ETL

Azure Databricks

SQL

Python

Data Quality Frameworks

Tools

Power BI

SAP BO

Git

CI/CD

Power Apps

Job description

Overview

Senior Data Engineer on a contract basis in London, UK (Hybrid). The role requires 7+ years of experience, with expertise in Informatica, Databricks, and SQL, focused on financial datasets and data quality frameworks.

Responsibilities

• Build and maintain data pipelines using Informatica and Azure Databricks (Spark/Delta Lake).
• Design and optimize data lake/lakehouse models, ensuring performance, reliability, and governance.
• Enable BI consumption by preparing clean, curated datasets for Power BI and SAP BO.
• Implement data quality rules, monitoring, and exception handling frameworks.
• Collaborate with business, analytics, and technology teams to understand requirements and deliver robust data solutions.
• Apply DevOps practices including Git, CI/CD, and automated testing for data pipelines.
• Support creation of lightweight workflow/ops tools using Power Apps (nice to have).

Qualifications

• 7+ years of experience in data engineering within enterprise environments.
• Strong hands-on experience with Informatica ETL, Azure Databricks, Spark, Delta Lake, and Azure data services.
• Proficiency in SQL and Python (or Scala).
• Experience preparing data models and datasets for Power BI and/or SAP BO.
• Practical understanding of data quality frameworks, metadata, and lineage.
• Strong problem-solving, documentation, and stakeholder communication skills.

Tags: #DataEngineer #Azure #Databricks #Spark #SQL #Python