Data Engineer – SC Cleared

Scrumconnect Ltd; Greater London; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading digital consultancy is seeking an experienced Data Engineer to design and maintain data products within Agile delivery teams. The ideal candidate will have strong expertise in Azure engineering, SQL, and Python, with a focus on building scalable data systems. Responsibilities include the integration of workflows using Azure DevOps, creating Power BI dashboards, and implementing data governance practices. Candidates must hold active SC Clearance at the time of application. This role promotes diversity and inclusivity within the workplace.

Qualifications

• Strong Azure engineering experience.
• Excellent SQL and Python capabilities.
• Passion for building scalable, reliable data systems.

Responsibilities

• Design, build, and maintain data solutions using Azure.
• Integrate and automate workflows using Azure DevOps pipelines.
• Create advanced dashboards and reporting solutions in Power BI.
• Implement robust data governance and quality checks.
• Lead migration of legacy data systems to Azure.

Skills

Azure engineering

SQL

Python

Azure Data Factory

Power BI

Terraform

Agile delivery

Data governance

dbt

Data migration

Education

Azure certifications (Data Engineer, Data Scientist, or related)

Job description

London, United Kingdom | Posted on 11/12/2025

Scrumconnect Consulting is a multi-award-winning digital consultancy recognised for delivering impactful technology solutions across UK government departments. Our work has positively influenced the lives of more than 40 million UK citizens. We are committed to user-centred design, agile delivery, and bringing innovation to digital services that truly matter.

Role Overview

We are seeking an experienced Data Engineer to design, build, and maintain data products and a modern Strategic Data Platform. You will work within multi-functional Agile delivery teams, ensuring operational stability, support, and continuous enhancement of data solutions.

This role is ideal for someone with strong Azure engineering experience, excellent SQL/Python capability, and a passion for building scalable, reliable data systems in complex environments.

Key Responsibilities

• Design, build, and maintain data solutions using Azure Data Factory and Azure Synapse.
• Manage the full data development life cycle within Agile delivery teams.
• Integrate and automate workflows using Azure DevOps pipelines.
• Develop dimension data models and semantic models to support Power BI analytics.
• Create advanced dashboards, visualisations, and reporting solutions in Power BI.
• Implement robust data governance, profiling, and quality checks to ensure accuracy and compliance.
• Lead migration of legacy data systems to modern Azure-based platforms.
• Apply dbt (with SQL databases) for data transformation, modelling, and workflow optimisation.
• Collaborate with business stakeholders to translate requirements into scalable technical solutions.
• Coach and mentor team members to build capability in modern data engineering practices.

Active SC Clearance (must be valid at time of application).

Proven Expertise With

• Python (incl. PySpark) and advanced SQL
• dbt for SQL-based transformations
• Terraform (infrastructure-as-code)
• Experience working with structured and unstructured data.
• Strong background in Agile delivery environments.
• Ability to translate business technical solutions.
• Experience delivering legacy migration projects in complex organisations.
• Excellent communication and stakeholder engagement skills.
• Azure certifications (Data Engineer, Data Scientist, or related).
• Understanding of GDPR, data security, and governance best practices.

Diversity & Inclusion

At Scrumconnect Consulting, diversity drives innovation. We are committed to creating an inclusive environment where every individual is valued, respected, and supported. We welcome applications from candidates of all backgrounds, including women, people with disabilities, underrepresented communities, and those seeking flexible working arrangements.