Data Platform Engineering Manager - Cyber Data Platform

Tesco; Welwyn Garden City; On-site; GBP 80,000 - 100,000; Full time

Job summary

A leading retail company in the UK is seeking a Data Platform Engineering Manager to oversee the development and management of their cyber data infrastructure. You will lead a team of engineers, manage data projects, and ensure compliance with security standards while enabling machine learning and analytics capabilities. Ideal candidates will have solid programming skills, experience in cloud platforms, and knowledge of cybersecurity principles. The role offers flexible working patterns and opportunities for professional development.

Qualifications

• Relevant experience as an Engineering Manager, leading teams and managing data projects at scale.
• Ability to deliver clear input and guide the team to achieve desired outcomes.
• Hiring, developing, and retaining cyber data platform talent.

Responsibilities

• Lead technical decisions and manage a team of data platform engineers.
• Design, build, and manage data architectures for threat detection and reporting.
• Implement and manage automated data integration and transformation frameworks.

Skills

Programming in Python or Java

Proficiency in SQL

Experience with cloud platforms (e.g., Azure)

Big data technologies like Spark, Flink

Kubernetes

CI/CD

Terraform

ETL and ELT frameworks

Orchestration tools like Airflow

Knowledge of cybersecurity principles

Job description

As the Data Platform Engineering Manager in the cyber data team, you will play a crucial role in the development, management, and optimisation of our self‑served cyber data infrastructure. You will lead technical decisions and be responsible for a team of data platform engineers to provide a reliable and robust data platform, enabling seamless acquisition, storage, processing and analysis of security data for operational, analytics, machine learning and Gen AI purposes. The data platform lies at the heart of our security detection strategy, serving wider security teams.

Data Architecture

Design, build and management of realtime, near realtime and batch data architectures that support threat detection, incident response and reporting through advanced analytics, machine learning and GenAI capabilities.

Data Integration and Transformation

Implement and manage the automated frameworks for integrating data from various security sources into the security lake, and the data transformation frameworks to move data between the raw, trusted, and curated data layers.

Data Security and Compliance

Implement and enforce data security standard methodologies, ensuring the protection of sensitive information and compliance with relevant regulations.

Automation and DevOps

Implement various automations and DevOps practices to streamline the deployment, configuration, and management of data platform components.

In addition to the above core accountabilities, I am also responsible for:

• Contributing to and supporting the ongoing recruitment and talent development process for the cyber data team at Tesco
• Providing reporting and insight to the cyber security leadership team and other senior representatives of the business
• The management of service providers and teams I work with inside and outside of Tesco

• Relevant experience as an Engineering Manager, leading teams and managing data projects at scale
• Solid programming experience with programming languages like Python or Java along with proficiency in SQL
• Experience working with cloud platforms (e.g., Azure) and big data technologies like Spark, Flink, etc.
• Solid grasp of Kubernetes, CI/CD and Terraform
• Working knowledge of ETL and ELT frameworks and orchestration tools like Airflow
• Hiring, developing, and retaining cyber data platform talent
• Ability to deliver clear input, guide, empower the team to achieve desired outcomes
• Developing working relationships with various teams and at all levels of seniority to facilitate the adoption of the data infrastructure
• Knowledge of cybersecurity principles and practices

Our vision at Tesco is to become every customer's favourite way to shop, whether they are at home or out on the move. Our core purpose is ‘Serving our customers, communities and planet a little better every day’. Serving means more than a transactional relationship with our customers. It means acting as a responsible and sustainable business for all stakeholders, for the communities we are part of and for the planet.

We are proud to have an inclusive culture at Tesco where everyone truly feels able to be themselves. At Tesco, we not only celebrate diversity, but recognise the value and opportunity it brings. We're committed to creating a workplace where differences are valued and we make sure that all colleagues are given the same opportunities. We’re proud to have been accredited Disability Confident Leader and we’re committed to providing a fully inclusive and accessible recruitment process. For further information on the accessibility support we can offer, please click here.

We’re a big business and we can offer a range of diverse full‑time & part‑time working patterns across our many business areas, which means that we can find something that works for you. We work in a more blended pattern – combining office and remote working. Our offices will continue to be where we connect, collaborate and innovate. If you are applying internally, please speak to the Hiring Manager about how this can work for you – Everyone is welcome at Tesco.