Data Engineer Manager

Rokstone Group; London; Hybrid; GBP 70,000 - 90,000; Full time

Job summary

A leading insurance firm in London seeks a Data Engineering Manager to lead a team in developing scalable data pipelines. The role involves technical leadership, project planning, and collaboration with cross-functional teams. Candidates should have a bachelor's degree in Computer Science and a minimum of 3 years in data engineering. A flexible hybrid working model is offered, along with a commitment to professional growth.

Benefits

Flexible benefits package

Career development opportunities

Hybrid work model

Qualifications

• Minimum 3 years of experience in data pipeline development.
• Experience with SQL and NoSQL databases.
• Hands-on experience with cloud-based resources.

Responsibilities

• Lead a team of data engineers to develop scalable data processes.
• Oversee project planning and resource allocation.
• Work with cross-functional teams to define business requirements.

Skills

Data pipeline design

Azure services

SQL development

Data modeling

ETL processes

Education

Bachelor’s degree in Computer Science or related field

Tools

Azure Data Factory

Power BI

Apache Spark

Cosmos DB

Job description

Overview

Who We Are
Since its inception, Aventum Group has sought a different approach to insurance. We are on a mission to be the ‘most inspiring specialty (re)insurance group in the world’. At the heart of Aventum are our people. Working together in dynamic, service-focused teams, we prioritise our customers in everything we do. Collaboration fuels our success, courage drives our innovation and continuous improvement keeps us ahead in a rapidly evolving industry. Our shared commitment is to revolutionise insurance for the better, one day at a time. We also believe that investing in our people is investing in our future. By empowering people across the Group to develop their careers, advance within the Group, and embrace new challenges, we build an environment where growth and learning never stop. Our competitive benefits package, offered via a flexible benefits platform, reflects this. Beyond core benefits, employees have the freedom to tailor their benefits to meet their individual needs, supporting their unique goals and ambitions.

Role Summary
The Data Engineering Manager role is a senior role within the Technology function responsible for the quality and reliability of the data engineering deliveries, the systems they build and the effective and aligned ways of working. The role reporting into the Head of Data is responsible for providing leadership and technical excellence support to the overall Data Strategy.

Role Accountabilities

Strategy

• Lead and manage a team of data engineers to design, develop, and maintain scalable data pipelines, infrastructure, and reliable data schemas that feed other data processes.


• Provide technical leadership, guidance, and support in architecture design, best practices, and emerging technologies within the data engineering space.


• Define, document, and manage high-quality engineering practices across the team’s deliverables, including coding standards, data quality, performance optimization strategies, and tooling.


• Oversee project planning, resource allocation, prioritization, and repository management to ensure timely and successful delivery of data engineering projects while maintaining standards and quality.


• Conduct regular performance evaluations, set goals, and provide constructive feedback to team members.


• Supports the business determine and document business processes, data flows and access controls.


• Manages the various repositories using available tools, open sources or using out of the box tools based on use case’s needs ensuring standards are being followed and quality is maintained.


• Mentor, coach, conduct regular performance evaluations, set goals, and provide constructive feedback to foster the professional growth and development of team members.


• Promote a culture of collaboration, innovation, continuous improvement, and knowledge sharing within the data engineering team and across the Technology group.


• Supporting the function to design and support the infrastructure/architecture of the data platform.


• Support the Head of Data in building and implementing the Data Strategy, ensuring alignment of team skills with strategic objectives.


• Assist in determining and documenting business processes, data flows, access controls, and supporting the selection, implementation, and management of tools and technologies.


• Evaluate, compare, and improve approaches including design patterns, data lifecycle design, ontology alignment, annotated datasets, and elastic search approaches.


• Stay updated with industry trends, tools, and technologies in data engineering and recommend innovative solutions to enhance team productivity and efficiency.


• Working closely across the Technology group assuring alignment, knowledge sharing and effective delivery and innovation.

Operations

• Work with cross-functional teams to gather, document, and approve business requirements for data analysis and reporting projects


• Capable of supporting the architecting, building, testing, and maintenance of the data platform. Responsible for the development and support a wide range of data transformations and migrations for the whole business.


• Manage the construction of custom ETL processes: Design and implementation data pipelines, data marts and schemas, access versatile data sources and apply data quality measures.


• Works with the IT team to design the support and monitoring processes working with the IT team to ensure systems, queries and pipelines are working optimally.


• Engage with other technology teams to ensure adherence to up front governance and data best practices.


• Work with Product tech leads and owners to help them understand their users aggregated reporting needs and advise on how best to manage their product data for easier integration in downstream products


• Any additional duties as assigned.

Role Requirements

• Experience in deploying ML models is a plus


• Bachelor’s degree in Computer Science or Computer Engineering or related field; or equivalent combination of education and experience.


• Knowledge of logical and physical data modelling concepts for OLTP and OLAP databases


• Knowledge of Cosmos DB, NoSQL database service, Open Source MongoDB and Cassandra. Also Azure Synapse or related tool for future plan and other RDBMS database instance


• Minimum 3 years overall work experience as a developer building data pipelines and schemas


• Minimum 3 years’ experience with SQL database development or other comparable environment


• Minimum 3 years with data warehouse implementations


• Hands-on experience using Synapse or related tool with cloud-based resources (e.g. Stored Procedures, ADF, NoSQL Databases, JSON/XML/DeltaLake data formats)


• Hands-on experience with Azure Service Bus, Azure Functions, Azure Data Factory data integration techniques


• Knowledge of Data Modelling concepts, monitoring, designs and techniques


• Knowledge of Data Warehouse project lifecycle, tools, technologies, best practices


• Demonstrative ability to develop complex SQL queries and Stored Procedures

Skills and Abilities

• Platforms & Tools: Cloud Computing platforms (ADLS Gen2), Microsoft Stack (Synapse, DataBricks, Fabric, Profisee), Snowflake Data Integration, Azure Service Bus, Apache Airflow, Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, DeltaLake, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App service, Azure ML is a plus


• Languages: Python, SQL, T-SQL, SSIS and high level programming knowledge on Spark is a plus


• DB: Azure SQL Database, Cosmos DB, NoSQL, MongoDB, HBase is a plus


• Methodologies: Agile, DevOps


• Concepts: ELT/ETL, DWH, APIs (RESTful), Spark APIs, FTP protocols, SSL, SFTP, PKI (public Key Infrastructure) and Integration testing

Management Duties

• No

We are an equal opportunity employer, and we are proud to share that 93% of our employees say they can be themselves at work. We aim to hire our industry's finest people because the best people drive the best outcomes. And we forever challenge the status quo because we know there are always ways to improve things. Because together, we're limitless.

We value applicants from all backgrounds and foster a culture of inclusivity. We understand the need for flexibility, so work in a hybrid model. Please let us know if you require any reasonable adjustments during the recruitment process.

FCA Conduct Rules

1. You must act with integrity.


2. You must act with due skill, care and diligence.


3. You must be open and cooperative with theFCA, thePRAand other regulators.


4. You must pay due regard to the interests ofcustomersand treat them fairly.


5. You must observe proper standards of market conduct.


6. You must act to deliver good outcomes for retail customers.