Lead Data Engineer

Roke Manor Research Limited; United Kingdom; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading technology firm in Gloucester is seeking a Senior / Lead Data Engineer to develop mission-critical solutions for national security clients. You will design complex data flows and ensure data quality and security while working in a collaborative environment. The ideal candidate has significant experience with SQL, noSQL databases, and ETL processing. This role offers flexible working options and is essential for safeguarding the nation.

Qualifications

• Experience with SQL and noSQL databases such as MongoDB.
• Proficient in ETL processing languages.
• Ability to manage stakeholder expectations effectively.

Responsibilities

• Design and implement data flows connecting operational systems.
• Coordinate teams and set best practices.
• Develop data ingestion and pipeline orchestration.

Skills

SQL and noSQL databases

ETL processing languages

Stakeholder management

Technical communication

Job description

Overview

Great ideas come from different minds. That’s why we bring together engineers, scientists, analysts, and creatives from every background — and give them the trust, tools, and freedom to make a difference. What connects us is the mission: solving meaningful problems and building capability that protects what matters most. And as the challenges evolve, so do we — working on the technologies that will shape tomorrow, not just today.

Senior / Lead Data Engineer

National Security Business
Be part of a growing and highly trusted supplier into the NS domain working to deliver mission critical solutions helping to keep the nation safe, secure and prosperous.

Working on leading edge technology solutions including AI/DS, Cyber, Cloud, DevOPs/SRE, Platform Engineering

As a Senior / Lead Data Engineer, you’ll be actively involved in development of mission critical technical solutions that focus on data services for our National Security customers.

Roke is a leading technology & engineering company with clients spanning National Security, Defence and Intelligence. You will work alongside our customers to solve their complex and unique challenges.

A Senior / lead Data Engineer is responsible for the design and implementation of numerous complex data flows to connect operational systems, data for analytics and business intelligence (BI) systems.

Responsibilities

• Recognise and share opportunities to reuse existing data flows between teams
• Responsible for the build of data-streaming systems
• Co-ordinate teams and set best practice and standards
• Apply knowledge of systems integration to your work
• Data pipeline development - Data ingestation and pipeline orchestration design and tooling.
• Data integration - Integrating and enriching data from various sources, ensuring data consistency and quality.
• ETL processing design and coding - Extract transform and load processing such as NiFI.
• Create code that is open by default and easy for others to reuse
• Maintain and develop existing architectural components including Data Ingest and Data Stores
• Work as part of an operational team investigating and diagnosing problem identified with integrated (enriched) data.
• Explain the difference between user needs and the desires of the use
• Data security - Implementing data security measures to protect sensitive information.
• Be able to help the scrum team decompose user requests and key results into epics and stories.
• Writing clean, secure code following a test-driven approach
• Create code that is open by default and easy for others to reuse
• Monitor and maintain - Monitor data systems for performance issues and make any necessary updates.

Required skills

• SQL and noSQL databases (e.g. MongoDB)
• ETL processing languages
• Listen to the needs of technical and business stakeholders, and interpret them
• Effectively manage stakeholder expectations
• Manage active and reactive communication
• Support or host difficult discussions within the team or with diverse senior stakeholder

Built on over a 60 year heritage, Roke offers specialist knowledge in sensors, communications, cyber, and AI and ML. We change the way organisations think and act – through dynamic insights from the analysis of multiple layers of data. We take care of the innovative, technical stuff that keeps everyone safe – that’s our mission, passion, and motivation.

We have secured long term work, across the full spectrum, on the latest framework with the client, which provides the springboard for our ongoing growth and development in this domain, so join us on what will be an incredible growth journey.

Where you’ll work

GLOUCESTER - Alongside hybrid and flexible working options, you’ll find our Gloucester site in a business park two minutes from junction 11A of the M5; The site allows easy access to our local customer base. Set on the outskirts of the Cotswolds, you are never far from a picturesque view or lunch time walk.

Due to the nature of this role, we require you to be eligible to achieve DV clearance. As a result, you should be a British Citizen and have resided in the U.K. for the last 10 years.

The Next Step

Click apply, submitting an up-to-date CV. We look forward to hearing from you.