Data Engineer

Roke Manor Research Limited; Manchester; On-site; GBP 40,000 - 60,000; Full time

Job summary

A leading technology firm in Manchester is seeking a Data Engineer to develop data services for National Security customers. The ideal candidate will be involved in building and managing data pipelines, integrating various data sources, and ensuring data quality. Familiarity with SQL, NoSQL databases, and ETL languages like Groovy, Python, or Java is required. This role offers the opportunity to work on mission-critical solutions in a dynamic tech environment.

Qualifications

• Experience in SQL and NoSQL databases is essential.
• Proficiency in ETL processing languages such as Groovy, Python, or Java is required.

Responsibilities

• Develop data pipelines for ingestion and orchestration.
• Integrate and enrich data from multiple sources.
• Design ETL processing systems.
• Write clean, maintainable code.
• Monitor and troubleshoot data systems.

Skills

SQL

NoSQL databases (e.g. MongoDB)

ETL processing with Groovy

ETL processing with Python

ETL processing with Java

Job description

Overview

Great ideas come from different minds. That’s why we bring together engineers, scientists, analysts, and creatives from every background — and give them the trust, tools, and freedom to make a difference. What connects us is the mission: solving meaningful problems and building capability that protects what matters most. And as the challenges evolve, so do we — working on the technologies that will shape tomorrow, not just today.

National Security Business
Be part of a growing and highly trusted supplier into the NS domain working to deliver mission critical solutions helping to keep the nation safe, secure and prosperous.

Working on leading edge technology solutions including AI/DS, Cyber, Cloud, DevOPs/SRE, Platform Engineering

We have secured long term work, across the full spectrum, on the latest framework with the client, which provides the springboard for our ongoing growth and development in this domain, so join us on what will be an incredible growth journey.

Role

As a Data Engineer, you’ll be actively involved in development of mission critical technical solutions that focus on data services for our National Security customers. You will work alongside our customers to solve their complex and unique challenges.

As our next Data Engineer, you’ll be managing and developing data pipelines that transform raw data into valuable insights for Roke’s National Security customers, enabling downstream analytics and reporting. You’ll be working with diverse data sources (batch, streaming, real-time and unstructured), applying distributed compute techniques to handle large datasets.

Responsibilities

• Data pipeline development - Data ingestion and pipeline orchestration design and tooling.
• Data integration - Integrating and enriching data from various sources, ensuring data consistency and quality.
• ETL processing design and coding - Extract transform and load processing such as NiFi.
• Create code that is open by default and easy for others to reuse
• Maintain and develop existing architectural components including Data Ingest and Data Stores
• Work as part of an operational team investigating and diagnosing problems identified with integrated (enriched) data.
• Explain the difference between user needs and the desires of the user
• Data security - Implementing data security measures to protect sensitive information.
• Be able to help the scrum team decompose user requests and key results into epics and stories.
• Writing clean, secure code following a test-driven approach
• Monitor and maintain - Monitor data systems for performance issues and make any necessary updates.

Required Skills

• SQL and noSQL databases (e.g. MongoDB)
• ETL processing languages such as Groovy, Python or Java.

Built on over a 60 year heritage, Roke offers specialist knowledge in sensors, communications, cyber, and AI and ML. We change the way organisations think and act – through dynamic insights from the analysis of multiple layers of data. We take care of the innovative, technical stuff that keeps everyone safe – that’s our mission, passion, and motivation.

Where you’ll work

Manchester - You’ll find our Manchester site located in the heart of the City; Europe’s fastest growing tech hub. You’ll become a key part of Roke’s growing local tech community as we support the Government levelling up agenda. There is easy, local access to our client community with great transport links and nearby local parking.

Due to the nature of this role, we require you to be eligible to achieve DV clearance.

The Next Step

Click apply, submitting an up-to-date CV. We look forward to hearing from you.