Data Engineer

Solirius; London; On-site; GBP 250,000 - 550,000; Full time

Job summary

A leading consultancy firm in London is seeking a Senior Data Engineer. You will design and maintain data pipelines, ensuring data quality while collaborating with various stakeholders. Ideal candidates have experience with SQL, cloud infrastructures, and strong leadership skills. Join our dynamic team dedicated to delivering innovative tech solutions.

Benefits

Competitive Salary

Bonus Scheme

Private Healthcare Insurance

25 Days Annual Leave + Bank Holidays

Gym Membership Benefits

Flexible Working

Qualifications

• Experience operating in data engineering teams and independently.
• Knowledge of cloud infrastructure such as Azure and AWS.
• Strong skills in SQL and relational databases.
• Hands-on experience in Python for data engineering.

Responsibilities

• Develop data engineering solutions for clients/projects.
• Design and build data models to support business needs.
• Ensure data quality across all projects.

Skills

Experience in data engineering teams

Leadership experience

SQL and relational databases

Experience with cloud infrastructure

Hands on coding experience in Python

Familiarity with ETL pipelines

Experience with big data technologies

Data architecture experience

Education

Bachelor's degree in a relevant field

Tools

SQL

Azure

AWS

Docker

Job description

Overview

Solirius Reply, part of the Reply Group, delivers technical consultancy and application delivery to our clients in order to solve real world problems and allow our clients to respond to an ever-changing technical landscape. We partner closely with our clients, embedding our consultants into their businesses in order to provide a bespoke service, allowing us to truly understand our clients' needs. This close collaboration with our clients has enabled us to grow rapidly and will drive our ambitious future growth plans. We currently have over 300 consultants working with a variety of key clients from both the public and private sectors such as the Ministry of Justice, Department for Education, FCDOS, UEFA, International Olympic Committee and Mercedes Benz; with plans to increase our client base further in the near future. We operate as a flat organisation and believe in trusting and supporting our team to operate independently. We pride ourselves on being specialists at what we do, making the most of our consultants\' expertise in their fields in order to provide a best-in-class service to our clients. All our consultants have the opportunity to work on a range of different projects, providing a broad range of knowledge on which to develop their careers and progress in the direction they choose.

Role

Senior Data Engineer to join our team at Solirius. You will be working as part of a team, developing and delivering exciting projects with a fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability.

Responsibilities

• Develop Data Engineering solutions for our clients/projects
• Design and build data models, schemas to support business requirements
• Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc
• Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based
• Work collaboratively with the client and cross-functional teams to identify and address data-related issues and opportunities
• Stay updated with the latest trends and developments in the data engineering field, such as modern data stack, big data technologies, cloud computing, etc
• Assist with defining the processes needed to achieve operational excellence
• Ensure data quality across all projects/clients
• Define and manage SLAs for data sets and processes throughout production
• Lead on the design, build and launch of new data models and pipelines

Key Skills / Experience

• Experience in operating as part of data engineering teams and independently
• Line/Team management experience, leadership experience
• Experience of working with cloud infrastructure (Azure or AWS, GCP is beneficial)
• SQL and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL)
• You have framework experience within either Flask, Tornado or Django, Docker
• Experience working with ETL pipelines such as Luigi, Airflow or Argo
• Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc
• Data acquisition and development of data sets and improving data quality
• Preparing data for predictive and prescriptive modelling
• Hands on coding experience, such as Python
• Reporting tools (e.g. Tableau, PowerBI, Qlik)
• GDPR and Government Service Standard (desirable)
• Passionate, motivated and enthusiastic about developing technology solutions
• Experience working in an Agile development environment
• Data architecture experience

Benefits

• Competitive Salary
• Bonus Scheme
• Private Healthcare Insurance
• 25 Days Annual Leave + Bank Holidays
• Up to 10 days allocated for development training per year
• Enhanced Parental Leave
• Paid Fertility Leave (5 Days)
• Statutory & Contributory Pension
• EAP with Help@Hand
• Gym Membership Benefits
• Flexible Working
• Annual Away Days/Company Socials

Equality & Diversity

Solirius Consulting is an equal opportunities employer. We are committed to creating a work environment that supports, celebrates, encourages, and respects all individuals and in which all processes are based on merit, competence and business needs. We do not discriminate on the basis of race, religion, gender, sexuality, age, disability, ethnicity, marital status or any other protected characteristics.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Consulting

Industries

• IT Services and IT Consulting