Senior Data Engineer

Advancing Analytics Limited; Remote; GBP 60,000 - GBP 80,000; Part time

Job summary

A leading analytics solutions provider is seeking a Senior Data Engineer for a 3-month contract. This remote role requires a strong background in Microsoft Azure, Apache Spark, and Python. You will support the implementation and maintenance of a large-scale Data and AI platform, ensuring high-performance data operations. The ideal candidate will have excellent skills in SQL and data orchestration tools, contributing to a collaborative workforce that prioritizes innovation and inclusivity.

Responsibilities

• Support the roll out and maintenance of a multi-service Data and AI platform.
• Focus on core tech stack and the end-to-end solution.

Skills

Microsoft Azure and cloud computing concepts

Apache Spark – Databricks

Python

SQL – high-performance queries

Azure Data Factory

Azure Data Lake storage

Terraform

Requirements gathering

Agile project management

Job description

Senior Data Engineer - 3 Month Contract

📍Location: Remote – must be based within the UK. Occasional visits to see customers and the team.

Interview process: Two rounds. 1: Get to know you chat with the People Recruitment Manager; 2: Technical competency with the Hiring Lead and a Team Member.

Our Values: Advancing, Come as you are, Zero burnout, Greta goal, We all level up together and Transparency

Learn more about us: YouTube, Totally Skewed Podcast, Data Science in Production. Read our Blogs.

Who Are We?

Advancing Analytics are a market leader in delivering bleeding edge analytical solutions for customers all over the world. To thrive in today\'s market, businesses need to implement AI built on a solid, reliable Data Platform, and we are looking for you to help us build it!

Who are we looking for?

We are seeking an experienced Data Engineer to support the roll out and maintenance of a large, multi-service Data and AI platform. This role will focus on our core tech stack and the ability to see the end-to-end solution.

Required Tools and Technologies

• Microsoft Azure and cloud computing concepts
• Apache Spark – Databricks, Microsoft Fabric or another Spark engine
• Python – we build most of our solutions in Python
• SQL – writing complex high-performance queries, understanding how queries execute on different compute technologies
• Azure Data Factory or other cloud orchestration tools
• Azure Data Lake storage and Delta Lake
• Unity Catalog, Purview or other Data Governance tools
• IAC tool such as Terraform, Azure DevOps

Other technology we like, but isn\'t essential:

• Visualisation Tools – Power BI, Tableau
• Streaming Data – Azure Stream Analytics, Event Hubs, IoT Hubs
• Building parallel systems – Distributed compute engines
• Azure Functions – Python, C#

Skills and Approaches

• Requirements gathering and client consulting
• Agile project management
• Understanding of OO Development Practices
• ETL Approaches – Data Quality, Resilience, Observability
• Understanding of CI/CD Methodologies and SDLC

What will it be like to work for Advancing Analytics?

We are a small company and encourage everyone to have a voice within our collaborative and inclusive team from day one.

As a Microsoft Specialised Partner, Databricks Elite Partner, and AWS Partner, you will have access to the latest tech and training opportunities the industry has to offer. We are aware this is a rapidly changing market and are committed to investing in the long-term goals of our employees. We love being engaged in the wider tech community and frequently present at events, sponsor events such as Big Data London, SQLBits and organise leading community events including Databricks and Microsoft Data & AI meetups around the UK, and the Global AI Bootcamp London.

Our company values define us

• 🚀 Advancing – the projects that get us all out of bed are challenging and push the limits of what is currently possible. We work on the bleeding edge and challenge the analytical industry daily.
• 🌈 Come as you are – we are an inclusive company. When you work with us, rest assured you\'re working in a safe environment.
• ❌ Zero burnout – too often technology teams are worked too hard or stretched too thin. We have seen it happen, and we never want to be a company that pushes our staff to breaking point.
• 🌱 Greta Goal – we only have one planet, let\'s look after it.
• 📚 We all level up together – we have each seen the benefit that being part of a developer community can have, it is transformational. We invest in our communities, you will find us organising meetups, conferences, and events. When we are not organising, we are helping, speaking, mentoring, or sponsoring.
• 💡Transparency – We are big believers that there are no secrets in Advancing Analytics, and we try to live this day to day.

Equal opportunities for everyone

At Advancing Analytics both diversity and inclusion are a priority. We are all committed to creating an inclusive environment where everyone feels valued, respected and empowered to be their authentic selves. We are proud to be an equal opportunity employer; all applicants will be considered without regard to age, ethnicity, religion, sex, sexual orientation, gender identity, family or parental status, national origin, veteran status, neurodiversity or disability status.