Senior Data Engineer (Databricks)

Mesh-AI Limited; Greater London; Hybrid; GBP 70,000 - GBP 100,000; Full time

Job summary

A leading data engineering company is looking for a Senior Data Engineer to work remotely in the UK. You will engage in complex projects with clients, manage relationships, and leverage your expertise in data engineering, Databricks, and cloud technologies. The role offers a flexible work environment, world-class educational benefits, and an annual salary ranging from £70,000 to £100,000. Join us to contribute to exciting data and AI projects.

Benefits

World-class educational benefits

Flexible PTO

4 weeks of paternity leave

Employee Assistance Program

Pension scheme enrollment

Private health insurance

Top-notch working equipment

High-transparency culture

Qualifications

• 5+ years of experience in Data Engineering, focusing on cloud platforms.
• Proven experience with Databricks and ETL/ELT development.
• Ability to explain technical concepts to non-technical audiences.

Responsibilities

• Deliver on complex projects across industries.
• Manage customer relationships, solo or with a Project Manager.
• Support adoption of latest technologies and data architectures.

Skills

Data Engineering

Cloud platforms (AWS, Azure, GCP)

Databricks (PySpark, SQL, Delta Lake)

ETL/ELT development

SQL

Python

CI/CD pipelines

Infrastructure as Code (Terraform)

Integrating Databricks with BI tools

Job description

Overview

We are currently looking for a Senior Data Engineer to join us remotely in the UK as we plan to set up a hub in the UK in the following 6-12 months to enable our GTM strategy. You will work with our EMEA and US customers to help them solve their data engineering, ML, ML Ops, and cloud migration puzzles.

As a Senior Data Engineer, you are expected to deliver on some of our most complex projects—individually or by leading small delivery teams. Projects are fast-paced, typically 2 to 4 months long, and most are delivered using Apache Spark/Databricks on AWS/Azure. You will directly manage customer relationships alone or in collaboration with a Project Manager and contribute to pre-sales, mentoring, and hiring efforts.

What will you do?

Deliver on complex projects across industries, with the opportunity to influence teams and the organization through mentoring and participation in pre-sales. Manage customer relationships, either solo or with a Project Manager, and support the adoption of the latest technologies and data architectures.

What does it take to fit the bill?

Technical Expertise

• 5+ years of experience in Data Engineering, with a focus on cloud platforms (AWS, Azure, GCP)
• Proven experience with Databricks (PySpark, SQL, Delta Lake, Unity Catalog)
• Extensive experience in ETL/ELT development and data pipeline orchestration (e.g., Databricks Workflows, DLT, Airflow, ADF, Glue, Step Functions)
• Proficiency in SQL and Python, used to transform and optimize data
• Knowledge of CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation, or Bicep)
• Hands-on experience integrating Databricks with BI tools (Power BI, Tableau, Looker)

Consulting & Client-Facing Skills

• Proven history in consulting, from scoping to requirements gathering, solution design, and stakeholder communication
• Experience delivering projects like Data Lakehouse buildouts and cloud data migrations
• Ability to explain technical concepts to non-technical audiences and drive decision-making

Operational Readiness & Soft Skills

• Ready to contribute to live client projects from day one
• Adaptability and problem-solving in a fast-paced consulting environment, with resilience and ability to thrive on challenges
• Strong communication skills across writing, speaking, and collaboration with stakeholders

What do we offer?

You’ll have the opportunity to join DATAPAO at a stage where you can meaningfully impact growth and spearhead regional expansion. We offer several benefits and a flexible work environment:

• The chance to work remotely—no UK office yet, with a fully remote setup. Onboarding includes one month in our Budapest hub and quarterly office visits.
• World-class educational benefits—access to Databricks courses, certifications, dedicated learning time, and an internal library.
• Flexible PTO—flexible time off as long as client success and work are not impacted
• 4 weeks of paternity leave
• Employee Assistance Program (EAP)—access to psychology, financial, and legal services
• Pension scheme enrollment and comprehensive private health insurance—via our EOR provider Remote.com
• Top-notch working equipment—MacBook Pro, a phone, and a sign-up bonus of 500 GBP gross
• High-transparency culture with open feedback and opportunities to work in data & AI

Important note: The list of benefits may be updated as we grow in the UK. The gross salary ranges from 70,000 to 100,000 GBP/year, depending on assessed seniority.

Please note that we are currently unable to offer transfer or full sponsorship for Skilled Worker visas as we establish our UK presence.

Want to know more about us?

DATAPAO is a data engineering and AI company covering data transformation from architecture to implementation. We provide data and AI training and enablement, and we are backed by Databricks and Microsoft Gold Partners in Europe.

You can follow us on LinkedIn or contact our recruitment team at [e-mail].

We value a diverse team and welcome applicants from all backgrounds. If you’re passionate about data and learning, you’ll fit right in.

Privacy note: We are committed to protecting your data. We do not share your data with third parties beyond those used for recruitment, and we keep applications for two years unless you ask us to delete them. For details on data storage and processing, please see our privacy policy.