Databricks Data Engineer – Pipelines, DataOps & Cloud

Ciandt; Greater London; On-site; GBP 68,000 - GBP 85,000; Full time

Job summary

A leading technology firm in the Greater London area is seeking a Senior Data Engineer to lead the design and development of data pipelines. You will work closely with business and analytics teams to ensure high-quality data deliverables. The ideal candidate should have proven experience in building large-scale data pipelines, strong programming skills in Python and SQL, and familiarity with cloud platforms such as AWS or Azure. This role emphasizes collaboration, innovation, and transformation in data engineering.

Qualifications

• Proven experience in building and managing large-scale data pipelines in Databricks.
• Strong programming skills in Python and SQL for data processing.
• Hands-on experience with version control and CI/CD pipelines.

Responsibilities

• Develop and maintain data pipelines.
• Integrate data from various sources.
• Collaborate with analytics teams to understand data requirements.

Skills

Data pipeline development

Python programming

SQL processing

ETL/ELT frameworks

DataOps practices

Troubleshooting skills

Tools

Databricks

AWS

Azure

GCP

Job description

A leading technology firm in the Greater London area is seeking a Senior Data Engineer to lead the design and development of data pipelines. You will work closely with business and analytics teams to ensure high-quality data deliverables. The ideal candidate should have proven experience in building large-scale data pipelines, strong programming skills in Python and SQL, and familiarity with cloud platforms such as AWS or Azure. This role emphasizes collaboration, innovation, and transformation in data engineering.