Databricks Data Engineer – Pipelines, DataOps & Cloud

Ciandt; Greater London; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading technology company in Greater London is seeking a Senior Data Engineer who will lead the design and development of robust data pipelines. The role includes integrating and transforming data from diverse sources and collaborating closely with analytics teams. Candidates should have proven experience in building large-scale data pipelines, strong programming skills in Python and SQL, and an understanding of modern DataOps practices. Join us in driving innovation and transformation in data management.

Qualifications

• Proven experience in building and managing large-scale data pipelines in Databricks.
• Deep understanding of ETL/ELT frameworks and data warehousing.
• Hands-on experience with version control (Git) and CI/CD pipelines.

Responsibilities

• Develop and maintain data pipelines.
• Integrate data from various sources such as APIs and databases.
• Collaborate with teams to understand data requirements.

Skills

Building and managing large-scale data pipelines

Programming skills in Python

Programming skills in SQL

Deep understanding of ETL/ELT frameworks

Hands-on experience with modern DataOps practices

Familiarity with cloud platforms (AWS, Azure, GCP)

Strong problem-solving skills

Job description

A leading technology company in Greater London is seeking a Senior Data Engineer who will lead the design and development of robust data pipelines. The role includes integrating and transforming data from diverse sources and collaborating closely with analytics teams. Candidates should have proven experience in building large-scale data pipelines, strong programming skills in Python and SQL, and an understanding of modern DataOps practices. Join us in driving innovation and transformation in data management.