Data Platform Lead: Dagster, APIs & BigQuery

Methodfi; Greater London; Hybrid; GBP 70,000 - GBP 90,000; Full time

Job summary

A leading financial technology firm in Greater London is seeking a Data Engineering Lead. You will own the technical roadmap for the data platform, focusing on reliability and performance. Responsibilities include delivering APIs, enhancing data ingestion, and coaching the engineering team. The ideal candidate will have hands-on experience with production data systems, strong skills in Dagster, BigQuery, and Python, and a track record of operational excellence. This role offers competitive compensation and a hybrid work model.

Benefits

Competitive Salary

Equity options

Pension matching

Private Medical Insurance

Paid sick leave

Group Life Assurance

Season Ticket Loan

Qualifications

• Hands-on experience with end-to-end production data platforms.
• Expertise in building asset-based orchestration.
• Strong SQL and BigQuery skills for performance optimization.
• Experienced with building resilient data ingestion patterns.
• Proven experience with delivering customer-facing APIs or feeds.
• Ability to write clean and testable Python code.
• Familiarity with multi-cloud environments and Infrastructure as Code.
• Experience in building observability and incident response systems.
• Strong leadership and communication skills.

Responsibilities

• Own the technical roadmap for the data platform.
• Deliver customer-facing APIs and data feeds.
• Level up orchestration using Dagster.
• Enhance data ingestion processes.
• Improve data quality and operational resilience.
• Create infrastructure as code using Terraform.
• Coach and mentor team members.

Skills

Production data platforms ownership

Dagster expertise

Advanced BigQuery skills

API and feeds experience

Clean Python coding

Multi-cloud and Terraform

Operational excellence

Clear communication skills

Tools

Dagster

Airbyte

Terraform

AWS

GCP

Job description

A leading financial technology firm in Greater London is seeking a Data Engineering Lead. You will own the technical roadmap for the data platform, focusing on reliability and performance. Responsibilities include delivering APIs, enhancing data ingestion, and coaching the engineering team. The ideal candidate will have hands-on experience with production data systems, strong skills in Dagster, BigQuery, and Python, and a track record of operational excellence. This role offers competitive compensation and a hybrid work model.