Senior Data Engineer

Kargo; London; On-site; GBP 80,000 - 100,000; Full time

Job summary

A leading advertising technology company is seeking a Senior Data Engineer in London to enhance and scale their data processes. The role involves implementing ETL pipelines using technologies like Python and AWS, and requires strong problem-solving skills. Candidates should have expertise in data systems and DevOps practices, along with excellent communication skills. Join a diverse team committed to innovation in the ad tech space.

Qualifications

• Strong expertise in implementing and optimizing large-scale data systems.
• Deep proficiency in Python, Spark, and data structuring.
• Extensive DevOps experience with AWS, Docker, Kubernetes.

Responsibilities

• Implement and maintain robust ETL/ELT pipelines.
• Contribute to design sessions with technical insights.
• Monitor and optimize data systems for performance.

Skills

Python

Spark

Airflow

AWS

Docker

Kubernetes

SQL

Kafka

Flink

Tools

Snowflake

Prometheus

ArgoCD

Job description

Join to apply for the Senior Data Engineer role at Kargo

Join to apply for the Senior Data Engineer role at Kargo

Kargo creates breakthrough cross-screen ad experiences for the world's leading brands and publishers. Every day, our 600+ employees bring the power of their creativity and diversity to radically raise the bar on what mobile, CTV, AI, social, and eCommerce can do to wow consumers and build businesses. Now 20 years strong, Kargo has offices in NYC, Chicago, Austin, LA, Dallas, Sydney, Auckland, London and Waterford, Ireland. Humble brag: In 2024, Kargo was recognized as a Best Place to Work by Ad Age and Built In.

Who We Hire

Success takes all kinds. Diversity describes our workforce. Inclusion defines our culture. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, marital status, age, national origin, protected veteran status, disability or other legally protected status. Individuals with disabilities are provided reasonable accommodation to participate in the job application process, perform essential job functions, and receive other benefits and privileges of employment.

Title: Senior Data Engineer

Job Type: Permanent

Job Location: London, UK

The Opportunity

At Kargo, we are rapidly evolving our data infrastructure and capabilities to address challenges of data scale, new methodologies for onboarding and targeting, and rigorous privacy standards. We're looking for an experienced Senior Data Engineer to join our team, focusing on hands-on implementation, creative problem-solving, and exploring new technical approaches. You'll work collaboratively with our technical leads and peers, actively enhancing and scaling the data processes that drive powerful targeting systems.

The Daily To-Do

• Independently implement, optimize, and maintain robust ETL/ELT pipelines using Python, Airflow, Spark, Iceberg, Snowflake, Aerospike, Docker, Kubernetes (EKS), AWS, and real-time streaming technologies like Kafka and Flink.
• Engage proactively in collaborative design and brainstorming sessions, contributing technical insights and innovative ideas for solving complex data engineering challenges.
• Support the definition and implementation of robust testing strategies, and guide the team in adopting disciplined CI/CD practices using ArgoCD to enable efficient and reliable deployments.
• Monitor and optimize data systems and infrastructure to ensure operational reliability, performance efficiency, and cost-effectiveness.
• Actively contribute to onboarding new datasets, enhancing targeting capabilities, and exploring modern privacy-compliant methodologies.
• Maintain thorough documentation of technical implementations, operational procedures, and best practices for effective knowledge sharing and onboarding.
  
  

Qualifications:

• Strong expertise in implementing, maintaining, and optimizing large-scale data systems with minimal oversight.
• Deep proficiency in Python, Spark, and Iceberg, with a clear understanding of data structuring for efficiency and performance.
• Experience with Airflow for building robust data workflows is strongly preferred.
• Extensive DevOps experience, particularly with AWS (including EKS), Docker, Kubernetes, CI/CD automation using ArgoCD, and monitoring via Prometheus.
• Familiarity with analytical warehousing such as Snowflake or Clickhouse, including writing and optimizing SQL queries and understanding Snowflake's performance and cost dynamics.
• Comfort with Agile methodologies, including regular use of Jira and Confluence for task management and documentation.
• Proven ability to independently drive implementation and problem-solving, turning ambiguity into clearly defined actions.
• Excellent communication skills to effectively engage in discussions with technical teams and stakeholders.
• Familiarity with identity, privacy, and targeting methodologies in AdTech is required.
  
  

Follow Our Lead

• Big Picture: kargo.com
• The Latest: Instagram (@kargomobile) and LinkedIn (Kargo)

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Advertising Services

Referrals increase your chances of interviewing at Kargo by 2x

Get notified about new Senior Data Engineer jobs in London, England, United Kingdom.

Senior Data Analyst - Up to £140,000 + Huge Bonus + Benefits - London/Hybrid

City Of London, England, United Kingdom £85,000.00-£85,000.00 3 weeks ago

Senior Data Analyst - TikTok LIVE - London

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 3 days ago

London, England, United Kingdom 1 month ago

Senior Data Analyst / Data Business Analyst – Investment Management / Asset Management

Senior Government Finance Function (GFF) Data Architect / Engineer

London, England, United Kingdom 1 week ago

Senior Data Analyst - Pricing Data Engineering & Automation, CUO Global Pricing

London, England, United Kingdom 4 days ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 week ago

Senior Data Analyst, Reporting & Operations

London, England, United Kingdom 3 days ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 days ago

Principal Solution Engineer AI and Data Use Governance

London, England, United Kingdom 2 weeks ago

City Of London, England, United Kingdom 1 week ago

Principal Solution Engineer – AI and Data Use Governance

London, England, United Kingdom 4 days ago

Senior Lead Software Engineer - Team Lead - Accelerator Business

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 1 day ago

London, England, United Kingdom 3 months ago

London Area, United Kingdom 33 minutes ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 9 hours ago

Senior Software Engineer - France Global Payroll

London, England, United Kingdom 23 hours ago

City Of London, England, United Kingdom 1 week ago

London, England, United Kingdom 4 weeks ago

London, England, United Kingdom 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.