Remote Data Engineer — Build AI-Driven Security Pipelines

Jack & Jill; Remote; GBP 60,000 - 80,000; Full time

Job summary

A well-funded AI cybersecurity startup in the UK is seeking a Data Engineer to build production-grade data pipelines and architect data lake infrastructure. The role requires strong software engineering skills and experience with data ingestion systems. The ideal candidate will work with cutting-edge technologies like Apache Iceberg and have hands-on experience with Python and Apache Kafka. This position offers a full-time opportunity in a dynamic, innovative environment.

Qualifications

• 7+ years of software engineering experience with at least 4+ years focused specifically on data engineering.
• Proven track record building and scaling data ingestion systems handling gigabytes to terabytes daily.
• Deep, hands-on production experience with Python, Apache Kafka, and Apache Spark.

Responsibilities

• Design, implement, and maintain scalable data pipelines that ingest security data daily.
• Architect and evolve S3-based data lake infrastructure using Apache Iceberg.
• Take end-to-end ownership of the complete data lifecycle.

Skills

Data pipeline engineering

Software engineering

Experience with Python

Apache Kafka

Apache Spark

Tools

Apache Iceberg

Job description

A well-funded AI cybersecurity startup in the UK is seeking a Data Engineer to build production-grade data pipelines and architect data lake infrastructure. The role requires strong software engineering skills and experience with data ingestion systems. The ideal candidate will work with cutting-edge technologies like Apache Iceberg and have hands-on experience with Python and Apache Kafka. This position offers a full-time opportunity in a dynamic, innovative environment.