Data Engineer - Pipelines & AI Enrichment (London)

Doorfeed; City of London; On-site; GBP 60,000 - 80,000; Full time

Job summary

A technology company in London is seeking a skilled Data Engineer to design, build, and maintain data pipelines. The role involves managing databases and using AI and machine learning to enhance data processing. Applicants should have at least 2 years of experience in data engineering, proficiency in Python and SQL, and strong problem-solving skills. This is a full-time position requiring in-office work 5 days a week.

Qualifications

• Minimum 2 years relevant professional experience.
• Understanding of ETL processes and data warehousing.
• Able to come into the central London office 5 days per week.

Responsibilities

• Maintain and improve the live properties data pipeline.
• Manage PostgreSQL databases.
• Use data processing tools to transform data from hundreds of different sources.
• Use AI and machine learning to enrich our data.
• Build data ingestion pipelines from scratch.

Skills

Python

SQL

pandas

Problem-solving

Communication

Tools

PostgreSQL

AWS services

Machine learning frameworks

Data orchestration tools

Job description

A technology company in London is seeking a skilled Data Engineer to design, build, and maintain data pipelines. The role involves managing databases and using AI and machine learning to enhance data processing. Applicants should have at least 2 years of experience in data engineering, proficiency in Python and SQL, and strong problem-solving skills. This is a full-time position requiring in-office work 5 days a week.