Data Platform Engineer — Pipelines & Orchestration

Viridiengroup; Crawley; Hybrid; GBP 45,000 - 65,000; Full time

Job summary

A dynamic technology company in Crawley is seeking a Data Engineer to develop their software solution aimed at transforming complex data challenges. This role involves building data platforms, developing flexible data transformation frameworks, and collaborating with cross-functional teams. Candidates should have significant experience with Python, SQL, and ETL tools, particularly Airflow, and be familiar with database systems like PostgreSQL and NoSQL. The position supports hybrid working arrangements.

Benefits

Discounts on restaurants

Cinema ticket discounts

Tech and travel discounts

Qualifications

• Experience designing and maintaining data transformations in a product setting.
• Ability to write secure, performant code in Python and SQL.
• Experience using orchestrators and data pipelines.

Responsibilities

• Develop the data platform infrastructure including orchestration systems.
• Build robust data pipelines for metadata-driven solutions.
• Collaborate with analysts and scientists to ensure data accessibility.

Skills

Python

SQL

ETL tools

Airflow

PostgreSQL

DevOps

DataOps

Tools

Docker

Kubernetes

Git

NoSQL databases

Job description

A dynamic technology company in Crawley is seeking a Data Engineer to develop their software solution aimed at transforming complex data challenges. This role involves building data platforms, developing flexible data transformation frameworks, and collaborating with cross-functional teams. Candidates should have significant experience with Python, SQL, and ETL tools, particularly Airflow, and be familiar with database systems like PostgreSQL and NoSQL. The position supports hybrid working arrangements.