Data Engineer: Build Robust Data Pipelines (Hybrid)

Hexegic Limited; Greater London; Hybrid; GBP 50,000 - GBP 60,000; Full time

Job summary

A leading technical consultancy in Greater London is seeking a Data Engineer to enhance their data foundation. This role involves establishing data integrations, conducting ETL activities, and collaborating with SMEs to validate data outputs. The ideal candidate will have proficiency in Python and experience with Apache Spark and PySpark. The position offers a base salary of £50,000-£60,000, a £5,000 development budget, wellness programs, and hybrid working arrangements.

Benefits

Base salary of £50,000-£60,000

£5,000 a year professional development budget

Wellness program

25 days annual leave

Hybrid working arrangements

Qualifications

• Strong experience with Python and big data technologies.
• Ability to work with Subject Matter Experts (SMEs) on data models.
• Prior experience in ETL processes is required.

Responsibilities

• Establish new data integrations within the data foundation.
• Conduct ETL activities as conducted by SMEs.
• Configure connections to other datasets within the data foundation.
• Collaborate to create, test and validate data models and outputs.
• Set up monitoring and ensure data health for outputs.

Skills

Proficiency in Python

Experience in Apache Spark

Experience in PySpark

Ability to scope new integrations

Experience with data analytics software

Job description

A leading technical consultancy in Greater London is seeking a Data Engineer to enhance their data foundation. This role involves establishing data integrations, conducting ETL activities, and collaborating with SMEs to validate data outputs. The ideal candidate will have proficiency in Python and experience with Apache Spark and PySpark. The position offers a base salary of £50,000-£60,000, a £5,000 development budget, wellness programs, and hybrid working arrangements.