Junior Big Data Developer: Pipelines & SQL

Informationtechconsultants; Greater London; On-site; GBP 30,000 - 40,000; Full time

Job summary

A technology consulting firm in the United Kingdom is seeking a Junior Big Data Developer to join their data engineering team. The ideal candidate will have strong skills in Python and SQL, focusing on building and maintaining data pipelines and ensuring data quality. Responsibilities include developing ETL/ELT processes and collaborating with Data Scientists and other Engineers. A Bachelor's degree in Computer Science or a related field is required.

Qualifications

• Strong proficiency in Python for data manipulation and scripting.
• Expert-level proficiency in SQL with experience in complex queries.
• Foundational understanding of Big Data architecture.

Responsibilities

• Assist in the design and maintenance of ETL/ELT pipelines.
• Write and maintain production-grade Python scripts for data processing.
• Develop complex SQL queries for data extraction and validation.

Skills

Python

SQL

ETL principles

Git

Apache Spark

Education

Bachelor's degree in Computer Science or related field

Tools

Pandas

NumPy

Apache Airflow

Job description

A technology consulting firm in the United Kingdom is seeking a Junior Big Data Developer to join their data engineering team. The ideal candidate will have strong skills in Python and SQL, focusing on building and maintaining data pipelines and ensuring data quality. Responsibilities include developing ETL/ELT processes and collaborating with Data Scientists and other Engineers. A Bachelor's degree in Computer Science or a related field is required.