Data Engineer

Camstgroup; Greater London; On-site; GBP 40,000 - 60,000; Full time

Job summary

A leading data services company is seeking a Data Engineer in London. The role involves designing and developing high-performance big data applications using SQL, AWS, and Databricks. Candidates should have a Bachelor's degree in Computer Science and 1-2 years of experience with big data projects. Excellent communication skills and a strong interest in technology are essential. The position offers opportunities for training and career progression in a vibrant environment.

Qualifications

• 1-2 years' experience with handling big data projects using SQL and Python.
• Solid understanding of AWS cloud environments, including S3, LAMBDA, RDS.
• Passion for technology and a strong interest in pursuing a Data Engineer career.

Responsibilities

• Translate functional requirements into technical requirements.
• Design and develop end-to-end big data applications.
• Implement tools for data acquisition and management of large data sets.

Skills

SQL

Python

AWS

Databricks

ETL/ELT

Data warehousing

Excellent communications skills

Knowledge of Python libraries

Education

Bachelor's degree in Computer Science or related IT discipline

Tools

AWS CDK

Terraform

Dynamo DB

Job description

Requisition ID10814-Posted - Years of Experience (1) -Technology- Where (1) -Job

Data Reply is the Reply Group company offering a broad range of analytics and data processing services. We operate across different industries and business functions, working directly with executive level professionals, enabling them to achieve meaningful outcomes through effective use of data. We find that one of the biggest problems experienced by our clients today is being overwhelmed with the amount of data that they face and not knowing how to leverage it to their advantage. The vast landscape of available technology stacks and models means that choosing the right ones can be a daunting task. Most companies know that their data is valuable, and that they should be making the most out of it to stay competitive, but often don’t know where to begin or what to prioritise. At Data Reply, we pride ourselves on helping clients make the right decisions to build their data strategy. With our consultants’ expertise, we map the right technologies to meet our clients’ business needs. We deal in bespoke solutions, and offer in house training to ensure that our clients realise the full value of their big data solution. www.data.reply.com

Role overview:

As a Data Engineer joining our Data Reply team in London, you will design and develop high-performance big data applications, manage complex data sets, and work across the full development lifecycle. You’ll work across a variety of projects as a consultant using big data technologies such as SQL, AWS and Databricks to add business value and collaborate with global clients. The role offers extensive training, structured career progression, and opportunities to work with leading brands in a vibrant, technology-driven environment.

Responsibilities:

• As a Data Engineering Consultant, you'll translate functional requirements into technical requirements
• Design and develop high performing and stable end-to-end big data applications to perform complex processing of batch and real-time massive volumes of data in a multi-tenancy cloud environment
• You will develop and implement tools for data acquisition, extraction, transformation, management, and manipulation of large and complex data sets
• You’ll be involved in all aspects of development - design, development, build, deployment, monitoring and operations
• Research and experiment with emerging technologies and industry trends with a view to bringing business value through early adoption

About the candidate:

• A minimum Bachelor's degree is required in Computer Science or in a directly related IT discipline
• At least 1-2 years' experience with handling big data projects using SQL and Python. ETL/ELT, Data warehousing Concepts
• You can demonstrate tangible experience using AWS and/or Databricks
• Excellent communications skills: an ability to communicate with impact, ensuring complex information is articulated in a meaningful way to wide and varied audiences
• A passion for technology and a strong interest in pursuing a specialist careers path as a Data Engineer
• A strong understanding of key Python concepts related to data engineering is needed as a foundation on which to build (e.g. Pandas, numpy, Python file handling, JSON)
• You possess solid understanding of AWS cloud environments, including S3, LAMBDA, RDS, AWS CDK or Terraform, Dynamo DB
• Have researched leveraging Agentic AI to stream the data engineering lifecycle
• Flexibility regarding local business travelling

Reply is an Equal Opportunities Employer and committed to embracing diversity in the workplace. We provide equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type regardless of age, sexual orientation, gender, identity, pregnancy, religion, nationality, ethnic origin, disability, medical history, skin colour, marital status or parental status or any other characteristic protected by the Law.

Reply is committed to making sure that our selection methods are fair to everyone. To help you during the recruitment process, please let us know of any Reasonable Adjustments you may need.