Senior Data Engineer

Collinson Group; Greater London; On-site; GBP 60,000 - 85,000; Full time

Job summary

A global travel solutions provider based in Greater London is seeking a Data Engineer. The successful candidate will design and maintain data pipelines while using Agile methodologies. Qualifications include a degree in computer science, at least 5 years of experience in Data Engineering, and proficiency in Python and AWS technologies. This role offers a collaborative and innovative environment with opportunities for personal and professional growth.

Qualifications

• At least 5 years’ experience in a Data Engineering role.
• In-depth understanding of modern data architectures and data modelling.
• Experience with Scrum, Kanban, or other Agile methodologies.

Responsibilities

• Design, develop, and maintain data pipelines.
• Write efficient and scalable code in Python.
• Provide technical support and deliver high-quality documentation.

Skills

Python

Data Engineering

Agile methodologies

AWS Technologies

Stakeholder management

Education

University Degree in Computer Science or Engineering

Tools

AWS (Aurora, Glue, Lambda, Step Functions, S3, API Gateway, SQS, SNS, Athena)

CI/CD (Terraform, CodeBuild, Flyway)

GitHub Enterprise

Job description

Overview

Collinson is the global, privately-owned company dedicated to helping the world to travel with ease and confidence. The group offers a unique blend of industry and sector specialists who together provide market-leading airport experiences, loyalty and customer engagement, and insurance solutions for over 400 million consumers. Collinson is the operator of Priority Pass, the world’s original and leading airport experiences programme, with access to a network of 1,500+ lounges and travel experiences in over 650 airports in 148 countries. We work with the world’s leading payment networks, over 1,400 banks, 90 airlines and 20 hotel groups worldwide. Our mission focuses on doing good beyond profit, and we seek opportunities for our people to share in our success and give back to the communities in which we work. Our business is driven by a diverse and talented team of over 2,200 global colleagues.

Purpose of the job

The Data Engineering Team is responsible for maintaining and enhancing the data platform, to deliver business value to both internal and external stakeholders. As a Data Engineer, you’ll be a key member of this team which delivers functionality using the Agile delivery methodology. You will be responsible for designing, building, and maintaining data pipelines under the guidance of a Principal Software Engineer to the agreed development plan and to approved specifications. You will have the opportunity to bring innovation to the team, using cutting-edge data engineering frameworks and techniques.

Key Responsibilities

• Design, develop, and maintain data pipelines for collecting, transforming, and loading data into various data stores
• Write efficient and scalable code in languages such as Python
• Develop collaborative relationships with internal stakeholders to understand their data requirements and provide solutions
• Resolve day-to-day challenges or issues without the need for technical guidance
• Provide competent, proactive, and professional technical support when required
• Deliver supporting documentation of a high quality
• Actively engage in and contribute to agile planning and design sessions
• Support agile process improvements that will improve productivity, effectiveness, and professionalism of the team, without impacting budgets and delivery plans
• Contribute to the Code Peer Review community to improve the quality of code produced and ensure it adheres to our standards
• Participate in regular team meetings to ensure the correct tasks are being worked on and share key decisions required, risks identified and highlight any issues encountered
• Support, develop and improve our CI/CD pipelines
• Maintain a good technical awareness and familiarity with new and forthcoming relevant technologies

Knowledge, skills and experience required

• Required: University Degree in computer science, engineering, or related experience required
• At least 5 years’ experience in a Data Engineering role or with similar technical systems and technologies
• Experience with Scrum, Kanban, or another Agile application development methodology
• Experience of working across multiple delivery organisations practising distributed development
• Specific Technical Skills: In-depth understanding of modern data architectures and data modelling practices
• Strong programming skills in Python, PySpark
• Extensive experience with AWS Technologies (Aurora, Glue, Lambda, Step Functions, S3, API Gateway, SQS, SNS, Athena)
• Familiarity with CI/CD for data pipelines using Terraform, CodeBuild and Flyway
• Usage of Source Control tools (GitHub Enterprise)

Personal Skills

• The ability to demonstrate through examples, the effective management of stakeholder relationships
• Excellent written and spoken English
• Personable, enthusiastic and a good communicator (ability to present, inform and guide others)
• Ability to bridge communications between technical and business focused groups
• Passionate about technology – willingness to learn about new and emerging technology within web, cloud, languages, frameworks, and methodologies
• Ability to thrive in a fast moving and changing environment
• Ability to show initiative and to work independently
• Willingness to take on a variety of roles and responsibilities

Collinson is an equal opportunity employer and welcomes differences in all their forms including: colour, race, ethnicity, gender identity, sexual orientation, neurodivergence, family status, age, individuals with disabilities and people from all backgrounds, cultures and experiences as we strongly believe this contributes to our on-going success.

We are focused on continually evolving our purpose driven, high performing culture, providing an environment where our people have the opportunity to achieve their full potential and do interesting and meaningful work. Our company values are: Take Action, Do the right thing, One team and Be insight led. These help guide everything we do internally in terms of how we think, act and interact, right through to how we deliver value to our customers and clients.

In your application, please feel free to note which pronouns you use (For example - she/her/hers, he/him/his, they/them/theirs, etc).

If you need any extra support throughout the interview process, then please email us at [e-mail]