Big Data Architect

DataSpartan Consulting; London; On-site; GBP 60,000 - 80,000; Full time

Job summary

A data consulting firm in London is searching for a data management professional with expertise in Big Data and Cloud technologies. The successful candidate will collaborate with clients to define secure data strategies, process diverse data sets, and support advanced analytics efforts. Applicants should have at least 5 years of experience, strong knowledge of ETL tools, and a commitment to data governance. This role involves leading projects and mentoring junior engineers, offering a chance to work on innovative data solutions.

Qualifications

• 5 years of experience in relevant data management roles.
• Experience working in close-knit teams on client-facing projects.
• Proven ability to communicate complex data solutions.

Responsibilities

• Model clients' data landscape and define secure data exchange approaches.
• Plan and execute data integration strategies.
• Process data from multiple sources into Big Data platforms.
• Create and manage data environments in the Cloud.
• Collaborate with data scientists for advanced analytics.

Skills

Data security & governance expertise

Strong experience in traditional data warehousing / ETL tools

Experience with Big Data technologies

Commercial client-facing project experience

Ability to communicate complex solutions

Tools

Informatica

Talend

Pentaho

DataStage

Hadoop

Spark

AWS

Azure

Job description

Overview

You’re passionate about data and the opportunity it provides to organisations. You ‘get’ Big Data and Cloud computing for more advanced data processing and Analytics, and are excited about these technologies. You are equally comfortable talking to senior client stakeholders to understand their data as well as designing the ingestion process to store the data locally and preparing it for Data Analytics. You have experience in handling vast amounts of data – working on database design and development, data integration and ingestion, designing ETL architectures using a variety of ETL tools and techniques. You are someone with a drive to implement the best possible solutions for clients and work closely with a highly skilled Data Science team.

Responsibilities

• Work with our clients to model their data landscape, obtain data extracts and define secure data exchange approaches
• Plan and execute secure, good practice data integration strategies and approaches
• Acquire, ingest, and process data from multiple sources and systems into Big Data platforms
• Create and manage data environments in the Cloud
• Collaborate with our data scientists to map data fields to hypotheses and curate, wrangle, and prepare data for use in their advanced analytical models
• Have a strong understanding of Information Security principles to ensure compliant handling and management of client data
• This is a fantastic opportunity to be involved in end-to-end data management for cutting-edge Advanced Analytics and Data Science
• Use new and innovative techniques to deliver impact for our clients as well as internal R&D projects
• A proven ability to lead a project from an engineering perspective, owning the workflow and setting expectations
• Mentoring junior engineers allowing them to develop and be challenged

Qualifications and Skills

• 5 years of experience.
• Commercial client-facing project experience is beneficial, including working in close-knit teams
• A proven ability in clearly communicating complex solutions
• Data security & governance expertise
• Strong experience in traditional data warehousing / ETL tools (Informatica, Talend, Pentaho, DataStage)
• Experience and interest in Big Data technologies (Hadoop / Spark / NoSQL DBs) and Cloud (AWS and Azure)

Apply to join our team!

First name

Last name

Email *

LinkedIn URL

Phone Number

Role Applying For *

Message to Hiring Manager

Attach CV *

Data Spartan Limited is committed to protecting and respecting your privacy, and we’ll only use your personal information to administer your account and to provide the products and services you requested from us. From time to time, we would like to contact you about our products and services, as well as other content that may be of interest to you. If you consent to us contacting you for this purpose, please tick below to say how you would like us to contact you:

• I agree to receive other communications from Data Spartan Limited.

You can unsubscribe from these communications at any time. For more information on how to unsubscribe, our privacy practices, and how we are committed to protecting and respecting your privacy, please review our Privacy Policy.

By clicking submit below, you consent to allow Data Spartan Limited to store and process the personal information submitted above to provide you the content requested.