Senior Data Engineer - Analytics Engineering

Apple Inc.; Ireland; On-site; EUR 70,000 - 100,000; Full time

Job summary

A leading tech company is seeking a Senior Data Engineer to create data pipelines for its Knowledge Graph in Dublin. This role involves significant influence and responsibility, focusing on unifying data across the Services division. Ideal candidates will have a Bachelor's degree in a related field, industry experience in data engineering, and proficiency in tools like Spark and Hadoop.

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, or equivalent professional experience.
• Industry experience in a Data Engineering/Data Architecture role.
• Experience working with Spark and other distributed data technologies.

Responsibilities

• Design and develop data pipelines for the Knowledge Graph.
• Work alongside a team of software and data engineers.
• Responsibility over the direction of a critical service.

Skills

Experience with Spark

Data Engineering

Backend API Development

Education

Bachelor’s degree in Computer Science or related field

Tools

Hadoop

Neo4j

Data Lake

Data Warehouse

Job description

Dublin, County Dublin, Ireland Software and Services

Description

We are looking for a Senior Data Engineer to design and develop data pipelines that will be the basis of our Knowledge Graph. The Knowledge Graph aims to unify insights on data processing and lineage across the entire Services division, pulling in metadata on workflows, execution jobs, schemas and more to generate a rich view of our data pipelines, exposed in an application that will be used daily by hundreds of internal data engineers. The graph will also power operational excellence, capturing production issues, driving analysis and guiding resolution of issues and enabling proactive avoidance of future incidents.You’ll work alongside a Dublin based team of software and other data engineers committed to bringing the knowledge graph to life, focusing on designing the data layer. You will have significant individual responsibility and influence over the direction of this critical service, and the opportunity to learn and interact with a department of global teams each with unique skill sets and operating in different time zones.

Minimum Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, or equivalent professional experience.
• Industry experience in a Data Engineering/Data Architecture role
• Experience working with Spark and other distributed data technologies (e.g. Hadoop, Presto, Druid) for building efficient & large scale data pipelines.

Preferred Qualifications

• Growth mindset and ability to learn new technologies
• Experience in backend API development and management
• Experience with a graph database (eg Neo4j, TigerGraph)
• Familiar with Data Lake and Data Warehouse technologies
• Good understanding of software development life cycle, version control, code reviews, testing, data quality tools and frameworks