Data Engineer: Lakehouse, ETL & PySpark Expert

YTL Construction UK; Bath; On-site; GBP 50,000 - 70,000; Full time

Job summary

A leading construction company in the UK is looking for a Microsoft Data Engineer to design and implement efficient data pipelines and lakehouse structures. The ideal candidate will have expertise in ETL processes, Azure Data Services, and Power BI integration. This role offers a dynamic opportunity to work alongside senior engineers and contributes to enterprise-wide data governance initiatives. Benefits include a strong pension plan, generous holiday allowance, and opportunities for professional development.

Benefits

Pension contribution of up to 20%

25 days holiday rising to 28

Healthcare package

Life assurance

Cashback from retailers

Paid volunteering day annually

Qualifications

• Experience with Delta Lake and Parquet storage concepts.
• Familiar with data processing using Python and Spark SQL.
• Ability to translate business needs into technical solutions.

Responsibilities

• Design and maintain data pipelines and ETL/ELT processes.
• Develop PySpark notebooks for data transformation.
• Collaborate with BI teams for Power BI integration.
• Ensure data governance compliance.

Skills

ETL/ELT design

Azure Data Services

PySpark

Power BI integration

SQL Server expertise

KQL for Eventstream

Data security and compliance

Excellent teamwork skills

Machine learning integration

Job description

A leading construction company in the UK is looking for a Microsoft Data Engineer to design and implement efficient data pipelines and lakehouse structures. The ideal candidate will have expertise in ETL processes, Azure Data Services, and Power BI integration. This role offers a dynamic opportunity to work alongside senior engineers and contributes to enterprise-wide data governance initiatives. Benefits include a strong pension plan, generous holiday allowance, and opportunities for professional development.