Senior Data Engineer

Mastek UK
London
Senior Data Engineer

Location: London, UK (3 days in the office)

SC Cleared: Required

Essential Skills & Experience:

* 10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks.

* Strong proficiency in Python and Spark (PySpark) or Scala.

* Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns.

* Extensive experience with Azure data services, including Azure Data Factory, Azure Blob Storage, and Azure SQL Database.

* Experience working with large datasets and complex data pipelines.

* Experience with data architecture design and data pipeline optimization.

* Proven expertise with Databricks, including hands-on implementation experience and certifications.

* Experience with SQL and NoSQL databases.

* Experience with data quality and data governance processes.

* Experience with version control systems (e.g., Git).

* Experience with Agile development methodologies.

* Excellent communication, interpersonal, and problem-solving skills.

* Experience with streaming data technologies (e.g., Kafka, Azure Event Hubs).

* Experience with data visualisation tools (e.g., Tableau, Power BI).

* Experience with DevOps tools and practices (e.g., Azure DevOps, Jenkins, Docker, Kubernetes).

* Experience working in a financial services or economic data environment.

* Azure certifications related to data engineering (e.g., Azure Data Engineer Associate)
Posted 2025-09-11

Recommended Jobs

Engineering Manager - Platform

Omaze
Central London

Engineering Manager - Platform ~&##127991;️ Role: Engineering Manager - Platform ~&##128221; Reports to: VP of Technology ~&##128107; Team: Technology ~&##127757; Location: Holborn, London …

View Details
Posted 2025-09-11

Functional Skills Teacher

Prospero Teaching
Croydon, Greater London

SEN Maths Teachers/Tutors required in Croydon (Tutors are welcome to apply) School Type: Pupil Referral Unit SEN Needs: SEMH, severe challenging behaviour Location: Croydon, CR0 Part Time: 3 Days…

View Details
Posted 2025-09-12

Head Barista and Lounge Host

Fooditude
London

Head Barista and Lounge Host Fulltime, 40 hours a week, Monday to Friday, £33,280 p/a Fooditude are looking for a Head Barista and Lounge Host to provide superb service at a prestigious client …

View Details
Posted 2025-09-25

Account Manager - PR Financial Services

The Opportunity Hub UK
London

We have an excellent opportunity for a proactive senior account manager who would be part of a 6 person team. The company are consistently growing and you would be part of top ranked agency team. The …

View Details
Posted 2025-09-09

Interim Head of Learning & OD

Morgan Law
London

We are delighted to be recruiting an Interim Head of Learning & Organisational Development for a period of 12 months for Certitude. Certitude is a leading provider of support for people with learn…

View Details
Posted 2025-09-27

Business Development Manager - Oil/Gas & Renewables

Skyports Drone Services
London

Job Title: Business Development Manager - Oil/Gas & Renewables Location: London, UK Departement: Commercial Type: Permanent, Full Time About Us: Founded in 2018, Skyports is at the …

View Details
Posted 2025-09-12

General Manager

Stratford, Greater London

A calendar of wellness activities - from healthy lunches to wellbeing walks and pay day treats, not forgetting our annual #HealthyHabits campaign. Access to our Employee Assistance Programme, prov…

View Details
Posted 2025-09-15

Deputy Manager

Leaders In Care Ltd
Richmond, Greater London

Are you a passionate nurse with experience in rehabilitation and acquired brain injuries? Our client is looking for a dedicated Deputy Manager to join their newly commissioned, 35-bed residential reha…

View Details
Posted 2025-09-11

Post Production Technical Associate - 12 Month Fixed Term Contract

Disney Entertainment and ESPN Product & Technology
London

Job Summary: About the Role & Team At Disney Entertainment & ESPN Product & Technology (DEEP&T), we bring together world-class product, technology, and commercialization teams to drive the gl…

View Details
Posted 2025-09-10

Administrative Assistant

Jobs in Fitness
London

This is an exciting opportunity for anyone looking to break into the recruitment industry within a dynamic, fitness-focused environment. The successful candidate will join a team dedicated to connect…

View Details
Posted 2025-09-30