Senior Data Engineer

Luxoft
London

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable.

Responsibilities

Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration

Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets

Design, implement, and tune Snowflake data warehouses to support analytical workloads and reporting needs

Partner with data scientists, analysts, and product teams to deliver reliable, well-documented datasets

Ensure data integrity, consistency, and accuracy across multiple sources and systems

Automate data workflows and processes to improve efficiency and reduce manual intervention

Monitor pipeline performance, identify bottlenecks, and resolve issues proactively

Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation)

Enforce data security, compliance, and governance standards in line with industry regulations

Mentor junior engineers, conduct code reviews, and foster a culture of continuous learning and knowledge-sharing

Skills

Must have

5+ years of experience in data engineering or software development

Strong proficiency in Python and PySpark

Hands-on experience with AWS services, especially EMR, S3, Lambda, and Glue

Deep understanding of Snowflake architecture and performance tuning

Solid grasp of data modeling, warehousing concepts, and SQL optimization

Familiarity with CI/CD tools (e.g., Jenkins, GitHub Actions) and infrastructure-as-code

Experience with data governance frameworks and security best practices

Excellent communication and collaboration skills

Nice to have

N/A

Other

Languages

English: C1 Advanced

Seniority

Senior

Posted 2025-09-24

Recommended Jobs

Japanese speaking job - Administrative Assistant - London

People First Recruitment
Central London

Job Title:  Japanese speaking Administrative Assistant The Skills You'll Need: Japanese, sales admin, import admin, SAP Your New Salary: £28,000 London 5 days Office based (No remote work) …

View Details
Posted 2025-10-21

Associate / Associate Director, Environmental (EIA) Consultant - UK Wide

WSP
London

Job Description What if you could do the kind of work the world needs? At WSP, you can access our global scale, contribute to landmark projects and connect with the brightest minds in your field…

View Details
Posted 2025-10-15

SEND Teaching Assistant

Step Teachers
Hayes, Hillingdon, Greater London

We are looking for a dedicated SEND Teaching Assistant with experience supporting students with autism to join a welcoming school on a long-term, temporary, ongoing basis, starting in November 2025.Th…

View Details
Posted 2025-10-15

Commercial Assistant - Retail Flagships

coty
London

  RETAIL SALES ASSISTANT – COTY UK&I 13 MONTHS INTERNSHIP  Starting in July 2026   We’re Coty, a global leader in beauty. We’re #1 in the world for Fragrance and #3 in the world in Colour C…

View Details
Posted 2025-10-27

Event Cleaners - Temporary Project | November

360 TALENT LONDON
London

Event Cleaners - Temporary Project | November We are looking for reliable and detail-oriented Cleaners to support a high-profile luxury event taking place in November . Candidates must be well-pre…

View Details
Posted 2025-10-09

SEN Tutor

Remedy Education
London

SEN Tutor Needed - Child with Complex Medical Needs Barking, East London We are looking for an experienced and compassionate SEN Tutor to support a child with complex medical and physical needs …

View Details
Posted 2025-10-21

Senior Business Development Representative

Quinyx
London

Sr BDR to  Quinyx Sales reps, assemble! Quinyx is on a mission to make work, well, work! In a world full of inefficiencies and lack of control for the frontline hero, we are a team trying to bri…

View Details
Posted 2025-10-27

Stock Controller

Louis Vuitton
London

Louis Vuitton is seeking a Stock Controller for its London location. This full-time, permanent role involves maintaining stock inventory, managing delivery operations, and ensuring product availabilit…

View Details
Posted 2025-09-21

Education Recruitment Manager - London

London

This position is for an education recruitment manager to join an international teacher recruitment agency This is an opportunity to take over a 300 day a week desk which will be split between yo…

View Details
Posted 2025-10-18