Staff Data Platform Engineer

wayve
London

About the Team

Portal is the cloud platform that connects Wayve to the outside world: handling data exchange with partners, surfacing AI insights, and enabling the commercial deployment of Wayve's autonomy stack to OEM partners globally. The team operates as a startup within a scale-up : with its own infrastructure, codebase, and direct relationships with commercial partners including Uber, Nissan and other OEMs. We move fast, own our decisions, and build systems that matter.

The Role

We're looking for a Staff Data Platform Engineer to own and lead Wayve's Data Transfer Hub project. This is a mission-critical piece of infrastructure that will scale to transfer petabytes of sensor data per day from partner-operated vehicles around the world.

This is a hands-on technical leadership role driving a new project at Wayve. You'll design and build a globally distributed hub-and-spoke ingestion system, working directly with data partners like Uber and Nissan. Your infrastructure is what makes Wayve's AI model training possible at scale.

What You'll Do

  • Set technical direction for the Data Transfer Hub , making trade-offs across reliability, throughput, cost, partner constraints, observability and operational support.

  • Lead the technical design and delivery of the Data Transfer Hub project, ingesting large volumes of video, LiDAR and sensor data from global partners at up to PB/day scale

  • Design and build parallelised, distributed data transfer pipelines using Flyte for workflow orchestration, Kafka/event-driven patterns for lifecycle tracing, and Azure for storage and transfer infrastructure

  • Build and operate a globally distributed hub-and-spoke data transfer model to retrieve and share sensor data at scale with partners

  • Write infrastructure-as-code in Terraform ; build pipeline logic primarily in Python

  • Drive cloud-to-cloud and cross-cloud networking solutions (Azure primary; cross-cloud experience beneficial)

  • Work in a fast-changing environment: requirements will evolve; high comfort with ambiguity required

What We're Looking For

  • Proven experience building and operating large-scale data transfer pipelines at multi-TB or PB scale

  • Experience orchestrating parallelised transfer jobs: Flyte preferred; other workflow orchestration tools (e.g. Airflow, Prefect) will be considered

  • Experience building reliable, observable data systems , including retry strategies, backfills, data integrity checks, lifecycle/state tracking and operational alerting.

  • Strong cloud platform skills (Azure preferred); experience working with multiple cloud providers (AWS/GCP) is a strong advantage

  • Proficiency in Python and Terraform

  • Cloud-to-cloud and networking experience (e.g. blob/object transfer and storage at scale, cross-cloud data movement)

  • A product mindset : you think about the customer and build solutions that fix real problems, not just implement requirements

  • Comfort working in a fast-changing environment with evolving requirements: this is a startup within a scale-up

  • High degree of autonomy and ownership: you take responsibility for outcomes, not just tasks

Nice to Have

  • Experience with Kafka for event-driven transfer observability

  • Multi-cloud experience across Azure, AWS and/or GCP

  • Experience working directly with external data partners

  • Background in autonomous vehicles, robotics or similar data-intensive domains

This is a full-time role based in our office in London. At Wayve we want the best of all worlds so we operate a hybrid working policy that combines time together in our offices and workshops to fuel innovation, culture, relationships and learning, and time spent working from home. We operate core working hours so you can determine the schedule that works best for you and your team.

#LI-KM1

Posted 2026-07-06

Recommended Jobs

Senior Consultant (Rail Advisory)

London

Around the world, SYSTRA’s specialists plan, design, integrate, test, commission, project manage and deliver mass transit and mobility solutions that are relied on by more than 50 million people ev…

View Details
Posted 2026-07-06

IT Technician - Newham

Marchant Recruitment
Newham, Greater London

Are you a skilled IT Technician who enjoys problem-solving and enabling effective teaching through technology? A forward-looking school in Newham is recruiting an IT Technician to support day-to-day …

View Details
Posted 2025-11-28

Teacher of Chemistry - Brent Independent School

Marchant Recruitment
Brent, Greater London

School Status & Location Sector: High-Achieving Independent School (with Sixth Form). Borough: Brent  Start Date: Permanent, full-time role commencing January 2026. The Opportunity & Schoo…

View Details
Posted 2025-12-06

Integrations Manager (Post-M&A) (Hiring Immediately)

Dwelly
London

About Dwelly Dwelly — a UK-based, AI-enabled lettings and property management platform, that is growing through a roll-up strategy acquiring estate agencies. The company leverages two arms: i) acqui…

View Details
Posted 2026-05-06

Art Teacher - Outstanding School in South East London...

Marchant Recruitment
London

Are you a passionate and dedicated Art Teacher seeking a new opportunity in an outstanding school? We are looking for an enthusiastic Art Teacher to join a thriving creative department in a high-ac…

View Details
Posted 2026-01-27

Join us as a Year 1 Teacher | Hillingdon, Part-time

Marchant Recruitment
Hillingdon, Greater London

A friendly and inclusive primary school in Hillingdon is seeking a dedicated and enthusiastic Year 1 Teacher to join their team on a part-time, fixed-term basis from October half term 2025 until J…

View Details
Posted 2025-10-25

Spanish Teacher - Linguistic Rigour - Waltham Forest

Marchant Recruitment
Waltham Forest, Greater London

Spanish Teacher – Drive Linguistic Rigour and Cultural Fluency in a Progressive School – Waltham Forest A progressive secondary school in Waltham Forest is seeking a skilled MFL Teacher profi…

View Details
Posted 2025-10-11

Postgres Data Engineer - Outside IR35/Remote (IT)

LA International Computer Consultants Ltd
Westminster, Greater London

Postgres Data Engineer - Outside IR35 / Remote We are looking for 3 to 4 Postgres data engineers from junior to senior level. You will have the following experience: - Good proficiency of SQL - W…

View Details
Posted 2026-07-01

Human Resources Project Manager

The Ardonagh Group
London

Are you an experienced HR Transformation professional who thrives on driving meaningful change? We’re looking for a HR Transformation Project Manager to lead and deliver impactful people initiative…

View Details
Posted 2026-05-30

Teacher of Science required (ECT Support) - Brent

Marchant Recruitment
Brent, Greater London

School Status & Location Sector: Outstanding Ofsted Secondary Academy. Borough: Brent (Inner London, England). Start Date: Permanent, full-time role commencing ASAP. The Opportunity & Sch…

View Details
Posted 2026-01-10