Staff Data Platform Engineer
About the Team
Portal is the cloud platform that connects Wayve to the outside world: handling data exchange with partners, surfacing AI insights, and enabling the commercial deployment of Wayve's autonomy stack to OEM partners globally. The team operates as a startup within a scale-up : with its own infrastructure, codebase, and direct relationships with commercial partners including Uber, Nissan and other OEMs. We move fast, own our decisions, and build systems that matter.
The Role
We're looking for a Staff Data Platform Engineer to own and lead Wayve's Data Transfer Hub project. This is a mission-critical piece of infrastructure that will scale to transfer petabytes of sensor data per day from partner-operated vehicles around the world.
This is a hands-on technical leadership role driving a new project at Wayve. You'll design and build a globally distributed hub-and-spoke ingestion system, working directly with data partners like Uber and Nissan. Your infrastructure is what makes Wayve's AI model training possible at scale.
What You'll Do
Set technical direction for the Data Transfer Hub , making trade-offs across reliability, throughput, cost, partner constraints, observability and operational support.
Lead the technical design and delivery of the Data Transfer Hub project, ingesting large volumes of video, LiDAR and sensor data from global partners at up to PB/day scale
Design and build parallelised, distributed data transfer pipelines using Flyte for workflow orchestration, Kafka/event-driven patterns for lifecycle tracing, and Azure for storage and transfer infrastructure
Build and operate a globally distributed hub-and-spoke data transfer model to retrieve and share sensor data at scale with partners
Write infrastructure-as-code in Terraform ; build pipeline logic primarily in Python
Drive cloud-to-cloud and cross-cloud networking solutions (Azure primary; cross-cloud experience beneficial)
Work in a fast-changing environment: requirements will evolve; high comfort with ambiguity required
What We're Looking For
Proven experience building and operating large-scale data transfer pipelines at multi-TB or PB scale
Experience orchestrating parallelised transfer jobs: Flyte preferred; other workflow orchestration tools (e.g. Airflow, Prefect) will be considered
Experience building reliable, observable data systems , including retry strategies, backfills, data integrity checks, lifecycle/state tracking and operational alerting.
Strong cloud platform skills (Azure preferred); experience working with multiple cloud providers (AWS/GCP) is a strong advantage
Proficiency in Python and Terraform
Cloud-to-cloud and networking experience (e.g. blob/object transfer and storage at scale, cross-cloud data movement)
A product mindset : you think about the customer and build solutions that fix real problems, not just implement requirements
Comfort working in a fast-changing environment with evolving requirements: this is a startup within a scale-up
High degree of autonomy and ownership: you take responsibility for outcomes, not just tasks
Nice to Have
Experience with Kafka for event-driven transfer observability
Multi-cloud experience across Azure, AWS and/or GCP
Experience working directly with external data partners
Background in autonomous vehicles, robotics or similar data-intensive domains
This is a full-time role based in our office in London. At Wayve we want the best of all worlds so we operate a hybrid working policy that combines time together in our offices and workshops to fuel innovation, culture, relationships and learning, and time spent working from home. We operate core working hours so you can determine the schedule that works best for you and your team.
#LI-KM1
Recommended Jobs
Senior Backend Engineer | Founding Team
Kulipa is a financial services platform built on the infrastructure of tomorrow: Stablecoins. Stablecoins are dollars (and other fiat currencies) tokenized on a blockchain. They are gaining massive a…
Site Manager - Hillingdon - Immediate Requirement
Site Manager Location: Hillingdon, West London Salary: Competitive (Based on experience) Contract Type: Full-Time, Permanent Start Date: ASAP / Immediate The Opportunity Wayman E…
Midweight Designer
Who We Are Fabric Social is the maverick of social agencies. We specialise in building brands through best-in-class social content, trend-first creative, and community-first thinking. We’re not ju…
Physics Position - Islington - Lovely Independent School
School Status & Location Sector: Highly Selective Independent School, Inner London. Borough: Islington. Start Date: Permanent, full-time role commencing January 2026. The Opportunity & …
Business ECT - Vocational Focus - Barking & Dagenham
ECT of Business Studies – Strong Induction for Vocational/Academic Pathways (KS4/5) – Barking & Dagenham An Outstanding rated secondary school in Barking & Dagenham is seeking an enthusiastic …
General Labourer
Reach for Remarkable Location: Regents Park Barracks, London Pay Rate: £14.80 per hour Hours: Permanent, full-time, 37 hours per week (Mon–Fri, 7:30–16:30) We’re looking for a Gene…
Visual Merchandising & Store Design Lead - Prestige
VISUAL MERCHANDISING & STORE DESIGN LEAD – PRESTIGE DIVISION RETAIL DESIGN & VISUAL MERCHANDISING SW19 – Wimbledon (2 to 3 days per week in the office) Lead the elevation of Coty’s luxury in-…
Art Technician — North London
A creative secondary school in North London is recruiting an Art Technician to support the smooth running of its highly successful Art department. Art Technician required from January 2026 North …
Marine Superintendent
Our client is a leading international shipping company operating a fleet of LPG and tanker vessels, renowned for its commitment to safety, operational efficiency, and strict regulatory compliance wor…
Nursery Practitioner | Barnet | January 2026
Are you an enthusiastic Nursery Practitioner looking for a rewarding role from January 2026? Do you want to work in a Barnet nursery/school setting that values play-led learning, strong attachments…