Senior Software Engineer, Data
The role
Portal is the cloud platform that connects Wayve to the outside world: handling data exchange with partners, surfacing AI insights, and enabling the commercial deployment of Wayve's AI driver on vehicles across the globe.
We're looking for a Senior Software Engineer, Data to help build Wayve's Data Transfer Hub : a mission-critical piece of infrastructure that will scale to transfer petabytes of sensor data per day from partners covering vehicles around the world.
This is a pivotal project at Wayve. You'll work as part of a small, high-autonomy team building a globally distributed hub-and-spoke data exchange system, working with partners like Uber, Stellantis and Nissan. Your work will help make Wayve's AI model training possible at scale.
Key responsibilities:
Build and operate large-scale data transfer pipelines for video, LiDAR and sensor data from global partners at up to PB/day scale
Contribute to the technical design of the Data Transfer Hub, making pragmatic trade-offs across UX, careliability, throughput, cost, partner constraints, observability and operational support
Build parallelised, distributed data transfer pipelines using Flyte for workflow orchestration, Kafka/event-driven patterns for lifecycle tracing, and Azure for storage and transfer infrastructure
Help implement and evolve a globally distributed hub-and-spoke data transfer model to retrieve and share sensor data at scale with partners
Write infrastructure-as-code in Terraform and pipeline logic primarily in Python
Build reliable operational foundations, including retry strategies, backfills, data integrity checks, lifecycle/state tracking, dashboards and alerting
Work on cloud-to-cloud and cross-cloud networking solutions, with Azure as the primary cloud platform
Once established, participate in an out-of-hours on-call and support rotation.
Collaborate with product, commercial and partner-facing teams to understand constraints and deliver solutions that solve real customer and partner problems
Work in a fast-changing environment where requirements and partner deliverable dates evolve, while maintaining high engineering standards
About you
In order to set you up for success as a Senior Software Engineer at Wayve, we’re looking for the following skills and experience.
Essential
Proven experience building and operating large-scale data transfer, ingestion or data processing pipelines, ideally at multi-TB or PB scale
Strong software engineering skills
Experience delivering & maintaining production systems
Experience with workflow orchestration for parallelised jobs; Flyte preferred, but Airflow, Prefect or similar tools are also relevant
Experience building reliable, observable data systems, including retry strategies, backfills, data integrity checks, lifecycle/state tracking and operational alerting
Strong cloud platform skills, with Azure preferred; experience with AWS or GCP is a plus
Proficiency in Python and Terraform
Experience with blob/object storage, large-scale file movement, networking or cloud-to-cloud data transfer
A product mindset: you think about the customer and build solutions that fix real problems, not just implement requirements
Comfort working in a fast-changing environment with evolving requirements
A strong sense of ownership: you take responsibility for outcomes, communicate clearly, and help the team move quickly
Desirable
Experience working with external data partners or customer-facing technical integrations
Background in autonomous vehicles, robotics, geospatial data, video processing or other data-intensive domains
Experience with Kafka or other event-driven systems for transfer observability and lifecycle tracking
Experience building dashboards to communicate transfer job status
Multi-cloud experience across Azure, AWS and/or GCP
Experience improving cost efficiency, throughput or reliability of large-scale cloud data systems
This is a full-time role based in our office in London. At Wayve we want the best of all worlds so we operate a hybrid working policy that combines time together in our offices and workshops to fuel innovation, culture, relationships and learning, and time spent working from home.
Recommended Jobs
Head of Geography Vacancy - School near Tower Bridge...
Head of Geography Highly Regarded Secondary School near Tower Bridge Station Full-time/Permanent September 2026 Job Overview A highly regarded secondary school near Tower Bridge Station…
Senior Project Controls Manager
Position: 210CMR: Senior Project Controls Manager Location : Remote 2 days / London 3 days Type: Full-time Start Date : Immediate Salary : Competitive We have an exciti…
Housing Litigation Lawyer
Housing Litigation Lawyer needed in East London Paying £40.81 per hr ref 135822 Full time hours on a temporary basis Key Responsibilities Manage a varied caseload of housing litigation matte…
Cleaning Supervisor - 4 hours per evening (£15ph)
August 2022 Dazzle is a rapidly fast-growing tech led commercial cleaning company that prides itself on exceptional customer care and that values its employees hugely. We are looking for an experie…
Media Studies Teacher - Outstanding Secondary School,...
Media Studies Teacher – Outstanding Secondary School, Tower Hamlets Start Date: As soon as possible Contract: Full-time, Permanent Salary: Paid to scale School information: This is …
EYFS Teaching Assistant - Twickenham
We are seeking a caring, reliable, and enthusiastic EYFS Teaching Assistant to join a supportive primary school in Twickenham, starting as soon as possible. This role is ideal for someone passionate …
Manager, Indirect Tax (advisory)
Job Details At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.…
Sales Associate
Want to start a career that’s full of opportunities and excitement? Whether you’re just starting out or have experience in people-facing roles like waitressing, warehouse work, or retail, we want you…
ASW Social Worker (2 yrs + PQE) (Adults) - Max Rate
Job Category : Social Care – Qualified (Adults) Location : Hackney Service Centre, Hackney Council Salary: £23.56 Social Worker position available in the Integrated Learning Disability Service…
Senior Interactive Designer
Who We Are Kargo creates powerful moments of connection between brands and consumers to build businesses. Every day, our 600+ employees work to radically raise the bar on what agentic AI, CTV, eCo…