Principal Data Engineer
Principal Data Engineer
We're building a modern technology platform that applies data engineering and AI to a problem with real global consequence: proving trust and transparency in supply chains. Our work helps protect people from exploitation, gives brands and producers confidence in what they sell, and supports more sustainable choices for the planet.
From a tech perspective, this is greenfield - designing scalable, cloud-native systems and AI-driven products that turn complex data into evidence customers can stand behind. You'll be working on hard, meaningful problems, with real ownership, close collaboration with product and leadership, and the opportunity to shape both the technology and the impact it delivers as we scale.
We're a global team across London, Auckland, Singapore, and Washington D.C.
Key Responsibilities
Define and own the technical strategy and architecture for our entire data platform: ingestion, storage, processing, governance, and consumption
Design and implement scalable, reliable ETL/ELT pipelines handling complex scientific datasets, supply chain inputs, and business data
Lead the design of canonical data models for our data warehouse and operational stores, ensuring quality, consistency, and integrity
Define and maintain a single source of truth for clients, suppliers, and transactions across systems (Salesforce, NetSuite, internal databases)
Implement data governance, security policies, automated quality checks, and robust monitoring across all pipelines
Work with the infrastructure team to provision Azure data resources using Terraform or equivalent IaC tooling
Partner with our Science teams to ensure accurate ingestion and translation of raw scientific data
Mentor engineers across the team on best practices for building and consuming data services
Skills & Experience
Essential
7+ years in data engineering, with significant time in a Principal, Lead, or Architect role defining data strategy
Deep, practical experience with Databricks — architecture and implementation
Strong hands-on experience across the Azure data stack: Data Factory, Data Lake, Synapse Analytics, Azure SQL/Cosmos DB
Expert-level Python and SQL, with a strong focus on clean, tested, performant data processing code
Proven track record designing and implementing scalable data warehouses and data marts
Experience with workflow orchestration, CI/CD for data pipelines, and IaC (Terraform)
Desirable
Experience with scientific, geospatial, or time-series data
Background in governance or compliance environments
Familiarity with streaming data technologies
The Recruitment Process
We like to keep our recruitment process smooth and efficient, giving you the opportunity to showcase your skillset in a comfortable environment. The process for this position is a 2-stage interview and short take home task.
Company Benefits
Paid Leave- 35 days (inclusive of public holidays) + your birthday off
Volunteering Leave Allowance
Enhanced Parental Leave
Life Insurance
Healthcare Cash Plan
Employee Assistance Programme (EAP)
Pension
Monthly Wellbeing Allowance
Breakfast, Snacks, Friday lunch & Barista Coffee Machine in the office
Learning Portal with over 100,000 assets available to support professional development
Recommended Jobs
Clinical Trials Supply Chain Manager
Our client, a global pharmaceutical company, is currently looking for a Clinical Trials Supply Chain Manager to join their team in Uxbridge on a full time, 6-month temporary basis (35 hours per week).…
Mandarin speaking Job-HR Specialist - wm
Please follow us on WeChat to see all our Cantonese and Mandarin jobs, interview tips and London news: Your New Job Title: Mandarin speaking HR Specialist The Skills You'll Need: Mandarin …
Roadside Assistance Specialist
Join Our Team as a Roadside Technician Become a vital part of the team that keeps the UK moving! As a Roadside Technician , you will leverage your Level 2 Light Vehicle Maintenance qualification (…
Early Years Nursery Practitioner in Beckenham
Early Years Nursery Practitioner position with immediate start This vibrant and welcoming nursery in Beckenham is looking for a dedicated and hardworking Early Years Nursery Practitioner to join t…
Senior Sales Executive Energy Projects Conference & Expo
We are looking for a driven and consultative Senior Sales Executive to join our Energy Projects Conference & Expo team at Easyfairs. This role is hybrid, based in Twickenham. This role also re…
Live In Carer
© 2012-2022 Healthcare Homes Holdings Limited. Registered in England. Company No. 6545256.
Billings & Collection Specialist
44097 Billing & Collection Specialist I am partnering with a specialist Insurance organisation that is seeking a Billing & Collection Specialist to join their finance operations team. This is …
Teacher of English - Independent Mixed School - Islington
A highly respected independent Mixed School in Islington, Central London, known for its strong liberal arts focus and intellectual debate culture, is seeking an experienced Teacher of English for a P…
Class 2 Driver
HGV Cat C Class 2 Driver The Best Connection are working with a well-established client, who have an excellent opportunity for an experienced 7.5 Tonne driver, for work ASAP in Woodford Green! This…
Year 4 Teacher - Independent School - Richmond - January...
Overview A well-resourced Independent School in Richmond seeks an enthusiastic Year 4 Teacher on a Full-Time contract from January 2026 . This Independent School prides itself on a broad, en…