Technical Architect (IT)
SC cleared technical architect
- Stakeholder engagement, requirements gathering, and collaboration with the current Data/Analytics Engineer to assess integration into the product roadmap.
- Working within Agile (Scrum) workflows, including ticket definition, allocation, and contributing to the Corporate Roadmap.
- Low-level design and build, ensuring best practices for reusable pipelines and data models.
- Leveraging an appropriate technology stack to build high performance, reusable, self service pipelines for automating Extract Load configurations.
- Defining infrastructure for data pipelines using AWS technologies (e.g., S3, Glue, Athena).
- Casting, cleaning, testing, and modelling loaded data using dbt, following a Kimball Dimensional Model architecture.
- Migrating extract/load pipelines from Airflow infrastructure, including defining a robust testing approach.
- Re architecting pipelines from ETL to ELT, leveraging dbt for dimensional modelling and transformation.
- Working with Data Engineers to deliver a generic, reusable approach to extracting data from source systems (specifically web app data using PlayWright), including Finance and HR datasets.
- Loading data from S3 to Athena using the dlt Python package.
Recommended Jobs
Nursery Practitioner
Nursery Practitioner - Baby Room Location: City of London Salary: 26,800 - 27,800 Hours: Full-time, 40 hours per week (4.5 days) Shift Pattern: 08:00 - 18:00, with one half …
Music Teacher - Hillingdon
Music Teacher – Hillingdon Location: Hillingdon, West London Salary: MPS/UPS (Outer London) Contract Type: Full-Time, Permanent The Opportunity Wayman Education is seeking a creative…
Assistant / Intermediate Project Manager
Are you an enthusiastic Assistant or Intermediate Project Manager in London looking for a new challenge? Do you want to work for a company that will out you and your professional growth first? If so,…
HGV Fitter - Hayes, Greater London
HGV Fitter - Hayes, Greater London FM Conway is currently recruiting for an experienced HGV Fitter to join our Plant and Workshop division based out of our Heathrow depot. Working within our bu…
Music Teacher - Barnet | Independent School
We are working with a leading independent school in the North London area seeking a proactive and inspiring Music Teacher. The school features a professional-standard concert hall and recording suite…
Chef de Partie | Mute Swan
Are you a culinary enthusiast looking for a vibrant kitchen to call home? We're on the hunt for a talented Chef de Partie to join our passionate team here at The Mute Swan . If you thrive in a fast…
Senior Asset Manager Digital Integration - Strand, London, WC2R 2LS
Senior Asset Manager Digital Integration - Strand, London, WC2R 2LS About us: King’s College London’s Directorate of Estates & Facilities is responsible for managing and developing the unive…
Midday Meal Supervisor (MDM)
Location: London Borough of Brent Cross / Golders Green Area (Barnet adjacent) Hours: Part-Time | Term-Time Only Working Pattern: Lunchtime cover, Monday to Friday Pay: Competitive …
Daily Nanny-Housekeeper, Job ID J1FA28
An warm, energetic Nanny-housekeeper is needed by this family in Chelsea, London, to care for their toddler and two school-aged children while also maintaining a clean and organised home. The role re…