Technical Architect (IT)
SC cleared technical architect
- Stakeholder engagement, requirements gathering, and collaboration with the current Data/Analytics Engineer to assess integration into the product roadmap.
- Working within Agile (Scrum) workflows, including ticket definition, allocation, and contributing to the Corporate Roadmap.
- Low-level design and build, ensuring best practices for reusable pipelines and data models.
- Leveraging an appropriate technology stack to build high performance, reusable, self service pipelines for automating Extract Load configurations.
- Defining infrastructure for data pipelines using AWS technologies (e.g., S3, Glue, Athena).
- Casting, cleaning, testing, and modelling loaded data using dbt, following a Kimball Dimensional Model architecture.
- Migrating extract/load pipelines from Airflow infrastructure, including defining a robust testing approach.
- Re architecting pipelines from ETL to ELT, leveraging dbt for dimensional modelling and transformation.
- Working with Data Engineers to deliver a generic, reusable approach to extracting data from source systems (specifically web app data using PlayWright), including Finance and HR datasets.
- Loading data from S3 to Athena using the dlt Python package.
Recommended Jobs
Maths Teacher - Independent School - Sutton
Maths Teacher – Independent School – Sutton An excellent Independent School in Sutton is looking to appoint a Maths Teacher to teach across KS3–KS5. • Maths Teacher • Independent School • S…
Year 5 Teacher - Lewisham
Wayman Education is seeking a passionate Year 5 Teacher for an Outstanding primary school in Lewisham. The successful Year 5 Teacher will deliver a creative curriculum and promote strong progress and…
Site Supervisor Vacancy - Primary School in Newham!
A friendly and well-run primary school in Newham is seeking a reliable and proactive Site Supervisor to take responsibility for the day-to-day operation, safety, and maintenance of the school premise…
Health, Safety & Fire Risk Assessor
Karntek a trusted name in fire safety consultancy, is seeking a Health, Safety & Fire Risk Assessor to join our professional team of fire and building safety consultants. Karntek are accredited to …
Scientific Director II, Translational Precision Medicine, Neuroscience
Company Description About AbbVie AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of to…
Logistics Category Specialist
About Holcim We are leaders in supplying innovative, sustainable building solutions to the UK construction industry; building progress for people and the planet. Since 1858, we’ve helped shape …
Spanish Teacher Position - Independent Mixed School in...
A prestigious independent Mixed School in Barnet, North London, celebrated for its linguistic success and international outlook, is seeking a MFL Teacher (specialising in Spanish) for a Permanent, Fu…
Procurement Executive
Overview Delaware North UK is hiring a full-time Procurement Executive to join our collaborative team at our Head Office in Uxbridge, London. When you're working with locations and events like our…
Lead Engineer
M&E Lead Engineer Location – London, EC2P 2SR Hours – 4 on 4 off shift pattern, 7am-7pm 1 in 5/6 weeks – OOH emergency callout cover There is also an enhanced call out allowance (built …
Multi Trade Operative
We are currently looking for a Multi Trade Operative. You will be working in the Surrey area Monday - Friday 08:00am - 17:00pm Temp Contract - Ongoing Pay rate - £18.60ph paye or £23.62ph umbrella J…