Data Engineer
- Hands on development on Nexus Platform
- Monitoring daily BAU data pipelines and ensure our data solution is refreshed up to date every day
- Enhance the daily BAU process. Making it easier to monitor and less likely to fail and hands on development on Data Lake build, change and defect fix
- Building new data pipelines using existing frameworks and patterns
- Working with the team within an Agile framework using agile methodology tooling that controls our development and CI/CD release processes
- Contributing to the new Data Lake technology across the organisation to address a broad set of use cases across data science and data warehousing
- Experience with data solution BAU processes (ETL, table refresh etc.)
- Experience with integration of data from multiple data sources
- Experience in Big Data data integration technologies such as Spark, Scala, Kafka
- Experience in programming language such as Python or Scala.
Experience using AWS, DBT and Snowflake. - Analytical and problem-solving skills, applied to data solution
- Experience of CI/CD
- Good aptitude in multi-threading and concurrency concepts
- Familiarity with the fundamentals of Linux scripting language
- Experience of ETL technologies
- AWS exposure (Athena, Glue, EMR, Step functions)
- Experience of Snowflake and DBT
- Experience with data solution BAU processes (ETL, table refresh etc
- Previous proficiency with ETL technologies (e.g. Talend, Informatica, Abinitio)
- Previous exposure to Python
- Previous exposure to own data solution BAU monitoring and enhancement
- Exposure to building applications for a cloud environment
Recommended Jobs
Temp - Perm Client Events Co-ordinator in Wandsworth
Temp - Perm Client Events Co-ordinator Are you passionate about events and looking for an exciting opportunity to showcase your skills? Our client, a dynamic player in the events industry, is seeking…
Operations & Assurance Manager
Role Profile – Operations & Assurance Manager Purpose of the Role The Operations & Assurance Manager will provide dedicated leadership to the CP team and strengthen operational assurance acro…
Secondary Divisional Manager - North London
This position is for an education recruitment professional with experience in supplying Secondary Schools with teachers and support staff to join an Education recruitment agency based in North London…
Art & Design Teacher - Creative Community - Barking &...
Art & Design Teacher – Champion Creative Excellence in a Supportive, Community-Oriented School – Barking & Dagenham A supportive , community-oriented secondary school in Barking & Dagenham i…
STOCK ASSISTANT (16 hours, White City WN, Fix Term)
At Mango we style everything we do with passion. Founded in Barcelona and with presence in over 120 countries, we inspire the world with creativity, innovation and authenticity. Our multicultura…
TIG Welder/Fabricator
TIG Welder/Fabricator - Aluminium Specialist (Milton Keynes) Monday-Friday | Ongoing work | Start ASAP Are you an experienced TIG Welder/Fabricator looking for a long-term position with steady hours…
Early Years Practitioner in Hampstead
Calling all Early Years Practitioners in Hampstead! This welcoming and bright nursery in Hampstead is currently looking for a dedicated Early Years Practitioner who holds a relevant qualifica…
.NET Developer
.NET Developer, .NET 9, C# - Break Into Banking - London (Tech stack: .NET Developer, .NET 9, C#, Azure, Angular 19, Multithreading, RESTful, Web API 2, JavaScript, Programmer, Full Stack Engineer, A…
Principal Communications Engineer
Our Client, a major Rail, Highways, Power and Tunnels consultancy are seeking a highly skilled and experienced Controls and Communications Engineer (CRE) to provide engineering leadership across the …