Data Engineer (Python, Kibana, Elasticsearch & AWS) - DV Security Clearance (IT)
Shape secure, data-driven solutions that help government clients tackle some of their most complex challenges. As a Senior Data Engineer within CGI?s Secure Innovation team, you?ll turn complex datasets into trusted insight, with particular emphasis on Kibana visualisation and hands-on data engineering. You?ll take ownership of data quality and end-to-end flows, creatively solve technical challenges, and collaborate with experts to deliver secure, scalable solutions that make a measurable difference. Working with modern technologies including Python, Elasticsearch, Kibana and AWS, you?ll have the freedom to innovate while being supported with ongoing learning and development to keep your skills at the forefront of an evolving technology landscape. CGI was recognised in the Sunday Times Best Places to Work List 2025 and has been named a UK ?Best Employer? by the Financial Times. We offer a competitive salary, excellent pension, private healthcare, plus a share scheme (3.5% + 3.5% matching) which makes you a CGI Partner not just an employee. We are committed to inclusivity, building a genuinely diverse community of tech talent and inspiring everyone to pursue careers in our sector, including our Armed Forces, and are proud to hold a Gold Award in recognition of our support of the Armed Forces Corporate Covenant. Join us and you?ll be part of an open, friendly community of experts. We?ll train and support you in taking your career wherever you want it to go. Due to the secure nature of the programme, you will need to hold DV level UK Security Clearance or be eligible to go through this clearance. This is a hybrid position and will require the holder to spend a minimum of 3 days a week on site in Central London Candidate profile: In this role, you will engineer, analyse and validate data that supports secure, high-value solutions for our government clients. You?ll take ownership of data quality and integrity across end-to-end data flows, using Kibana and Elasticsearch to create visualisations, dashboards and investigations that turn complex information into actionable insight. You?ll work collaboratively across upstream and downstream teams, bringing creative thinking to technical challenges and identifying risks, anomalies and dependencies before they affect delivery. Supported by CGI colleagues and ongoing development opportunities, you?ll communicate findings clearly to technical and non-technical stakeholders, including senior leadership and client teams.
- Engineer & Deliver: Develop and support robust data engineering solutions using Python and modern data tooling.
- Visualise & Investigate: Use Kibana and Elasticsearch extensively to build dashboards, investigate datasets and communicate meaningful insights.
- Analyse & Validate: Perform detailed data analysis, integrity checks and quality validation across multiple data formats.
- Automate & Improve: Use Python and command-line tooling to automate analysis and operational activities.
- Manage Data Flows: Load data into bespoke visualisation tools and work with AWS services, including S3.
- Own Data Quality: Understand end-to-end data flows, dependencies and impacts, proactively identifying risks and anomalies.
- Collaborate & Communicate: Work across technical teams and provide clear status updates and findings to clients and senior stakeholders.
- Innovate & Develop: Explore new technologies and approaches while sharing knowledge within a supportive, collaborative engineering environment.
- Strong data engineering experience, including working with complex datasets and end-to-end data flows.
- Strong practical experience with Kibana, including dashboards, data visualisation and investigative analysis.
- Experience with Elasticsearch and its use alongside Kibana.
- Proficiency in Python for data analysis, development and automation.
- Proven experience in data analysis, validation, integrity and quality checking.
- Familiarity with AWS, particularly navigating services and working with S3.
- Experience with command-line tools for investigation, file handling and operational activities.
- Strong analytical and problem-solving skills, with the ability to identify risks, issues and anomalies.
- Excellent attention to detail and the ability to interpret nuances across multiple data formats.
- Effective stakeholder communication and collaboration skills, including working across teams and communicating with senior and client stakeholders.
- A demonstrable interest in learning, innovation and continuous technical development.
#LI-RB8
Recommended Jobs
Senior Software Engineer
Oritain is the global leader in product origin verification, with locations in Auckland, Dunedin, London, Singapore and Washington D.C. We sit at the intersection of forensic science and supply ch…
Daily Supply Teacher
Daily Supply Teacher Location: Wandsworth, London Salary: £145 - £175 per day, depending on qualifications and experience. Contract: Temporary daily supply; working days agreed for each booking St…
Team Member - Full Time - Bleecker - Seven Dials, London
Team Member - Full Time - Bleecker - Seven Dials, London We are looking for a Team Member to join the Seven Dialsteam! The role: Team Members are essential to Bleeckers operations. They l…
Site Manager | Successful Secondary School | Lambeth
Position: Site Manager Location: Lambeth Contract: Full-Time, Permanent Start Date: Immediate Start Available Site Manager Role in a Successful Secondary School A Successful Second…
Lead Year 5 Teacher | Good Primary School | Newham
A forward-thinking Good primary school - Newham is seeking an experienced and ambitious Lead Year 5 Teacher to join its Key Stage 2 team from September . This is a full-time, permanent positio…
Finance Apprenticeship
Summary Todd Doors is seeking an apprentice who is dedicated and has a real interest in Accounts to join their wonderful team. The successful candidate will enrol onto a Level 2 Accounts/Finance a…
Teacher of Science (Biology Specialist) | Haringey |...
A highly regarded secondary school in Haringey is looking for a versatile and dedicated Science Teacher, with a specific focus on Biology. This permanent position involves delivering a modern and aca…
Building Surveyor
Building Surveyor, Eltham Salary: £50,000-£60,000 Join our Eltham, London team as a Building Surveyor with Project Team Leadership responsibility. You will have the opportunity to work on dive…
Key Account Manager - Cross Border Property Management
Role Overview We are looking for a commercially minded Key Account Manager to lead relationships with some of Savills' most important cross-border property management clients across Europe. Thi…
Computing Teacher - Collaborative and Inclusive School -...
Computing Teacher – Collaborative, inclusive and progressive comprehensive school – Hackney Our client requires a Computing Teacher to join an innovative and collaborative secondary school in Hackn…