Data Engineer - Contingent
- Establishing and building processes based on business and technical requirements to channel data from multiple inputs and store using any combination of distributed (cloud) structures, local databases or other applicable storage forms
- Develop and own technical tools leveraging big-data to cleanse, organise and transform data to maintain data structures and integrity on an automated basis in real time
- Develop solutions that are functional, reliable, maintainable, scalable and extensible
- Resolving complex issues that may impact multiple business areas
- Maintaining relationships with internal and external stakeholders
- Collaborating with Data Engineers, Software Engineers, and Data Scientists both within the team and across the business
- Writing clear and relevant documentation
- Expert level (5+ years' experience) Python, including data manipulation packages
- Expert level (5+ years' experience) SQL
- Object Oriented Programming (OOP)
- Familiar with Airflow
- Familiar with the Software Development Lifecycle
- Creative problem-solving
- Meticulous attention to detail
- Comfortable with working independently and taking ownership
- Willingness to work outside of area of expertise
- Data processing frameworks (e.g. Spark, Hadoop, Kafka, FluentBit, RabbitMQ)
- Data warehousing solutions (e.g. PostgreSQL, BigQuery)
- Cloud Platforms (e.g. Google Cloud Platform, AWS)
- CI/CD tools (e.g. GitHub Actions, Jenkins)
- Containerization solutions (e.g. Docker and Kubernetes)
- Version control systems (e.g. Git)
- Package managers (e.g. Poetry)
- Jinja2 SQL templating
- Linux scripting
- Agile change management processes
- Comfortable with coaching members in the team
- A passion for developing creative solutions to real user needs and business problems
- Experience in aviation connectivity
- Experience in telecommunications industry
Recommended Jobs
Passionate Year 3 Teacher | Thriving Primary School in Brent
We are seeking a dedicated and enthusiastic Year 3 Teacher to join a welcoming and inclusive primary school in Brent . This full-time, permanent role offers the opportunity to deliver high-qualit…
Exams Officer
Job Title: Exams Officer Location: Romford Start Date: Imme…
Policy Manager
Policy Manager London Responsibilities: Design and implement advocacy strategies targeting UK regulators, politicians, and media to accelerate decarbonization. Commission and deliver evid…
Void Surveyor
Job Title: Void Surveyor Location: South East London Contract Type: Temporary - Ongoing Pay Rate: £27 - £32 per hour Sector: Social Housing Start Date: ASAP Job Description: …
Outreach Worker
Job Title: Outreach Worker Location : Forward Drive, Harrow, HA3 8NT (London Borough of Harrow) Employer : Pertemps Recruitment Partnership on behalf of the London Borough of Harrow Type …
Chef de Partie - Tobi Masa
Press space or enter keys to toggle section visibility The Chancery Rosewood, a Rosewood Hotel Group property, is housed in the iconic former U.S. Embassy on Grosvenor Square, reimagined…
KS2 Teacher - Outstanding School - Teddington - January...
Overview An Outstanding primary in Teddington seeks an ambitious KS2 Teacher for a Full-Time KS2 Teacher position commencing January 2026 . The school values evidence-based practice, pupil…
Qualified Nursery Nurses
Salary: £23,000 to £27,000+ We have a number of nurseries in and around the West London area that are looking for experienced, caring and motivated Nursery Nurses to join their team. The successf…
Afternoon Nanny, Job ID J1E222
This lovely family in Hampton, London, is looking for an afternoon nanny to care for their toddler. The role involves all general nanny duties. A confident driver is required, and a valid first aid q…