Lead Data Engineer

Lead Data Engineer

London Hybrid, 1 day per week in the London Liverpool Street Office

We are looking for a Lead Data Engineer to lead our Data Platform team, who builds our data pipelines, looks after our data quality and manages the data warehouse that houses the data at the core of our products at FXC Intelligence.

If successful, you will:

• Take responsibility for the quality of the code and architecture delivered by your team

• Influence, coach and line manage the Data Platform team engineers

• Align your team on goals, outcomes and timelines

• Collaborate with product and tech to translate our strategic roadmap into actionable tasks; provide visibility on delivery progress outside your team

• Design, develop, test, maintain and enhance our datasets and pipelines

• Improve the performance and observability of our datasets and pipelines

• Improve the quality of life of your team and the business, through automation, process improvement or new technologies

About the team:

• You will join a technical team of c. 40 technologists with a key purpose of continuously and reliably collecting large amounts of financial data describing cross-border payments, then processing the data, checking the quality and serving it to our users so that they can make the best business decisions

• The Data Platform team consists of three Data Engineers, varying in seniority. You will be responsible for the line management of some of them, potentially taking on more as you get more familiar with the company

• We have four more technical delivery teams, and as the data platform is the centre of all data flows, you will regularly interact with other team leads and product owners

• You will also have a lot of interaction with our fantastic Data Analysts and Technical Business Analysts

You should apply if you can confidently:

• Line manage a team, coaching them to reach your level of expertise

• Write complex SQL, use DBT, Airflow (or other task orchestration tools), and Kafka

• Understand database management and data modelling

• Build, maintain, and document data quality and cataloguing solutions

• Learn and engage with a new business domain and product

• Communicate complex topics to technical and non-technical people

• Talk about how you learn and improve your skills

These skills will help, but aren’t essential:

• Prior experience working for a data product company or working with large datasets

• Involvement in Terraform, web scraping and/or backend development

• Experience collaborating with a BI, DA and/or ML team

• Experience utilising AI to increase team productivity, efficiency and data quality

Tech Stack:

• ClickHouse, Airflow, DBT, Python, PostgreSQL, MySQL, MongoDB, DataHub, AirByte, SageMaker

AI Usage Disclaimer:

At FXC Intelligence, we are enthusiastic about the use of AI tools and value candidates with experience or interest in AI technologies. However, we kindly ask that candidates refrain from using AI tools during interviews or for technical tasks unless explicitly instructed by us. This is because we want to understand your thought process and approach to tasks. If the use of AI assistance is detected in tasks or interviews where it was not permitted, the submission may be discounted.

About us:

FXC Intelligence is a leading provider of cross-border payments data and intelligence, providing some of the world's biggest companies, central banks and non-governmental organisations with the strategic insights, expertise and awareness to effectively compete in their chosen markets. By joining us, you will be diving into a world of data-driven exploration and innovation, revolutionising financial insights through cutting-edge technologies, machine learning and predictive analytics.

Your contributions will shape the future of cross-border finance, helping clients to uncover better paths to growth and profitability, as well as being a trusted reference and source for many of the leading international publications.

We are proud to produce industry-changing data and intelligence, aided by our company values of being customer-focused, taking ownership, knowledge, communication and leadership.

We’re an innovative company that strives to look after its team, and we take pride in providing a positive company culture. Feel free to check out our blog , Instagram and Glassdoor pages to learn more about our culture and hear directly from our team about what it's really like to work with us!

What’s in it for you?

• 25 days holiday per annum (plus bank holidays), increasing to 26 days after 2 years of service

• Healthcare for you and your family with AXA

• Annual bonus/option scheme

• Pension scheme

• Enhanced maternity and paternity policy

• After four years of employment, you are entitled to a 6-week paid sabbatical

• After one year of employment, you can work abroad for up to three months of the year, with approval from your manager

• Quarterly external one-to-one coaching sessions

• £1,000 annual learning budget for courses, books and conferences

• Annual salary reviews with your manager

• A chance to work with a vibrant, friendly team in a relaxed but committed culture

• Monthly London-based socials paid for by the company, from mini golf to cooking challenges to escape rooms!

• We operate in a hybrid working environment, expecting you to work in the London office once a week for collaboration with the team

• The opportunity to join our LGBTQIA+ and Women in Fintech employee networks

• In our last engagement survey, 95% of employees felt that "People from all backgrounds are being treated fairly”

At FXC Intelligence, we believe in embracing diversity in all forms and fostering an inclusive environment. All applicants will be considered for employment without attention to ethnicity, religion, sexual orientation, gender identity, family or parental status, national origin, veteran status, neurodiversity status or disability status.