Senior Data Engineer - Azure

About UBDS

UBDS Group empowers organizations to achieve remarkable digital transformations through innovative technology solutions We work with clients across the public and private sector to design and build products, platforms and services that genuinely make a difference to users.

We’re looking for a Senior Data Engineer who combines deep technical capability with a strong consulting mindset. Someone who enjoys ambiguity, cares about users, and can turn messy business problems into robust, production-grade data solutions.

The Role

As a Senior Data Engineer at UBDS, you’ll work closely with clients, designers, analysts and engineers to shape and deliver modern data solutions end to end. You’ll be trusted to lead technical thinking, make pragmatic design decisions, and support teams in delivering high‑quality outcomes that stand up in the real world.

This is a hands-on role with influence: you’ll be building, guiding others, and helping clients understand what good looks like.

What You’ll Do

• Turn ambiguous business problems into clear data, analytical and technical solutions.
• Design, build and operate production-grade data pipelines, models and products using SQL, Python and modern data engineering frameworks.
• Architect and work across data warehouses, lakehouse and event-driven patterns, including strong semantic models for analytics and visualisation.
• Deliver solutions on cloud data and AI platforms (AWS/Azure), applying solid software engineering, testing and CI/CD practices.
• Embed analytics, experimentation, AI/ML integration, governance, security and data quality best practices by default.
• Create clear data visualisations, narratives and consultant-grade materials that help clients understand and act on insight.
• Work closely with users and stakeholders in Agile, client-driven environments, learning from live services and real-world feedback.
• Apply strong critical thinking, attention to detail and relevant industry and government standards to deliver solutions that are easy to hand over, maintain and evolve.

What We’re Looking For

Core Data & Technical Skills

• Ability to translate ambiguous business problems into clear data, analytical and technical requirements.
• Strong SQL and Python skills for data modelling, transformation, automation and analysis.
• Experience designing data models and architectures across data warehouses, lakehouse and event-driven patterns, or strong semantic modelling in Power BI or other visualisation tools.
• Hands-on experience with modern data engineering frameworks such as Spark / PySpark, Pandas and orchestration tools.
• Experience working with cloud data and AI platforms on AWS or Azure (e.g. Databricks, Redshift, Bedrock, Microsoft Fabric).
• Solid software engineering fundamentals, including Git, testing and QA, CI/CD pipelines and modular, maintainable design.
• Strong analytics and statistical reasoning, including metric design, experimentation and interpretation of results.
• Practical AI/ML literacy, including integrating model APIs, evaluation approaches and prompt orchestration.
• Experience applying data governance, security and quality best practices, such as access control, data catalogues, lineage and GDPR awareness.
• Ability to communicate insight through data visualisation and storytelling using tools like Power BI, Tableau or Python-based charts.

Consulting & Delivery Mindset

• A user-centred approach: curiosity about who will use the solution, why it matters, and the impact it will have.
• Confidence communicating clearly and working effectively in ambiguous, client-driven environments.
• Ability to produce high-quality, consultant-grade slides and written materials.
• Strong critical thinking, with a clear and logical approach to defining and delivering data solutions.
• Proven experience delivering production-grade solutions to real users, supporting live services and learning from real-world feedback.
• High attention to detail, including readable code, consistent naming conventions and clear technical and user documentation.
• A product-driven mindset, with experience delivering features and outcomes iteratively in Agile teams.
• Familiarity with relevant industry and government standards, and a habit of seeking out appropriate standards at the start of delivery rather than reinventing solutions.

Benefits

Why people choose to grow their careers at UBDS Group

Professionals choose to grow their careers at UBDS Group for its reputation as a dynamic and forward-thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting-edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth. The Group’s culture emphasises continuous improvement, offering ample training programs, mentorship, and the chance to gain certifications that enhance their skills and marketability.

UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.

Employee Benefits

• Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
• Private medical cover for you and your spouse/partner, offered via Vitality
• Discretionary bonus based on a blend of personal and company performance
• Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
• Electric Vehicle leasing with salary sacrifice
• Contributed Pension Scheme
• Death in service cover

About UBDS Group

At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.

Equal Opportunities

We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.