ML Ops Engineer
- Leverage best practices in schema design, partitioning, and optimisation for efficient storage and retrieval.
- Build and maintain data models to support analytics and machine learning workflows.
- Design and implement scalable, secure, and high-performance data lake and data warehouse solutions.
- Develop, monitor, and optimize ETL/ELT workflows using Apache Airflow.
- Ensure data pipelines are robust, error-tolerant, and scalable for real-time and batch processing.
- Develop and maintain scalable web scraping solutions to collect data from diverse sources, including APIs, websites, and other unstructured data sources.
- Extract, clean, and transform unstructured data such as text, images, and log files into structured formats suitable for analysis.
- Use tools and frameworks like BeautifulSoup, Scrapy, or Selenium for web scraping, and natural language processing (NLP) techniques for text processing.
- Design and implement cloud-native data solutions with Microsoft Azure.
- Optimize costs and performance of cloud-based data solutions.
- Use Terraform to automate the provisioning and management of cloud infrastructure.
- Define reusable and modular Terraform configurations to support scalable deployment of resources.
- Collaborate with data scientists and machine learning engineers to operationalise machine learning models.
- Implement CI/CD pipelines for machine learning workflows, ensuring efficient model deployment and monitoring.
- Utilize Kubernetes and containerisation technologies (e.g., Docker) to deploy scalable, fault-tolerant data processing systems.
- Manage infrastructure and resource allocation for containerised data applications.
- Work closely with stakeholders, including data scientists, software engineers, and business analysts, to align technical solutions with business needs.
- Mentor junior engineers and foster a culture of continuous learning within the team.
- Bachelor's/Master's/PhD degree in Computer Science, Engineering, or a related field; or equivalent professional experience.
- 5+ years of experience in data engineering or a related field.
- Strong expertise in data pipeline orchestration tools such as Apache Airflow .
- Proven track record of designing and implementing data lakes and warehouses (experience with Azure is a plus).
- Demonstrated experience with Terraform for infrastructure provisioning and management.
- Solid understanding of MLOps practices, including model training, deployment, and monitoring.
- Hands-on experience with Kubernetes and containerised environments.
- Proficiency in programming languages such as Python & SQL.
- Experience with distributed computing frameworks such as Spark.
- Familiarity with version control systems (e.g., Git) and CI/CD pipelines.
- Strong problem-solving skills and the ability to work in a fast-paced, collaborative environment.
- Excellent communication and documentation skills.
- Strong analytical mindset with attention to detail.
Recommended Jobs
Nanny-Housekeeper from Monday to Friday, Job ID J1E1DD
A wonderful family in Highbury, London, is seeking a full-time English-speaking Nanny-Housekeeper to help manage their home and support them in welcoming their newborn, due at the end of the year. Ne…
Senior Venue Business Development Manager
Overview Senior Business Development Manager | Up to OTE £50k–£55k pa | Uncapped commission | Permanent | Hybrid/London | Medical cash plans, enhanced pension contributions + more great benefits! …
Lead Nurse - Substance Misuse Service
JOB-20241107-af0545f3 Job Vacancy: Lead Nurse - Substance Misuse Service Location: Camberwell Type: Permanent Salary: £43,814.50 - £48,183.48 per annum dependant on experience Sanctuary Pers…
Geography Teacher - Fieldwork & Rigour - Ealing
Geography Teacher – Lead Practical Fieldwork and Drive Academic Rigour in West London – Ealing A large, community-oriented secondary school in Ealing is recruiting a Geography Teacher with a …
Au Pair
?????? ???? ????. ????????? ????, ??? ????????? ???????? (30 - 45 ???) ? ?????, ??????? ?? ????????? ???? ????? ????? ???? ? 4-?? ??????? (3, 5, 6, 7 ???). ?? ??????? ?????? ?????????, ? ???????????. …
KS1 Primary Teacher
Primary Teacher - Tower Hamlets, London Are you an ECT or experienced Primary Teacher looking for your next opportunity? If so, get in touch with Ethos Education! We are looking for Primary Teach…
Teaching Assistant
Advert 1 - SEN Teaching Assistant (ASD Unit) - Vauxhall A welcoming Primary School near Vauxhall is looking for a dedicated SEN Teaching Assistant to join their specialist ASD provision on an ASAP st…
ESPN Digital Production and Social Content Placement
ESPN Digital Production and Social Content Placement Are you an undergraduate looking for a rewarding and exciting placement year with ESPN? As an ESPN Intern, you will be fully integrated into …