Backend Software Engineer - Search, Crawler Team (London, Belgrade, Berlin)
- Take ownership of and lead projects focused on developing large-scale web crawlers, ingestion pipelines, and data processing systems.
- Build, maintain, and optimize core backend and frontend components for crawler services, including storage, retrieval, and UI dashboards for data management.
- Collaborate closely with Search and Infrastructure teams to ensure the reliable, high-quality ingestion and processing of billions of web pages.
- Architect and implement fullstack features and scalable distributed systems that handle high-load and real-time data operations.
- Rapidly iterate, experiment with novel approaches, and continuously enhance system performance, usability, and reliability.
- Minimum of 5 years of software development experience, with strong knowledge of data structures and algorithms in at least one of the following languages: Python, C++, Rust, or Go.
- Experience with large-scale web crawlers is highly desirable.
- Proven experience building, deploying, and optimizing high-load, distributed, and hardware-adjacent services.
- Deep understanding of cloud infrastructure, with hands-on experience in Kubernetes (K8s) and AWS.
- Demonstrated passion for writing clean, efficient, and scalable systems.
Recommended Jobs
Human Resources Business Partner - FTC
43719 Really exciting FTC for a well respected, boutique Financial Services firm. Are you passionate about developing a people strategy that truly drives business success? My client is seek…
MFL Teacher (ECT Support) - Harrow Outstanding School
School Status & Location Sector: Outstanding Ofsted Secondary School (with Sixth Form). Borough: Harrow (Outer London, England). Start Date: Permanent, full-time role commencing January 2026…
Receptionist
Welcome and assist visitors in a professional and friendly manner. Manage incoming calls and direct them to the appropriate departments. Maintain the reception area to ensure a clean and organi…
Senior Apparel Designer - Trail & Extrem (Berghaus)
We’re Pentland Brands; a dynamic, global family business, and proud owners and licensees of many iconic active and footwear brands. With a community of over 1,300 team members worldwide, we embrace d…
Administrator
Job Category: Admin & Clerical Job location: 255 – 259 High Road, Ilford, Greater London, IG1 1NN, Redbridge Council Hours per week: 36 Start date: Immediate start Salary: £15.63 per hour …
Year 5 Teacher | Lambeth | Independent School
Are you an ambitious Year 5 Teacher who thrives on curriculum leadership and high standards? A distinguished Independent School in Lambeth seeks a Year 5 Teacher to start in January 2026. The Year 5 …
Live-in Nanny role, Job ID J1DC85
A lovely family based in Alderley Edge, Cheshire, is seeking a Live-in Nanny to care for their baby on a permanent basis. This is a blended role that includes both overnight monitoring and daytime su…
Account Executive
Support the development and delivery of a business growth strategy for a membership programme. Research and identify prospective member organisations and initiate outreach. Deliver compelling p…
Marine Hull Broker
Marine Hull Broker An exciting opportunity for an experienced Marine Hull Broker to join a boutique, fast-growing Lloyd’s Broker in London. You’ll handle Marine Hull risks across the Lloyd’s an…