AI Inference Engineer
- Develop APIs for AI inference that will be used by both internal and external customers
- Benchmark and address bottlenecks throughout our inference stack
- Improve the reliability and observability of our systems and respond to system outages
- Explore novel research and implement LLM inference optimizations
- Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
- Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.)
- Experience with deploying reliable, distributed, real-time model serving at scale
- (Optional) Understanding of GPU architectures or experience with GPU kernel programming using CUDA
Our prominent investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Naval Ravikant, Tobi Lutke, and many other visionary individuals. Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above. Equity: In addition to the base salary, equity may be part of the total compensation package. Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.
Recommended Jobs
Financial advisors wanted in Portugal
Due to aggressive and ambitious expansion our client is now accepting job applications from financial advisors to work in Portugal. Our client stands as a beacon of sustainability, recognition, an…
Care Assistant
Job Title: Care Assistant Location: Havering & Romford Shifts: Weekday & Weekend: Morning Shifts: 7am - 2:30pm / Evening Shifts: 4pm - 10pm Contract: Full-Time & Part-Time Salary: £…
Team Leader Care Bank
Pay rate effective from 1st April 2025 Are you a passionate and caring individual looking for a rewarding career with excellent training and opportunities for development? Join Care UK, a multi awa…
HVAC ENGINEER - LONDON
Vacancy No 5378 Vacancy Title HVAC ENGINEER Location: CENTRAL LONDON (INNER M25) PLEASE NOTE: Candidates must be within a comfortable working remotely in the field with minimal supervision, ide…
Graduate SEN Teaching Assistant
Graduate SEN Teaching Assistant – Enfield, North London Immediate Start | Full-Time | Up to £600 per Week Fantastic Opportunity for Psychology or Education Graduates Are you a recent graduat…
Real Estate Analyst 2/3 (Living)
Analyse RE investment opportunities, providing detailed financial modelling and market research. Lead on development reporting, budgeting, and fund-level analysis across a portfolio of Build-to-Re…
Recruitment Specialist
As a result, we are seeking applications from experienced Recruitment Professionals to join our Glasgow operation with a view to helping us expand our footprint within the sector whilst also taking a…
Corporate Finance Valuations
Corporate Finance Valuations London, United Kingdom The Role Our client, a leading global advisory firm, is looking for a Valuations Senior Consultant to lead on engagements through to the…
Commercial, Rights & Business Affairs Manager EXTEND TALENT POOL
PACKAGE DESCRIPTION Band: D Salary between: £50,000 -£70,000 per annum based on knowledge and experience. London Weighting Allowance of £5319 also offered. The expected salary range for this ro…