Machine Learning - Model Serving Job at Alexander Chapman, San Francisco, CA

WXBqOWVpaFI1a2pqZ3I1MUJmaDl2QTNtNUE9PQ==
  • Alexander Chapman
  • San Francisco, CA

Job Description

Base pay range $230,000.00/yr - $350,000.00/yr The Role Youll help optimize and scale the inference stack, working across model serving, performance tuning, and deployment to support real-time, multimodal AI. What Youll Do Improve serving systems for LLMs, speech, and vision models. Optimize throughput, latency, and cost using advanced techniques like batching, caching, and kernel tuning. Extend frameworks like VLLM or SGLang to push the limits of performance. Collaborate with training teams to deploy faster, lighter models. Experiment with compilers and hardware backends to boost efficiency. What Were Looking For Strong experience with PyTorch or similar ML frameworks. Deep knowledge of model serving and systems performance. Skilled in low-level debugging, bottleneck analysis, and server optimization. Familiar with VLLM, Ray, or deploying inference workloads at scale. Comfortable owning complex infrastructure projects end to end. Background in computer science or related field from a top-tier university (e.g. Stanford, MIT, Ivy League). Experience at a top tech company (e.g. FAANG) or a successful, high-growth startup. Theyre looking for curious, impact-driven engineers ready to push whats possible with real-time AI. Seniority level Mid-Senior level Employment type Full-time Job function Software Development Industries Software Development #J-18808-Ljbffr Alexander Chapman

Job Tags

Full time,

Similar Jobs

Charlotte Animal Referral & Emergency

Oncology Veterinary Technician- RVT/ Vet Tech/ Experienced Vet Assistant Job at Charlotte Animal Referral & Emergency

We are a privately owned 24-hour Emergency and Specialty Referral Hospital in Charlotte NC that offers its employees a fun, supportive work environment, terrific benefits, and opportunities for growth! CARE | Charlotte Animal Referral & Emergency is seeking talented ...

GHR Healthcare - Travel Division

Per Diem / PRN Nurse RN - ED - Emergency Department Job at GHR Healthcare - Travel Division

 ...Description GHR Healthcare - Travel Division is seeking a per diem / prn nurse RN ED - Emergency Department for a per diem / prn nursing job in...  ...license; 2+ years relevant experience; BLS; ACLS; every other weekend / Contact (***) ***-**** to apply About GHR Healthcare -... 

HDR

Structural EIT/Inspector Job at HDR

 ...Join to apply for the Structural EIT/Inspector role at HDR . At HDR, our employee-owners are fully engaged in creating a welcoming environment where each of us is valued and respected. We foster diversity, equity, and inclusion, and encourage everyone to bring their... 

Wyoming Staffing

General Construction Laborer Job at Wyoming Staffing

 ...divh2Concrete Finishers/Laborers And Construction Framers/Laborers/h2pLooking for experienced concrete finishers/laborers and experienced construction framers/laborers. Perform tasks involving physical labor at construction sites. May operate hand and power tools of all...