Home
Jobs
United States
California
San Francisco
LLM Serving

LLM Serving Jobs in San Francisco, California, United States

Browse 18 LLM Serving jobs in San Francisco, California, United States on Inference Jobs.

18 jobs

3 wk. ago

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175–280K Yearly

Machine Learning Engineer

AI Engineer

PyTorch

vLLM

3 days ago Scale logo

AI Infrastructure Engineer, Model Serving Platform

Scale

San Francisco, California, United States (On-site)$216–270K Yearly

ML Infrastructure

Machine Learning Engineer

Python

3 wk. ago

Senior Machine Learning Engineer, Voice AI

Together AI

San Francisco, California, United States (On-site)$200–260K Yearly

Machine Learning Engineer

AI Engineer

Machine Learning

Python

4 wk. ago

Staff Machine Learning Engineer, Voice AI

Together AI

San Francisco, California, United States (On-site)$220–280K Yearly

Machine Learning Engineering

Voice AI Engineering

TensorRT-LLM

SGLang

4 days ago Anthropic logo

Staff + Sr. Software Engineer, Cloud Inference Launch Engineering

Anthropic

San Francisco, California, United States (Hybrid)$320–485K Yearly

Software Engineering - Infrastructure

Cloud Infrastructure Engineering

AWS

GCP

2 wk. ago

Engineering Manager, Search

Anthropic

San Francisco, California, United States (Hybrid)$320–405K Yearly

Engineering Management

Search Engineering

Search Systems

Indexing

4 wk. ago

Senior Engineering Manager, Model Infrastructure

Harvey

San Francisco, California, United States (Hybrid)$272–355K Yearly

Engineering Management

AI Infrastructure Engineering

AI Infrastructure

Machine Learning Platforms

4 wk. ago

Performance Engineer, Inference Systems

Anthropic

San Francisco, California, United States (Hybrid)$350–850K Yearly

Performance Engineering

Inference Systems

Python

SQL

3 days ago Anthropic logo

Software Engineer, AI Reliability

Anthropic

San Francisco, California, United States (Hybrid)$325–485K Yearly

Site Reliability Engineering

Software Engineering - Infrastructure

Distributed Systems

Site Reliability Engineering (SRE)

3 days ago SambaNova logo

Senior Software Engineer, ML Infrastructure

SambaNova

United States (Remote)$200–275K Yearly

3 days ago NVIDIA logo

Senior Manager, Software Engineering - NIM Factory

NVIDIA

United States (Remote)$272–431.3K Yearly

Senior Engineering Manager

Software Engineering Management

Python

Kubernetes

2 wk. ago

Senior Technical Product Manager - Serverless AI

Nebius

Europe + 1 more (Remote)

Technical Product Management

AI Cloud Infrastructure

Docker

Container Runtimes

3 wk. ago

Software Engineer - Model API's

Baseten

San Francisco, California, US or Remote (Worldwide)$180–360K Yearly

6 days ago NVIDIA logo

Distinguished Engineer, Scaled Out Inferencing

NVIDIA

Worldwide (Remote)$320–488.8K Yearly

Distinguished Engineer

AI Infrastructure Engineering

GPU Architecture

CUDA

3 days ago NVIDIA logo

Developer Relations Manager, AI Platform and Tools - MLOps

NVIDIA

United States (Remote)$152–287.5K Yearly

Developer Relations

MLOps

TensorRT-LLM

4 wk. ago

Developer Relations Manager – AI Natives

NVIDIA

United States (Remote)$152–287.5K Yearly

3 wk. ago

Developer Relations Manager, Higher Education and Research - Foundational AI

NVIDIA

United States (Remote)$152–287.5K Yearly

Developer Relations Manager

AI Technical Evangelist

PyTorch

JAX

7 days ago NVIDIA logo

Developer Relations Manager, Higher Education and Research - AI Agents

NVIDIA

Santa Clara, California, US or Remote (United States)$152–287.5K Yearly

Developer Relations

AI/ML Engineering

Large Language Models

PyTorch

Jobs on Inference Jobs

Browse jobs on Inference Jobs.

JobsAI-ranked

Inference Jobs

Discover the latest AI roles from Inference Jobs.

Powered byCavuno

For Candidates

Jobs
Companies

For Companies

Post a job
Pricing

Resources

Locations
Salaries
Sitemap

About

About