Home
Jobs
United States
California
LLM Serving

LLM Serving Jobs in California, United States

Browse 22 LLM Serving jobs in California, United States on Inference Jobs.

22 jobs

3 wk. ago

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)

LLM Engineering

Machine Learning Engineering

LLM Inference

Distributed Serving

3 wk. ago

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175–280K Yearly

Machine Learning Engineer

AI Engineer

PyTorch

vLLM

3 days ago Scale logo

AI Infrastructure Engineer, Model Serving Platform

Scale

San Francisco, California, United States (On-site)$216–270K Yearly

ML Infrastructure

Machine Learning Engineer

Python

2 days ago NVIDIA logo

Senior Product Manager – AI Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$208–327.8K Yearly

Senior Product Manager

AI Inference Product Management

Inference Optimization

TensorRT-LLM

3 wk. ago

Product Manager, Strategic Verticals

Cerebras

Sunnyvale, California, United States (Hybrid)

Product Management

Technical Product Management

Product Management

LLMs

2 wk. ago

Senior Machine Learning Engineer, Voice AI

Together AI

San Francisco, California, United States (On-site)$200–260K Yearly

Machine Learning Engineer

AI Engineer

Machine Learning

Python

4 wk. ago

Staff Machine Learning Engineer, Voice AI

Together AI

San Francisco, California, United States (On-site)$220–280K Yearly

Machine Learning Engineering

Voice AI Engineering

TensorRT-LLM

SGLang

3 days ago Anthropic logo

Staff + Sr. Software Engineer, Cloud Inference Launch Engineering

Anthropic

San Francisco, California, United States (Hybrid)$320–485K Yearly

Software Engineering - Infrastructure

Cloud Infrastructure Engineering

AWS

GCP

2 wk. ago

Engineering Manager, Search

Anthropic

San Francisco, California, United States (Hybrid)$320–405K Yearly

Engineering Management

Search Engineering

Search Systems

Indexing

4 wk. ago

Senior Engineering Manager, Model Infrastructure

Harvey

San Francisco, California, United States (Hybrid)$272–355K Yearly

Engineering Management

AI Infrastructure Engineering

AI Infrastructure

Machine Learning Platforms

4 wk. ago

Performance Engineer, Inference Systems

Anthropic

San Francisco, California, United States (Hybrid)$350–850K Yearly

Performance Engineering

Inference Systems

Python

SQL

7 days ago NVIDIA logo

Senior Performance Architect, Nemotron

NVIDIA

Santa Clara, California, United States (On-site)$152–287.5K Yearly

Performance Architecture

AI Systems Engineering

Python

C++

3 days ago Anthropic logo

Software Engineer, AI Reliability

Anthropic

San Francisco, California, United States (Hybrid)$325–485K Yearly

Site Reliability Engineering

Software Engineering - Infrastructure

Distributed Systems

Site Reliability Engineering (SRE)

2 days ago SambaNova logo

Senior Software Engineer, ML Infrastructure

SambaNova

United States (Remote)$200–275K Yearly

2 days ago NVIDIA logo

Senior Manager, Software Engineering - NIM Factory

NVIDIA

United States (Remote)$272–431.3K Yearly

Senior Engineering Manager

Software Engineering Management

Python

Kubernetes

2 wk. ago

Senior Technical Product Manager - Serverless AI

Nebius

Europe + 1 more (Remote)

Technical Product Management

AI Cloud Infrastructure

Docker

Container Runtimes

3 wk. ago

Software Engineer - Model API's

Baseten

San Francisco, California, US or Remote (Worldwide)$180–360K Yearly

6 days ago NVIDIA logo

Distinguished Engineer, Scaled Out Inferencing

NVIDIA

Worldwide (Remote)$320–488.8K Yearly

Distinguished Engineer

AI Infrastructure Engineering

GPU Architecture

CUDA

2 days ago NVIDIA logo

Developer Relations Manager, AI Platform and Tools - MLOps

NVIDIA

United States (Remote)$152–287.5K Yearly

Developer Relations

MLOps

TensorRT-LLM

4 wk. ago

Developer Relations Manager – AI Natives

NVIDIA

United States (Remote)$152–287.5K Yearly

Jobs on Inference Jobs

Browse jobs on Inference Jobs.

JobsAI-ranked

Inference Jobs

Discover the latest AI roles from Inference Jobs.

Powered byCavuno

For Candidates

Jobs
Companies

For Companies

Post a job
Pricing

Resources

Locations
Salaries
Sitemap

About

About