Home
Jobs
United States
California
LLM Inference

LLM Inference Jobs in California, United States

Browse 94 LLM Inference jobs in California, United States on Inference Jobs.

94 jobs

3 wk. ago

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)

LLM Engineering

Machine Learning Engineering

LLM Inference

Distributed Serving

5 days ago NVIDIA logo

Senior Deep Learning Architect, LLM Inference

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

Deep Learning Architecture

LLM Inference Engineering

Deep Learning

LLM Inference

3 wk. ago

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

Machine Learning Engineering

LLM Inference Optimization

Python

PyTorch

3 wk. ago

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

2 wk. ago

Member of Technical Staff - RL Inference

xAI

Palo Alto, California, United States (On-site)

RL Inference Engineering

ML Infrastructure Engineering

Python

C++

6 days ago NVIDIA logo

Engineering Manager, LLM Performance

NVIDIA

Santa Clara, California, United States (On-site)$224–431.3K Yearly

Engineering Manager

LLM Performance Engineering

TensorRT-LLM

vLLM

4 wk. ago

Manager, Large Language Model Inference

NVIDIA

Santa Clara, California, United States (Hybrid)$184–356.5K Yearly

Engineering Management

AI Engineering

C++

Python

6 days ago NVIDIA logo

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124–241.5K Yearly

AI Engineering

Machine Learning Infrastructure

TensorRT-LLM

SGLang

4 wk. ago

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160–230K Yearly

Machine Learning Engineer

AI Research Engineer

TensorRT-LLM

vLLM

1 day ago

Senior Product Manager – AI Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$208–327.8K Yearly

Senior Product Manager

AI Inference Product Management

Inference Optimization

TensorRT-LLM

5 days ago NVIDIA logo

Senior DL Algorithms Engineer - Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$152–287.5K Yearly

Deep Learning Engineer

Algorithms Engineer

Deep Learning

Inference

3 wk. ago

Senior Performance Engineer, Inference

Cerebras

Sunnyvale, California, United States (On-site)

Performance Engineering

ML Infrastructure Engineering

vLLM

SGLang

3 wk. ago

Compiler Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$152–241.5K Yearly

Compiler Engineering

AI Infrastructure

Compiler Optimizations

MLIR

6 days ago NVIDIA logo

Senior System Software Engineer - Dynamo-Triton Inference Server

NVIDIA

Santa Clara, California, United States (On-site)$184–287.5K Yearly

Software Engineering

Machine Learning Engineering

Rust

C++

3 wk. ago

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$220–485K Yearly

AI Engineering

Machine Learning Engineer

Rust

Python

4 wk. ago

Principal Software Engineer – Large-Scale LLM Memory and Storage Systems

NVIDIA

Santa Clara, California, United States (On-site)$272–431.3K Yearly

Principal Software Engineer

LLM Infrastructure Engineer

Rust

Python

6 days ago NVIDIA logo

Solutions Architect, Inference Deployments

NVIDIA

Santa Clara, California, United States (On-site)$152–241.5K Yearly

Solutions Architecture

Generative AI

Kubernetes

TensorRT-LLM

3 wk. ago

Senior Solutions Architect, GPU Performance and LLM - Cloud Service Providers

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

Solutions Architecture

GPU Performance Engineering

AI/ML

HPC

2 wk. ago

Staff Software Engineer, Inference

CoreWeave

Sunnyvale, California, United States (Hybrid)$188–275K Yearly

Staff Software Engineer

Inference Engineering

Python

3 wk. ago

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$295–555K Yearly

Software Engineer

Inference Engineer

Inference Infrastructure

Multimodal Models

Jobs on Inference Jobs

Browse jobs on Inference Jobs.

JobsAI-ranked

Inference Jobs

Discover the latest AI roles from Inference Jobs.

Powered byCavuno

For Candidates

Jobs
Companies

For Companies

Post a job
Pricing

Resources

Locations
Salaries
Sitemap

About

About