Home
Jobs
United States
California
LLM Inference Engineering

LLM Inference Engineering Jobs in California, United States

Browse 76 LLM Inference Engineering jobs in California, United States on Inference Jobs.

76 jobs

3 wk. ago

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)

LLM Engineering

Machine Learning Engineering

LLM Inference

Distributed Serving

4 wk. ago

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

Machine Learning Engineering

LLM Inference Optimization

Python

PyTorch

5 days ago NVIDIA logo

Senior Deep Learning Architect, LLM Inference

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

Deep Learning Architecture

LLM Inference Engineering

Deep Learning

LLM Inference

4 wk. ago

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

2 wk. ago

Member of Technical Staff - RL Inference

xAI

Palo Alto, California, United States (On-site)

RL Inference Engineering

ML Infrastructure Engineering

Python

C++

6 days ago NVIDIA logo

Engineering Manager, LLM Performance

NVIDIA

Santa Clara, California, United States (On-site)$224–431.3K Yearly

Engineering Manager

LLM Performance Engineering

TensorRT-LLM

vLLM

6 days ago NVIDIA logo

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124–241.5K Yearly

AI Engineering

Machine Learning Infrastructure

TensorRT-LLM

SGLang

4 wk. ago

Manager, Large Language Model Inference

NVIDIA

Santa Clara, California, United States (Hybrid)$184–356.5K Yearly

Engineering Management

AI Engineering

C++

Python

3 wk. ago

Senior Performance Engineer, Inference

Cerebras

Sunnyvale, California, United States (On-site)

Performance Engineering

ML Infrastructure Engineering

vLLM

SGLang

3 wk. ago

Compiler Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$152–241.5K Yearly

Compiler Engineering

AI Infrastructure

Compiler Optimizations

MLIR

4 wk. ago

Performance Engineer, Inference Systems

Anthropic

San Francisco, California, United States (Hybrid)$350–850K Yearly

Performance Engineering

Inference Systems

Python

SQL

6 days ago NVIDIA logo

Senior System Software Engineer - Dynamo-Triton Inference Server

NVIDIA

Santa Clara, California, United States (On-site)$184–287.5K Yearly

Software Engineering

Machine Learning Engineering

Rust

C++

3 wk. ago

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$220–485K Yearly

AI Engineering

Machine Learning Engineer

Rust

Python

4 wk. ago

Principal Software Engineer – Large-Scale LLM Memory and Storage Systems

NVIDIA

Santa Clara, California, United States (On-site)$272–431.3K Yearly

Principal Software Engineer

LLM Infrastructure Engineer

Rust

Python

2 wk. ago

Staff Software Engineer, Inference

CoreWeave

Sunnyvale, California, United States (Hybrid)$188–275K Yearly

Staff Software Engineer

Inference Engineering

Python

3 wk. ago

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$295–555K Yearly

Software Engineer

Inference Engineer

Inference Infrastructure

Multimodal Models

2 days ago CoreWeave logo

Software Engineer, Inference AI/ML

CoreWeave

Sunnyvale, California, United States (Hybrid)$92–135K Yearly

Software Engineering

Machine Learning Engineering

Python

6 days ago NVIDIA logo

Solutions Architect, Inference Deployments

NVIDIA

Santa Clara, California, United States (On-site)$152–241.5K Yearly

Solutions Architecture

Generative AI

Kubernetes

TensorRT-LLM

3 wk. ago

Senior Solutions Architect, GPU Performance and LLM - Cloud Service Providers

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

Solutions Architecture

GPU Performance Engineering

AI/ML

HPC

2 wk. ago

Research Engineer, Post-Training Inference

Together AI

San Francisco, California, United States (On-site)$200–290K Yearly

Research Engineering

ML Infrastructure Engineering

Python

Jobs on Inference Jobs

Browse jobs on Inference Jobs.

JobsAI-ranked

Inference Jobs

Discover the latest AI roles from Inference Jobs.

Powered byCavuno

For Candidates

Jobs
Companies

For Companies

Post a job
Pricing

Resources

Locations
Salaries
Sitemap

About

About