Jobs on Inference Jobs

3 wk. ago

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180–250K Yearly

Model Inference

Distributed Systems

2 days ago Etched logo

Inference Software Engineer

Etched

Cupertino, California, United States (On-site)

Machine Learning Infrastructure

3 wk. ago

Software Engineer, Model Inference

OpenAI

San Francisco, California, United States (On-site)$295–555K Yearly

3 wk. ago

Compiler Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$152–241.5K Yearly

Compiler Engineering

AI Infrastructure

Compiler Optimizations

MLIR

4 wk. ago

Performance Engineer, Inference Systems

Anthropic

San Francisco, California, United States (Hybrid)$350–850K Yearly

Performance Engineering

Inference Systems

AI/ML Inference Engineering

SQL

3 wk. ago

Staff AI Inference and Acceleration Engineer

Figure

San Jose, California, United States (On-site)$180–275K Yearly

Hardware Acceleration

AI/ML Inference

ONNX

4 wk. ago

Applied AI Inference Engineer

Crusoe

San Francisco, California, United States (On-site)$250–300K Yearly

2 wk. ago

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)

LLM Engineering

ML Infrastructure Engineering

LLM Inference

Distributed Serving

3 wk. ago

Senior Performance Engineer, Inference

Cerebras

Sunnyvale, California, United States (On-site)

Performance Engineering

vLLM

SGLang

5 days ago NVIDIA logo

Senior System Software Engineer - Dynamo-Triton Inference Server

NVIDIA

Santa Clara, California, United States (On-site)$184–287.5K Yearly

Software Engineering

Rust

2 wk. ago

Staff Software Engineer, Inference

CoreWeave

Sunnyvale, California, United States (Hybrid)$188–275K Yearly

Staff Software Engineer

Cloud Infrastructure Engineering

3 wk. ago

Staff Software Engineer, Inference Cloud

Cerebras

Sunnyvale, California, United States (On-site)

Staff Software Engineer

3 wk. ago

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

LLM Inference Optimization

PyTorch

3 wk. ago

Inference Technical Lead, Sora

OpenAI

San Francisco, California, United States (Hybrid)$380K Yearly

Machine Learning Infrastructure

AI Infrastructure

GPU Inference

Model Serving

5 days ago NVIDIA logo

Senior Software Engineer, AI Inference Systems

NVIDIA

Santa Clara, California, United States (Hybrid)$184–356.5K Yearly

3 wk. ago

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$295–555K Yearly

Software Engineer

Inference Engineer

Inference Infrastructure

Multimodal Models

5 days ago NVIDIA logo

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124–241.5K Yearly

AI Engineering

TensorRT-LLM

SGLang

3 wk. ago

Principal SRE - AI Inference

Cerebras

Sunnyvale, California, United States (On-site)

Principal Site Reliability Engineering

AI Infrastructure SRE

Site Reliability Engineering

AI Inference

19 hr. ago CoreWeave logo

Software Engineer, Inference AI/ML

CoreWeave

Sunnyvale, California, United States (Hybrid)$92–135K Yearly

Software Engineering