Jobs on Inference Jobs

Deep Learning Architecture

Distributed Serving

4 days ago NVIDIA logo

Senior Deep Learning Architect, LLM Inference

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

LLM Inference Engineering

Deep Learning

3 wk. ago

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

LLM Inference Optimization

ML Infrastructure Engineering

PyTorch

3 wk. ago

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

2 wk. ago

Member of Technical Staff - RL Inference

xAI

Palo Alto, California, United States (On-site)

RL Inference Engineering

LLM Performance Engineering

5 days ago NVIDIA logo

Engineering Manager, LLM Performance

NVIDIA

Santa Clara, California, United States (On-site)$224–431.3K Yearly

Engineering Manager

vLLM

4 wk. ago

Manager, Large Language Model Inference

NVIDIA

Santa Clara, California, United States (Hybrid)$184–356.5K Yearly

Engineering Management

AI Engineering

Machine Learning Infrastructure

5 days ago NVIDIA logo

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124–241.5K Yearly

AI Engineering

ML Infrastructure Engineering

SGLang

1 wk. ago

Member of Technical Staff - Inference Research

Modal

New York, United States (On-site)$150–350K Yearly

Engineering

Speculative Decoding

3 wk. ago

Staff Inference ML Runtime Engineer

Cerebras

United States (On-site)

Software Engineering

Machine Learning Engineer

4 wk. ago

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160–230K Yearly

AI Research Engineer

AI Inference Product Management

vLLM

14 hr. ago NVIDIA logo

Senior Product Manager – AI Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$208–327.8K Yearly

Senior Product Manager

Inference Optimization

5 days ago NVIDIA logo

Senior DL Algorithms Engineer - Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$152–287.5K Yearly

Deep Learning Engineer

Algorithms Engineer

Deep Learning

Inference

2 wk. ago

Applied AI Engineer, Inference

CoreWeave

Bellevue, Washington, United States (On-site)$188–275K Yearly

Applied AI Engineering

ML Infrastructure Engineering

3 wk. ago

Senior Performance Engineer, Inference

Cerebras

Sunnyvale, California, United States (On-site)

Performance Engineering

vLLM

SGLang

3 wk. ago

Compiler Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$152–241.5K Yearly

Compiler Engineering

AI Infrastructure

Compiler Optimizations

MLIR

5 days ago NVIDIA logo

Senior System Software Engineer - Dynamo-Triton Inference Server

NVIDIA

Santa Clara, California, United States (On-site)$184–287.5K Yearly

Software Engineering

Rust

Machine Learning Engineer

3 wk. ago

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$220–485K Yearly

AI Engineering

Rust

Principal Software Engineer

4 wk. ago

Principal Software Engineer – Large-Scale LLM Memory and Storage Systems

NVIDIA

Santa Clara, California, United States (On-site)$272–431.3K Yearly

LLM Infrastructure Engineer

Rust

5 days ago NVIDIA logo

Solutions Architect, Inference Deployments

NVIDIA

Santa Clara, California, United States (On-site)$152–241.5K Yearly

Solutions Architecture

Generative AI

Kubernetes