Jobs on Inference Jobs

C/C++

2 wk. ago

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)

LLM Engineering

Deep Learning Research Engineering

Distributed Serving

4 days ago NVIDIA logo

Senior Deep Learning Research Engineer, LLM Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)

LLM Inference Optimization

PyTorch

3 wk. ago

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

LLM Inference Optimization

PyTorch

3 wk. ago

Senior Software Engineer, LLM Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)

Senior Software Engineer

LLM Inference Engineer

Deep Learning Architecture

GPU Programming

4 days ago NVIDIA logo

Senior Deep Learning Architect, LLM Inference

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

LLM Inference Engineering

Deep Learning

Infrastructure Engineering

2 wk. ago

Software Engineer- BIS (Baseten Inference Stack)

Baseten

United States (Remote)$180–360K Yearly

Software Engineering

Distributed Systems

Kubernetes

4 wk. ago

Senior Performance Engineer - LLM Inference Frameworks

NVIDIA

Yokne'am, Northern District, Israel (On-site)

Performance Engineering

Machine Learning Infrastructure

PyTorch

5 days ago NVIDIA logo

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124–241.5K Yearly

AI Engineering

TensorRT-LLM

SGLang

3 wk. ago

Staff Inference ML Runtime Engineer

Cerebras

United States (On-site)

Software Engineering

Machine Learning Engineer

C++

4 wk. ago

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160–230K Yearly

AI Research Engineer

TensorRT-LLM

vLLM

4 days ago NVIDIA logo

Senior DL Algorithms Engineer - Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$152–287.5K Yearly

Deep Learning Engineer

Algorithms Engineer

Deep Learning

Inference

2 wk. ago

Applied AI Engineer, Inference

CoreWeave

Bellevue, Washington, United States (On-site)$188–275K Yearly

Applied AI Engineering

ML Infrastructure Engineering

3 wk. ago

Senior Performance Engineer, Inference

Cerebras

Sunnyvale, California, United States (On-site)

Performance Engineering

vLLM

SGLang

3 wk. ago

Compiler Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$152–241.5K Yearly

Compiler Engineering

AI Infrastructure

Compiler Optimizations

MLIR

3 wk. ago

AI Inference Engineer (London)

Perplexity

London, England, United Kingdom (On-site)

AI Inference Engineer

Machine Learning Engineer

Rust

4 wk. ago

Performance Engineer, Inference Systems

Anthropic

San Francisco, California, United States (Hybrid)$350–850K Yearly

Performance Engineering

Inference Systems

DL Performance Engineering

SQL

1 wk. ago

DL Performance Software Engineer - LLM Inference

NVIDIA

Toronto, Ontario, Canada (Hybrid)CA$135–220K Yearly

LLM Inference Engineering

C++

5 days ago NVIDIA logo

Senior System Software Engineer - Dynamo-Triton Inference Server

NVIDIA

Santa Clara, California, United States (On-site)$184–287.5K Yearly

Software Engineering

Machine Learning Engineer

Rust

C++

3 wk. ago

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$220–485K Yearly

AI Engineering

Rust