Jobs on Inference Jobs

C/C++

3 wk. ago

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)

LLM Engineering

Deep Learning Architecture

Distributed Serving

2 wk. ago

Senior Deep Learning Researcher, LLM Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)

Deep Learning Research

LLM Research

Deep Learning Research

Large Language Models

4 days ago NVIDIA logo

Senior Deep Learning Architect, LLM Inference

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

LLM Inference Engineering

Deep Learning

3 wk. ago

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

LLM Inference Optimization

Deep Learning Research Engineering

PyTorch

4 days ago NVIDIA logo

Senior Deep Learning Research Engineer, LLM Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)

LLM Inference Optimization

PyTorch

3 wk. ago

Senior Software Engineer, LLM Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)

Senior Software Engineer

LLM Inference Engineer

ML Infrastructure Engineering

GPU Programming

3 wk. ago

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

2 wk. ago

Member of Technical Staff - RL Inference

xAI

Palo Alto, California, United States (On-site)

RL Inference Engineering

C++

4 wk. ago

Senior Performance Engineer - LLM Inference Frameworks

NVIDIA

Yokne'am, Northern District, Israel (On-site)

Performance Engineering

LLM Performance Engineering

PyTorch

5 days ago NVIDIA logo

Engineering Manager, LLM Performance

NVIDIA

Santa Clara, California, United States (On-site)$224–431.3K Yearly

Engineering Manager

vLLM

4 wk. ago

Manager, Large Language Model Inference

NVIDIA

Santa Clara, California, United States (Hybrid)$184–356.5K Yearly

Engineering Management

AI Engineering

C++

Infrastructure Engineering

2 wk. ago

Software Engineer- BIS (Baseten Inference Stack)

Baseten

United States (Remote)$180–360K Yearly

Software Engineering

Distributed Systems

Kubernetes

5 days ago NVIDIA logo

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124–241.5K Yearly

AI Engineering

Machine Learning Infrastructure

ML Infrastructure Engineering

SGLang

1 wk. ago

Member of Technical Staff - Inference Research

Modal

New York, United States (On-site)$150–350K Yearly

Engineering

Speculative Decoding

3 wk. ago

Staff Inference ML Runtime Engineer

Cerebras

United States (On-site)

Software Engineering

Machine Learning Engineer

C++

4 wk. ago

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160–230K Yearly

AI Research Engineer

AI Inference Product Management

vLLM

16 hr. ago NVIDIA logo

Senior Product Manager – AI Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$208–327.8K Yearly

Senior Product Manager

Inference Optimization

5 days ago NVIDIA logo

Senior DL Algorithms Engineer - Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$152–287.5K Yearly

Deep Learning Engineer

Algorithms Engineer

Deep Learning

Inference

2 wk. ago

Applied AI Engineer, Inference

CoreWeave

Bellevue, Washington, United States (On-site)$188–275K Yearly

Applied AI Engineering