Jobs on Inference Jobs

Machine Learning Engineering

Distributed Serving

3 wk. ago

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

LLM Inference Optimization

LLM Inference Engineering

2 wk. ago

D-

Principal LLM Inference Engineer

d-Matrix

United States (Remote)$195–285K Yearly

AI Infrastructure Engineer

Principal Software Engineer

C/C++

4 wk. ago

Principal Software Engineer – Large-Scale LLM Memory and Storage Systems

NVIDIA

Santa Clara, California, United States (On-site)$272–431.3K Yearly

LLM Infrastructure Engineer

Rust

4 wk. ago

Senior Performance Engineer - LLM Inference Frameworks

NVIDIA

Yokne'am, Northern District, Israel (On-site)

Performance Engineering

Forward Deployed Engineer

3 wk. ago

Forward Deployed Engineer - LLM Post-training

Reflection AI

San Francisco, California, United States (On-site)

ML Engineer

Reinforcement Learning Engineering

Fine-tuning

3 wk. ago

LLM Reinforcement Learning Framework Engineer

NVIDIA

Shanghai, Shanghai, China (On-site)

LLM Engineering

3 wk. ago

Senior Software Engineer, LLM Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)

Senior Software Engineer

LLM Inference Engineer

Deep Learning Architecture

GPU Programming

4 days ago NVIDIA logo

Senior Deep Learning Architect, LLM Inference

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

LLM Inference Engineering

Deep Learning

Infrastructure Engineering

1 wk. ago

Senior Infrastructure Software Engineer, TensorRT Edge-LLM

NVIDIA

Santa Clara, California, United States (Hybrid)$184–287.5K Yearly

DevOps

Infrastructure Engineering

C/C++

2 wk. ago

Software Engineer- BIS (Baseten Inference Stack)

Baseten

United States (Remote)$180–360K Yearly

Software Engineering

Distributed Systems

Kubernetes

3 wk. ago

AI Infrastructure Engineer, Serving Platform

Scale

London, England, United Kingdom (On-site)

ML Infrastructure

Backend Engineering

Deep Learning Engineering

4 wk. ago

AI Computing Development Engineer, TensorRT-LLM

NVIDIA

Shanghai, Shanghai, China (On-site)

AI Software Engineering

TensorRT-LLM

C/C++

1 wk. ago

DL Performance Software Engineer - LLM Inference

NVIDIA

Toronto, Ontario, Canada (Hybrid)CA$135–220K Yearly

DL Performance Engineering

LLM Inference Engineering

AI Infrastructure Engineering

C++

5 days ago NVIDIA logo

Principal High-Performance LLM Training Engineer

NVIDIA

Santa Clara, California, United States (On-site)$272–431.3K Yearly

LLM Training Engineering

JAX

3 wk. ago

Full Stack LLM Engineer

Cerebras

Toronto, Ontario, Canada (Hybrid)

Full-Stack LLM Engineer

Software Engineer

Machine Learning Engineer

3 wk. ago

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175–280K Yearly

AI Engineer

Machine Learning Infrastructure

vLLM

5 days ago NVIDIA logo

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124–241.5K Yearly

AI Engineering

TensorRT-LLM

SGLang

5 days ago NVIDIA logo

Senior AI Software Engineer, Kernel Libraries

NVIDIA

Santa Clara, California, United States (On-site)$184–287.5K Yearly

AI Engineering

Machine Learning Engineering

Machine Learning Engineer

C++

3 wk. ago

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$220–485K Yearly

AI Engineering

Rust