Jobs on Inference Jobs

Principal Software Engineer

LLM Inference

Distributed Serving

4 wk. ago

Principal Software Engineer – Large-Scale LLM Memory and Storage Systems

NVIDIA

Santa Clara, California, United States (On-site)$272–431.3K Yearly

LLM Infrastructure Engineer

Rust

3 wk. ago

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

LLM Inference Optimization

Deep Learning Engineering

5 days ago NVIDIA logo

Senior High-Performance LLM Training Engineer

NVIDIA

Santa Clara, California, United States (Hybrid)$184–356.5K Yearly

LLM Training Engineering

Forward Deployed Engineer

JAX

3 wk. ago

Forward Deployed Engineer - LLM Post-training

Reflection AI

San Francisco, California, United States (On-site)

ML Engineer

Deep Learning Architecture

Fine-tuning

4 days ago NVIDIA logo

Senior Deep Learning Architect, LLM Inference

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

LLM Inference Engineering

Deep Learning

LLM Inference

3 wk. ago

Senior Solutions Architect, GPU Performance and LLM - Cloud Service Providers

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

Solutions Architecture

GPU Performance Engineering

AI/ML

HPC

15 hr. ago NVIDIA logo

Solutions Architect, LLM Model Builder

NVIDIA

Santa Clara, California, United States (On-site)$152–241.5K Yearly

Solutions Architecture

Infrastructure Engineering

LLMs

VLMs

3 wk. ago

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

1 wk. ago

Senior Infrastructure Software Engineer, TensorRT Edge-LLM

NVIDIA

Santa Clara, California, United States (Hybrid)$184–287.5K Yearly

DevOps

Forward Deployed Engineering

C/C++

5 days ago Hippocratic AI logo

Senior Forward Deployed Engineer

Hippocratic AI

Menlo Park, California, United States (On-site)

AI Engineering

AI Infrastructure Engineering

LangChain

5 days ago NVIDIA logo

Principal High-Performance LLM Training Engineer

NVIDIA

Santa Clara, California, United States (On-site)$272–431.3K Yearly

LLM Training Engineering

JAX

3 wk. ago

Senior Machine Learning Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)

Product and Engineering

LLM Engineering

Machine Learning Infrastructure

5 days ago NVIDIA logo

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124–241.5K Yearly

AI Engineering

TensorRT-LLM

SGLang

3 wk. ago

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175–280K Yearly

Machine Learning Engineer

AI Engineer

vLLM

3 wk. ago

Staff AI Engineer (Life Sciences)

Hippocratic AI

Palo Alto, California, United States (On-site)

5 days ago NVIDIA logo

Senior AI Software Engineer, Kernel Libraries

NVIDIA

Santa Clara, California, United States (On-site)$184–287.5K Yearly

AI Engineering

Machine Learning Engineer

C++

3 wk. ago

ML Engineer

Sesame

San Francisco, California, United States (On-site)$190–320K Yearly

Machine Learning