Jobs on Inference Jobs

Distributed Serving

3 wk. ago

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

LLM Inference Optimization

LLM Performance Engineering

PyTorch

5 days ago NVIDIA logo

Engineering Manager, LLM Performance

NVIDIA

Santa Clara, California, United States (On-site)$224–431.3K Yearly

Engineering Manager

TensorRT-LLM

vLLM

2 wk. ago

D-

Principal LLM Inference Engineer

d-Matrix

United States (Remote)$195–285K Yearly

LLM Inference Engineering

AI Infrastructure Engineer

Principal Software Engineer

C/C++

4 wk. ago

Principal Software Engineer – Large-Scale LLM Memory and Storage Systems

NVIDIA

Santa Clara, California, United States (On-site)$272–431.3K Yearly

LLM Infrastructure Engineer

Rust

Deep Learning Architecture

4 days ago NVIDIA logo

Senior Deep Learning Architect, LLM Inference

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

LLM Inference Engineering

Deep Learning

GPU Performance Engineering

3 wk. ago

Senior Solutions Architect, GPU Performance and LLM - Cloud Service Providers

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

Solutions Architecture

AI/ML

HPC

4 wk. ago

Senior Performance Engineer - LLM Inference Frameworks

NVIDIA

Yokne'am, Northern District, Israel (On-site)

Performance Engineering

Reinforcement Learning Engineering

PyTorch

3 wk. ago

LLM Reinforcement Learning Framework Engineer

NVIDIA

Shanghai, Shanghai, China (On-site)

LLM Engineering

PyTorch

3 wk. ago

Senior Software Engineer, LLM Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)

Senior Software Engineer

LLM Inference Engineer

Forward Deployed Engineer

GPU Programming

3 wk. ago

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

3 wk. ago

Forward Deployed Engineer - LLM Post-training

Reflection AI

San Francisco, California, United States (On-site)

ML Engineer

Infrastructure Engineering

Fine-tuning

1 wk. ago

Senior Infrastructure Software Engineer, TensorRT Edge-LLM

NVIDIA

Santa Clara, California, United States (Hybrid)$184–287.5K Yearly

DevOps

C/C++

3 wk. ago

AI Infrastructure Engineer, Serving Platform

Scale

London, England, United Kingdom (On-site)

ML Infrastructure

Backend Engineering

Deep Learning Engineering

4 wk. ago

AI Computing Development Engineer, TensorRT-LLM

NVIDIA

Shanghai, Shanghai, China (On-site)

AI Software Engineering

TensorRT-LLM

C/C++

3 wk. ago

Senior Software Developer: Models Team (Token Factory)

Nebius

Amsterdam, North Holland, Netherlands (Hybrid)

AI Infrastructure Engineering

Infrastructure Engineering

2 wk. ago

Software Engineer- BIS (Baseten Inference Stack)

Baseten

United States (Remote)$180–360K Yearly

Software Engineering

Distributed Systems

Kubernetes

1 wk. ago

Member of Technical Staff - Inference Research

Modal

New York, United States (On-site)$150–350K Yearly

Engineering

ML Infrastructure Engineering

Speculative Decoding

2 days ago Cohere logo

Member of Technical Staff, Agentic Environments

Cohere

North America, Europe, Middle East, and Africa (Remote)

AI Infrastructure Engineering

DL Performance Engineering

JAX

1 wk. ago

DL Performance Software Engineer - LLM Inference

NVIDIA

Toronto, Ontario, Canada (Hybrid)CA$135–220K Yearly

LLM Inference Engineering