Jobs on Inference Jobs

Distributed Serving

3 wk. ago

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

LLM Inference Optimization

LLM Performance Engineering

5 days ago NVIDIA logo

Engineering Manager, LLM Performance

NVIDIA

Santa Clara, California, United States (On-site)$224–431.3K Yearly

Engineering Manager

TensorRT-LLM

vLLM

2 wk. ago

D-

Principal LLM Inference Engineer

d-Matrix

United States (Remote)$195–285K Yearly

LLM Inference Engineering

AI Infrastructure Engineer

Principal Software Engineer

C/C++

4 wk. ago

Principal Software Engineer – Large-Scale LLM Memory and Storage Systems

NVIDIA

Santa Clara, California, United States (On-site)$272–431.3K Yearly

LLM Infrastructure Engineer

Rust

4 wk. ago

Senior Performance Engineer - LLM Inference Frameworks

NVIDIA

Yokne'am, Northern District, Israel (On-site)

Performance Engineering

Forward Deployed Engineer

3 wk. ago

Forward Deployed Engineer - LLM Post-training

Reflection AI

San Francisco, California, United States (On-site)

ML Engineer

Reinforcement Learning Engineering

Fine-tuning

3 wk. ago

LLM Reinforcement Learning Framework Engineer

NVIDIA

Shanghai, Shanghai, China (On-site)

LLM Engineering

Deep Learning Architecture

4 days ago NVIDIA logo

Senior Deep Learning Architect, LLM Inference

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

LLM Inference Engineering

Deep Learning

GPU Performance Engineering

3 wk. ago

Senior Solutions Architect, GPU Performance and LLM - Cloud Service Providers

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

Solutions Architecture

AI/ML

HPC

3 wk. ago

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

1 wk. ago

Senior Infrastructure Software Engineer, TensorRT Edge-LLM

NVIDIA

Santa Clara, California, United States (Hybrid)$184–287.5K Yearly

Infrastructure Engineering

DevOps

Infrastructure Engineering

C/C++

2 wk. ago

Software Engineer- BIS (Baseten Inference Stack)

Baseten

United States (Remote)$180–360K Yearly

Software Engineering

Distributed Systems

Kubernetes

3 wk. ago

AI Infrastructure Engineer, Serving Platform

Scale

London, England, United Kingdom (On-site)

ML Infrastructure

Backend Engineering

Deep Learning Engineering

4 wk. ago

AI Computing Development Engineer, TensorRT-LLM

NVIDIA

Shanghai, Shanghai, China (On-site)

AI Software Engineering

TensorRT-LLM

C/C++

1 wk. ago

DL Performance Software Engineer - LLM Inference

NVIDIA

Toronto, Ontario, Canada (Hybrid)CA$135–220K Yearly

DL Performance Engineering

LLM Inference Engineering

AI Infrastructure Engineering

C++

5 days ago NVIDIA logo

Principal High-Performance LLM Training Engineer

NVIDIA

Santa Clara, California, United States (On-site)$272–431.3K Yearly

LLM Training Engineering

AI Infrastructure Engineering

JAX

3 wk. ago

Senior Software Developer: Models Team (Token Factory)

Nebius

Amsterdam, North Holland, Netherlands (Hybrid)

2 days ago Cohere logo

Member of Technical Staff, Agentic Environments

Cohere

North America, Europe, Middle East, and Africa (Remote)

AI Infrastructure Engineering

ML Infrastructure Engineering

JAX

1 wk. ago

Member of Technical Staff - Inference Research

Modal

New York, United States (On-site)$150–350K Yearly

Engineering