Jobs on Inference Jobs

Distributed Serving

2 mo. ago

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

LLM Inference Optimization

LLM Performance Engineering

3 mo. ago

Engineering Manager, LLM Performance

NVIDIA

Santa Clara, California, United States (On-site)$224–431.3K Yearly

Engineering Manager

TensorRT-LLM

vLLM

3 mo. ago

D-

Principal LLM Inference Engineer

d-Matrix

United States (Remote)$195–285K Yearly

LLM Inference Engineering

AI Infrastructure Engineer

Principal Software Engineer

C/C++

9 mo. ago

Principal Software Engineer – Large-Scale LLM Memory and Storage Systems

NVIDIA

Santa Clara, California, United States (On-site)$272–431.3K Yearly

LLM Infrastructure Engineer

Rust

GPU Performance Engineering

2 mo. ago

Senior Solutions Architect, GPU Performance and LLM - Cloud Service Providers

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

Solutions Architecture

AI/ML

HPC

5 mo. ago

Senior Performance Engineer - LLM Inference Frameworks

NVIDIA

Yokne'am, Northern District, Israel (On-site)

Performance Engineering

Reinforcement Learning Engineering

5 mo. ago

LLM Reinforcement Learning Framework Engineer

NVIDIA

Shanghai, Shanghai, China (On-site)

LLM Engineering

2 mo. ago

Senior Software Engineer, LLM Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)

Senior Software Engineer

LLM Inference Engineer

Forward Deployed Engineer

GPU Programming

2 mo. ago

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

4 mo. ago

Forward Deployed Engineer - LLM Post-training

Reflection AI

San Francisco, California, United States (On-site)

ML Engineer

Head of Customer Engineering

Fine-tuning

4 days ago NVIDIA logo

Head of Global Customer Engineering - Internal EDA Infrastructure

NVIDIA

United States (Remote)$272–488.8K Yearly

Platform Engineering

Kubernetes

EDA Infrastructure

2 mo. ago

AI Infrastructure Engineer, Serving Platform

Scale

London, England, United Kingdom (On-site)

ML Infrastructure

Backend Engineering

AI Infrastructure Engineering

3 mo. ago

Senior Software Developer: Models Team (Token Factory)

Nebius

Amsterdam, North Holland, Netherlands (Hybrid)

Infrastructure Engineering

4 mo. ago

Software Engineer- BIS (Baseten Inference Stack)

Baseten

San Francisco, California, United States (Hybrid)$180–360K Yearly

Software Engineering

Distributed Systems

Kubernetes

3 mo. ago

Member of Technical Staff - Inference Research

Modal

New York, United States (On-site)$150–350K Yearly

Engineering

ML Infrastructure Engineering

Speculative Decoding

1 mo. ago

Member of Technical Staff, Agentic Environments

Cohere

North America, Europe, Middle East, and Africa (Remote)

AI Infrastructure Engineering

JAX

3 days ago Modal logo

Inference Engineering and Product Lead

Modal

San Francisco, California, United States (On-site)$300–350K Yearly

Engineering Leadership

Product Management

AI Infrastructure Engineering

Cloud Infrastructure

5 mo. ago

Principal High-Performance LLM Training Engineer

NVIDIA

Santa Clara, California, United States (On-site)$272–431.3K Yearly

LLM Training Engineering

AI Research & Engineering

JAX

4 days ago Anthropic logo

Software Engineer, Tokens and Prompt Structures

Anthropic

San Francisco, California, United States (Hybrid)$320–405K Yearly

Software Engineering