Home
Jobs
AI Inference Infrastructure

AI Inference Infrastructure Jobs

Browse 214 AI Inference Infrastructure jobs on Inference Jobs.

214 jobs

3 wk. ago

Principal SRE - AI Inference

Cerebras

Sunnyvale, California, United States (On-site)

Principal Site Reliability Engineering

AI Infrastructure SRE

Site Reliability Engineering

AI Inference

3 wk. ago

Compiler Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$152–241.5K Yearly

Compiler Engineering

AI Infrastructure

Compiler Optimizations

MLIR

3 wk. ago

Inference Technical Lead, Sora

OpenAI

San Francisco, California, United States (Hybrid)$380K Yearly

Inference Engineering

AI Infrastructure

GPU Inference

Model Serving

4 wk. ago

Applied AI Inference Engineer

Crusoe

San Francisco, California, United States (On-site)$250–300K Yearly

14 hr. ago NVIDIA logo

Senior Product Manager – AI Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$208–327.8K Yearly

Senior Product Manager

AI Inference Product Management

Inference Optimization

TensorRT-LLM

3 wk. ago

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180–250K Yearly

Inference Engineering

Machine Learning Engineering

Model Inference

Distributed Systems

3 wk. ago

AI Inference Engineer (London)

Perplexity

London, England, United Kingdom (On-site)

AI Inference Engineer

Machine Learning Engineer

Rust

Python

3 wk. ago

Staff Inference ML Runtime Engineer

Cerebras

United States (On-site)

Machine Learning Engineering

Software Engineering

Python

C++

2 wk. ago

Technical Support Engineer (Inference) - US Weekends

Together AI

United States (Remote)$160–230K Yearly

Technical Support Engineering

Customer Success

Kubernetes

Python

2 wk. ago

Applied AI Engineer, Inference

CoreWeave

Bellevue, Washington, United States (On-site)$188–275K Yearly

Applied AI Engineering

Machine Learning Engineering

Python

LLM Inference

5 days ago NVIDIA logo

Senior Software Engineer, AI Inference Systems

NVIDIA

Santa Clara, California, United States (Hybrid)$184–356.5K Yearly

5 days ago NVIDIA logo

Solutions Architect, Inference Deployments

NVIDIA

Santa Clara, California, United States (On-site)$152–241.5K Yearly

Solutions Architecture

Generative AI

Kubernetes

TensorRT-LLM

2 wk. ago

Sr. Engineering Manager, Inference

CoreWeave

United States (Remote)$188–303K Yearly

Engineering Management

AI/ML Platform Engineering

AI/ML Platform

Inference

5 days ago NVIDIA logo

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124–241.5K Yearly

AI Engineering

Machine Learning Infrastructure

TensorRT-LLM

SGLang

19 hr. ago CoreWeave logo

Software Engineer, Inference AI/ML

CoreWeave

Sunnyvale, California, United States (Hybrid)$92–135K Yearly

Software Engineering

Machine Learning Engineering

Python

3 wk. ago

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$295–555K Yearly

Software Engineer

Inference Engineer

Inference Infrastructure

Multimodal Models

4 days ago NVIDIA logo

Senior Deep Learning Architect, LLM Inference

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

Deep Learning Architecture

LLM Inference Engineering

Deep Learning

LLM Inference

4 wk. ago

Inference Technical Lead, On-Device Transformers

OpenAI

San Francisco, California, United States (Hybrid)$445K Yearly

Machine Learning

Inference Engineering

CUDA

ML Runtimes

2 days ago Etched logo

Inference Software Engineer

Etched

Cupertino, California, United States (On-site)

Inference Engineering

Machine Learning Infrastructure

C++

Python

2 wk. ago

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)

LLM Engineering

Machine Learning Engineering

LLM Inference

Distributed Serving

Jobs on Inference Jobs

Browse jobs on Inference Jobs.

JobsAI-ranked

Inference Jobs

Discover the latest AI roles from Inference Jobs.

Powered byCavuno

For Candidates

Jobs
Companies

For Companies

Post a job
Pricing

Resources

Locations
Salaries
Sitemap

About

About