Home
Jobs
AI/LLM Infrastructure

AI/LLM Infrastructure Jobs

Browse 193 AI/LLM Infrastructure jobs on Inference Jobs.

193 jobs

5 days ago NVIDIA logo

Senior Deep Learning Architect, LLM Inference

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

Deep Learning Architecture

LLM Inference Engineering

Deep Learning

LLM Inference

3 wk. ago

Senior Solutions Architect, GPU Performance and LLM - Cloud Service Providers

NVIDIA

Santa Clara, California, United States (On-site)$184–356.5K Yearly

Solutions Architecture

GPU Performance Engineering

AI/ML

HPC

3 wk. ago

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)

LLM Engineering

Machine Learning Engineering

LLM Inference

Distributed Serving

3 wk. ago

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

Machine Learning Engineering

LLM Inference Optimization

Python

PyTorch

6 days ago NVIDIA logo

Engineering Manager, LLM Performance

NVIDIA

Santa Clara, California, United States (On-site)$224–431.3K Yearly

Engineering Manager

LLM Performance Engineering

TensorRT-LLM

vLLM

2 wk. ago

D-

Principal LLM Inference Engineer

d-Matrix

United States (Remote)$195–285K Yearly

LLM Inference Engineering

AI Infrastructure Engineer

Python

C/C++

4 wk. ago

Principal Software Engineer – Large-Scale LLM Memory and Storage Systems

NVIDIA

Santa Clara, California, United States (On-site)$272–431.3K Yearly

Principal Software Engineer

LLM Infrastructure Engineer

Rust

Python

4 wk. ago

Senior Performance Engineer - LLM Inference Frameworks

NVIDIA

Yokne'am, Northern District, Israel (On-site)

Performance Engineering

LLM Inference

Python

PyTorch

3 wk. ago

Forward Deployed Engineer - LLM Post-training

Reflection AI

San Francisco, California, United States (On-site)

Forward Deployed Engineer

ML Engineer

Python

Fine-tuning

3 wk. ago

LLM Reinforcement Learning Framework Engineer

NVIDIA

Shanghai, Shanghai, China (On-site)

LLM Engineering

Reinforcement Learning Engineering

Python

PyTorch

3 wk. ago

Senior Software Engineer, LLM Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)

Senior Software Engineer

LLM Inference Engineer

LLM Inference

GPU Programming

3 wk. ago

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2–262.2K Yearly

4 wk. ago

AI Computing Development Engineer, TensorRT-LLM

NVIDIA

Shanghai, Shanghai, China (On-site)

AI Software Engineering

Deep Learning Engineering

TensorRT-LLM

C/C++

3 wk. ago

AI Infrastructure Engineer, Serving Platform

Scale

London, England, United Kingdom (On-site)

ML Infrastructure

Backend Engineering

Python

6 days ago NVIDIA logo

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124–241.5K Yearly

AI Engineering

Machine Learning Infrastructure

TensorRT-LLM

SGLang

3 wk. ago

Senior Software Developer: Models Team (Token Factory)

Nebius

Amsterdam, North Holland, Netherlands (Hybrid)

AI Infrastructure Engineering

Machine Learning Engineering

Python

3 wk. ago

Senior Solutions Architect - Generative AI

NVIDIA

Pune, Maharashtra, India (On-site)

Solutions Architect

Generative AI

Kubernetes

3 wk. ago

Senior Applied AI Engineer

NVIDIA

Shanghai, Shanghai, China (On-site)

Applied AI Engineer

AI Infrastructure Engineering

Python

LLMs

1 day ago

Solution Architect - ISV for AI Infra

NVIDIA

Beijing, Beijing, China (On-site)

Solution Architecture

Cloud Architecture

GPU Architecture

Cloud Computing

3 wk. ago

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$220–485K Yearly

AI Engineering

Machine Learning Engineer

Rust

Python

Jobs on Inference Jobs

Browse jobs on Inference Jobs.

JobsAI-ranked

Inference Jobs

Discover the latest AI roles from Inference Jobs.

Powered byCavuno

For Candidates

Jobs
Companies

For Companies

Post a job
Pricing

Resources

Locations
Salaries
Sitemap

About

About