Home
Jobs
United States
LLM Serving

LLM Serving Jobs in United States

Browse 25 LLM Serving jobs in United States on Inference Jobs.

25 jobs

3 wk. ago

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)

LLM Engineering

Machine Learning Engineering

LLM Inference

Distributed Serving

3 wk. ago

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175–280K Yearly

Machine Learning Engineer

AI Engineer

PyTorch

vLLM

2 days ago Scale logo

AI Infrastructure Engineer, Model Serving Platform

Scale

San Francisco, California, United States (On-site)$216–270K Yearly

ML Infrastructure

Machine Learning Engineer

Python

1 day ago

Senior Product Manager – AI Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$208–327.8K Yearly

Senior Product Manager

AI Inference Product Management

Inference Optimization

TensorRT-LLM

3 wk. ago

Product Manager, Strategic Verticals

Cerebras

Sunnyvale, California, United States (Hybrid)

Product Management

Technical Product Management

Product Management

LLMs

2 wk. ago

Senior Machine Learning Engineer, Voice AI

Together AI

San Francisco, California, United States (On-site)$200–260K Yearly

Machine Learning Engineer

AI Engineer

Machine Learning

Python

4 wk. ago

Staff Machine Learning Engineer, Voice AI

Together AI

San Francisco, California, United States (On-site)$220–280K Yearly

Machine Learning Engineering

Voice AI Engineering

TensorRT-LLM

SGLang

2 days ago Anthropic logo

Staff + Sr. Software Engineer, Cloud Inference Launch Engineering

Anthropic

San Francisco, California, United States (Hybrid)$320–485K Yearly

Software Engineering - Infrastructure

Cloud Infrastructure Engineering

AWS

GCP

3 wk. ago

Forward Deployed ML Engineer

Modal

New York, United States (On-site)$180–250K Yearly

Forward Deployed Engineer

Machine Learning Engineer

Machine Learning

MLOps

2 wk. ago

Engineering Manager, Search

Anthropic

San Francisco, California, United States (Hybrid)$320–405K Yearly

Engineering Management

Search Engineering

Search Systems

Indexing

4 wk. ago

Senior Engineering Manager, Model Infrastructure

Harvey

San Francisco, California, United States (Hybrid)$272–355K Yearly

Engineering Management

AI Infrastructure Engineering

AI Infrastructure

Machine Learning Platforms

3 wk. ago

Solution Specialist, AI Runtime Services

CoreWeave

Livingston, New Jersey, United States (On-site)$207–275K Yearly

AI Infrastructure Sales

Solution Specialist

vLLM

TensorRT-LLM

4 wk. ago

Performance Engineer, Inference Systems

Anthropic

San Francisco, California, United States (Hybrid)$350–850K Yearly

Performance Engineering

Inference Systems

Python

SQL

1 day ago

Research Engineer, LangSmith Engine

LangChain

New York, United States (On-site)

Research Engineering

Machine Learning Engineering

LLMs

AI Agents

6 days ago NVIDIA logo

Senior Performance Architect, Nemotron

NVIDIA

Santa Clara, California, United States (On-site)$152–287.5K Yearly

Performance Architecture

AI Systems Engineering

Python

C++

2 days ago Anthropic logo

Software Engineer, AI Reliability

Anthropic

San Francisco, California, United States (Hybrid)$325–485K Yearly

Site Reliability Engineering

Software Engineering - Infrastructure

Distributed Systems

Site Reliability Engineering (SRE)

1 day ago

Senior Software Engineer, ML Infrastructure

SambaNova

United States (Remote)$200–275K Yearly

1 day ago

Senior Manager, Software Engineering - NIM Factory

NVIDIA

United States (Remote)$272–431.3K Yearly

Senior Engineering Manager

Software Engineering Management

Python

Kubernetes

2 wk. ago

Senior Technical Product Manager - Serverless AI

Nebius

Europe + 1 more (Remote)

Technical Product Management

AI Cloud Infrastructure

Docker

Container Runtimes

3 wk. ago

Software Engineer - Model API's

Baseten

San Francisco, California, US or Remote (Worldwide)$180–360K Yearly

Jobs on Inference Jobs

Browse jobs on Inference Jobs.

JobsAI-ranked

Inference Jobs

Discover the latest AI roles from Inference Jobs.

Powered byCavuno

For Candidates

Jobs
Companies

For Companies

Post a job
Pricing

Resources

Locations
Salaries
Sitemap

About

About