Home
Jobs
Serving Infrastructure

Serving Infrastructure Jobs

Browse 75 Serving Infrastructure jobs on Inference Jobs.

75 jobs

3 wk. ago

AI Infrastructure Engineer, Serving Platform

Scale

London, England, United Kingdom (On-site)

ML Infrastructure

Backend Engineering

Python

1 day ago

AI Infrastructure Engineer, Model Serving Platform

Scale

San Francisco, California, United States (On-site)$216–270K Yearly

ML Infrastructure

Machine Learning Engineer

Python

4 wk. ago

Senior Engineering Manager, Model Infrastructure

Harvey

San Francisco, California, United States (Hybrid)$272–355K Yearly

Engineering Management

AI Infrastructure Engineering

AI Infrastructure

Machine Learning Platforms

3 wk. ago

Software Engineer - Infrastructure

Baseten

San Francisco, California, US or Remote (United States)$165–330K Yearly

Software Engineering

DevOps

Python

3 wk. ago

Senior Software Engineer - ML Infrastructure

Applied Intuition

Sunnyvale, California, United States (On-site)$153–222K Yearly

Machine Learning Infrastructure Engineering

ML Platform Engineering

Machine Learning Infrastructure

Distributed GPU Training

2 wk. ago

Software Engineer, Monetization ML Infrastructure

OpenAI

Worldwide (Remote)$293–441K Yearly

Machine Learning Infrastructure Engineering

ML Platform Engineer

Machine Learning Infrastructure

Distributed Systems

3 wk. ago

Senior Software Developer: Models Team (Token Factory)

Nebius

Amsterdam, North Holland, Netherlands (Hybrid)

AI Infrastructure Engineering

Machine Learning Engineering

Python

3 wk. ago

Senior Technical Program Manager, Machine Learning Infrastructure

Cohere

Worldwide (Remote)

Technical Program Management

Engineering Program Management

Technical Program Management

Machine Learning Infrastructure

3 wk. ago

Lead Member of Technical Staff, Inference Infrastructure

Cohere

Worldwide (Remote)

Inference Infrastructure

Model Serving

Kubernetes

GPU Computing

3 wk. ago

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175–280K Yearly

Machine Learning Engineer

AI Engineer

PyTorch

vLLM

3 wk. ago

Site Reliability Engineer, Inference Infrastructure

Cohere

Toronto, Ontario, CA or Remote (Worldwide)

Site Reliability Engineering

MLOps

Kubernetes

Distributed Systems

2 days ago NVIDIA logo

AI Infrastructure Software Engineer — CosmosLab

NVIDIA

Shanghai, Shanghai, China (On-site)

AI Infrastructure Engineer

Machine Learning Infrastructure Engineer

Python

C/C++

1 day ago

Senior Software Engineer, ML Infrastructure

SambaNova

United States (Remote)$200–275K Yearly

1 wk. ago

Senior Software Engineer – Kubernetes AI Foundations, Open Source

NVIDIA

Yokne'am, Northern District, Israel (On-site)

Senior Software Engineer

Kubernetes Engineer

Kubernetes

Cloud Native

1 day ago

Software Engineer, AI Reliability

Anthropic

San Francisco, California, United States (Hybrid)$325–485K Yearly

Site Reliability Engineering

Software Engineering - Infrastructure

Distributed Systems

Site Reliability Engineering (SRE)

20 hr. ago NVIDIA logo

Senior Platform AI Engineer - Silicon Co-Design Group

NVIDIA

Shanghai, Shanghai, China (On-site)

AI Infrastructure Engineering

Platform Engineering

Python

C++

2 days ago Anthropic logo

Staff + Sr. Software Engineer, Cloud Inference Launch Engineering

Anthropic

San Francisco, California, United States (Hybrid)$320–485K Yearly

Software Engineering - Infrastructure

Cloud Infrastructure Engineering

AWS

GCP

3 wk. ago

Sr./Staff TPM - Inference Capacity

Cerebras

Sunnyvale, California, United States (Hybrid)

Technical Program Management

Capacity Planning

SQL

Grafana

1 day ago

Forward Deployed Engineer - ML

Modal

Stockholm, Sweden (On-site)

Machine Learning Engineer

ML Infrastructure

LLM Serving

Model Training

1 day ago

Member of Engineering (Compute)

Poolside

Europe, Middle East, and Africa, North America (Remote)

Engineering

Infrastructure Engineering

Kubernetes

Jobs on Inference Jobs

Browse jobs on Inference Jobs.

JobsAI-ranked

Inference Jobs

Discover the latest AI roles from Inference Jobs.

Powered byCavuno

For Candidates

Jobs
Companies

For Companies

Post a job
Pricing

Resources

Locations
Salaries
Sitemap

About

About