Home
Jobs
Distributed Serving

Distributed Serving Jobs

Browse 57 Distributed Serving jobs on Inference Jobs.

57 jobs

3 wk. ago

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175–280K Yearly

Machine Learning Engineer

AI Engineer

PyTorch

vLLM

5 days ago NVIDIA logo

Senior Systems Software Engineer, Accelerated Kubernetes Performance and Scale - DGX Cloud

NVIDIA

Santa Clara, California, United States (Hybrid)$152–241.5K Yearly

Systems Software Engineering

Kubernetes Engineering

Kubernetes

Golang

1 mo. ago

Senior Software Engineer, AIOps

NVIDIA

Raanana, Central District, Israel (On-site)

Senior Software Engineer

AIOps Engineer

C++

2 days ago NVIDIA logo

AI Infrastructure Software Engineer — CosmosLab

NVIDIA

Shanghai, Shanghai, China (On-site)

AI Infrastructure Engineer

Machine Learning Infrastructure Engineer

Python

C/C++

4 days ago NVIDIA logo

Distinguished Engineer, Scaled Out Inferencing

NVIDIA

Worldwide (Remote)$320–488.8K Yearly

Distinguished Engineer

AI Infrastructure Engineering

GPU Architecture

CUDA

3 wk. ago

Staff Software Engineer, Inference Cloud

Cerebras

Sunnyvale, California, United States (On-site)

Staff Software Engineer

Cloud Infrastructure Engineering

C++

3 wk. ago

Staff Software Engineer, Inference Platform

Cerebras

Sunnyvale, California, United States (On-site)

Staff Software Engineer

Platform Engineering

C++

2 wk. ago

Software Engineer, Monetization ML Infrastructure

OpenAI

Worldwide (Remote)$293–441K Yearly

Machine Learning Infrastructure Engineering

ML Platform Engineer

Machine Learning Infrastructure

Distributed Systems

2 wk. ago

Sr. Engineering Manager, Inference

CoreWeave

United States (Remote)$188–303K Yearly

Engineering Management

AI/ML Platform Engineering

AI/ML Platform

Inference

3 wk. ago

Site Reliability Engineer, Inference Infrastructure

Cohere

Toronto, Ontario, CA or Remote (Worldwide)

Site Reliability Engineering

MLOps

Kubernetes

Distributed Systems

3 wk. ago

Senior Software Developer: Models Team (Token Factory)

Nebius

Amsterdam, North Holland, Netherlands (Hybrid)

AI Infrastructure Engineering

Machine Learning Engineering

Python

3 wk. ago

Senior Systems Software Engineer, Kubernetes Scale - DGX Cloud

NVIDIA

Germany + 5 more (Remote)

Systems Software Engineer

Kubernetes Engineer

Kubernetes

Golang

3 wk. ago

Systems Software Engineer, Kubernetes Scale - DGX Cloud

NVIDIA

Germany + 5 more (Remote)PLN 221.3–383.5K Yearly

Systems Software Engineering

Kubernetes Engineering

Kubernetes

Golang

19 hr. ago NVIDIA logo

Software Engineer, AI Networking Architect

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)

1 wk. ago

Senior Software Engineer – Kubernetes AI Foundations, Open Source

NVIDIA

Yokne'am, Northern District, Israel (On-site)

Senior Software Engineer

Kubernetes Engineer

Kubernetes

Cloud Native

2 wk. ago

Senior Technical Product Manager - Serverless AI

Nebius

Europe + 1 more (Remote)

Technical Product Management

AI Cloud Infrastructure

Docker

Container Runtimes

3 wk. ago

Systems Software Engineer, Kubernetes Scale - DGX Cloud

NVIDIA

Germany + 5 more (Remote)PLN 176.3–383.5K Yearly

Systems Software Engineer

Kubernetes Engineer

Kubernetes

Containers

3 wk. ago

Senior Software Engineer - ML Infrastructure

Applied Intuition

Sunnyvale, California, United States (On-site)$153–222K Yearly

Machine Learning Infrastructure Engineering

ML Platform Engineering

Machine Learning Infrastructure

Distributed GPU Training

3 wk. ago

Member of Technical Staff, MLE (Korea)

Cohere

Seoul, KR or Remote (Worldwide)

Machine Learning Engineer

Applied Machine Learning

Python

TensorFlow

3 wk. ago

Software Engineer, Model Routing & Inference

Cursor

New York, United States (On-site)

Jobs on Inference Jobs

Browse jobs on Inference Jobs.

JobsAI-ranked

Inference Jobs

Discover the latest AI roles from Inference Jobs.

Powered byCavuno

For Candidates

Jobs
Companies

For Companies

Post a job
Pricing

Resources

Locations
Salaries
Sitemap

About

About