Home
Jobs
Distributed Inference Serving

Distributed Inference Serving Jobs

Browse 39 Distributed Inference Serving jobs on Inference Jobs.

39 jobs

3 wk. ago

Staff Software Engineer, Inference Cloud

Cerebras

Sunnyvale, California, United States (On-site)

Staff Software Engineer

Cloud Infrastructure Engineering

C++

2 wk. ago

Sr. Engineering Manager, Inference

CoreWeave

United States (Remote)$188–303K Yearly

Engineering Management

AI/ML Platform Engineering

AI/ML Platform

Inference

3 wk. ago

Site Reliability Engineer, Inference Infrastructure

Cohere

Toronto, Ontario, CA or Remote (Worldwide)

Site Reliability Engineering

MLOps

Kubernetes

Distributed Systems

3 wk. ago

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180–250K Yearly

Inference Engineering

Machine Learning Engineering

Model Inference

Distributed Systems

2 wk. ago

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)

LLM Engineering

Machine Learning Engineering

LLM Inference

Distributed Serving

3 wk. ago

Inference Intern

Etched

San Jose, California, United States (On-site)

Inference Architecture

AI Accelerator Engineering

Python

C++

2 wk. ago

Technical Program Manager, Inference

CoreWeave

Livingston, New Jersey, United States (On-site)$198–264K Yearly

Technical Program Management

AI/ML Platform Engineering

Distributed Systems

GPU Compute

4 wk. ago

Performance Engineer, Inference Systems

Anthropic

San Francisco, California, United States (Hybrid)$350–850K Yearly

Performance Engineering

Inference Systems

Python

SQL

3 wk. ago

Staff Software Engineer, Inference Infrastructure

Cohere

San Francisco, California, US or Remote (Canada + 3 more)

3 wk. ago

Staff Software Engineer, Inference Platform

Cerebras

Sunnyvale, California, United States (On-site)

Staff Software Engineer

Platform Engineering

C++

3 wk. ago

Software Engineer, Model Routing & Inference

Cursor

New York, United States (On-site)

3 wk. ago

Senior Inference Platform SDET

Cerebras

Sunnyvale, California, United States (On-site)

Software Development Engineer in Test

Platform Engineering

Python

3 wk. ago

Principal Engineer, Inference Cloud

Cerebras

Sunnyvale, California, United States (On-site)

Software

Cloud Computing

Distributed Systems Architecture

Cloud Infrastructure

1 day ago

Staff + Sr. Software Engineer, Cloud Inference Launch Engineering

Anthropic

San Francisco, California, United States (Hybrid)$320–485K Yearly

Software Engineering - Infrastructure

Cloud Infrastructure Engineering

AWS

GCP

3 wk. ago

Staff Python / PyTorch Developer — Frontend Inference Compiler – Dubai

Cerebras

Dubai, United Arab Emirates (On-site)

Software Engineering

Machine Learning Engineering

Python

PyTorch

11 hr. ago SambaNova logo

Senior Software Engineer, ML Infrastructure

SambaNova

United States (Remote)$200–275K Yearly

3 wk. ago

Lead Member of Technical Staff, Inference Infrastructure

Cohere

Worldwide (Remote)

Inference Infrastructure

Model Serving

Kubernetes

GPU Computing

3 wk. ago

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175–280K Yearly

Machine Learning Engineer

AI Engineer

PyTorch

vLLM

1 day ago

AI Infrastructure Software Engineer — CosmosLab

NVIDIA

Shanghai, Shanghai, China (On-site)

AI Infrastructure Engineer

Machine Learning Infrastructure Engineer

Python

C/C++

5 days ago NVIDIA logo

Senior Systems Software Engineer, Accelerated Kubernetes Performance and Scale - DGX Cloud

NVIDIA

Santa Clara, California, United States (Hybrid)$152–241.5K Yearly

Systems Software Engineering

Kubernetes Engineering

Kubernetes

Golang

Jobs on Inference Jobs

Browse jobs on Inference Jobs.

JobsAI-ranked

Inference Jobs

Discover the latest AI roles from Inference Jobs.

Powered byCavuno

For Candidates

Jobs
Companies

For Companies

Post a job
Pricing

Resources

Locations
Salaries
Sitemap

About

About