67 Inference-Serving Systems jobs

Menlo Park, California, US (On-site)

ABOUT THE ROLE We’re seeking an inference systems engineer to build the distributed serving and high-performance networking layer behind our large…

San Francisco, California, US (Hybrid)

$350–850K / year

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.

San Francisco, California, US (On-site)

$170–265K / year

Perplexity is looking for a technical program manager to be the connective tissue between our model providers, engineering, and product teams,…

United States (Remote)

$150–220K / year

Runpod is the AI Developer Cloud.

Sunnyvale, California, US (Hybrid)

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.

San Francisco, California, US (On-site)

$180–250K / year

About Cartesia Our mission is to architect AI that learns from and interacts with the world like humans do.

San Francisco, California, US (On-site)

$300–350K / year

About Us: AI needs a new infrastructure layer.

Santa Clara, California, US (On-site)

$224–356.5K / year

We are looking for an architect that wants to change how the AI inference industry works.

Menlo Park, California, US (On-site)

Role Mission As HAI's LLM Inference Engineer, you will own the serving infrastructure that determines whether our breakthrough healthcare AI reaches…

San Jose, California, US (On-site)

About Etched Etched is building hardware for frontier intelligence.

San Francisco, California, US (Hybrid)

Who are we? Cohere is the leading security-first enterprise AI company.

New York, US (On-site)

Our mission is to automate coding.

San Francisco, California, US (On-site)

$350–475K / year

About Thinking Machines The mission of Thinking Machines is to build AI that extends human will and judgment.

Santa Clara, California, US (Hybrid)

$208–379.5K / year

At NVIDIA, we are building the foundation & blueprints for how AI workloads are served at scale for NVIDIA employees and DSX Partners.

San Francisco, California, US (Hybrid)

$180–360K / year

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay,…

Sunnyvale, California, US (On-site)

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.

Bellevue, Washington, US (On-site)

$177–237K / year

CoreWeave is The Essential Cloud for AI™.

Sunnyvale, California, US (On-site)

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.

San Francisco, California, US (On-site)

$230–390K / year

About us Sierra is the leading platform for customer-facing AI agents, working with many of the world's biggest brands — including The GAP, Rocket…

Sunnyvale, California, US (Hybrid)

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.