245 LLM Infrastructure jobs

Menlo Park, California, US (On-site)

Role Mission As HAI's LLM Inference Engineer, you will own the serving infrastructure that determines whether our breakthrough healthcare AI reaches…

Palo Alto, California, US (On-site)

$195.2–262.2K / year

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

Menlo Park, California, US (On-site)

ABOUT THE ROLE We’re seeking an inference systems engineer to build the distributed serving and high-performance networking layer behind our large…

Europe (Remote)

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

Santa Clara, California, US (On-site)

$272–431.3K / year

NVIDIA Dynamo is a high-throughput, low-latency inference framework for serving generative AI and reasoning models across multi-node distributed environments.

Santa Clara, California, US (Hybrid)

$195–285K / year

At d-Matrix , we are focused on unleashing the potential of generative AI to power the transformation of technology.

Santa Clara, California, US (On-site)

$184–356.5K / year

Join our team at NVIDIA and help bring AI solutions to our largest customers.

Yokne'am, Northern District, IL (On-site)

NVIDIA is hiring exceptional software engineers to build and optimize the core inference infrastructure for large language models.

Shanghai, CN (On-site)

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years.

Tel Aviv-Yafo, Tel Aviv District, IL (On-site)

NVIDIA has been at the forefront of the deep learning revolution, pioneering innovations that have transformed the entire field.

Palo Alto, California, US (On-site)

$195.2–262.2K / year

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

San Francisco, California, US (On-site)

Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on.

Amsterdam, North Holland, NL (Hybrid)

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

London, England, GB (On-site)

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

North America, Europe, Middle East, and Africa (Remote)

Who are we? Cohere is the leading security-first enterprise AI company.

New York, US (On-site)

$150–350K / year

About Us: AI needs a new infrastructure layer.

San Francisco, California, US (On-site)

$300–350K / year

About Us: AI needs a new infrastructure layer.

Santa Clara, California, US (On-site)

$272–431.3K / year

NVIDIA is seeking a Principal Engineer to drive the performance of large-scale AI training and post-training workloads across NVIDIA’s full hardware…

Poland + 3 more (Remote)

PLN 221.3–507K / year

We are looking for a passionate and energized engineer to accelerate the integration of APIs across the CUDA-X math library software stack into…

San Francisco, California, US (Hybrid)

$320–405K / year

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.