164 LLM Infrastructure Engineer jobs

Menlo Park, California, US (On-site)

Role Mission As HAI's LLM Inference Engineer, you will own the serving infrastructure that determines whether our breakthrough healthcare AI reaches…

Palo Alto, California, US (On-site)

$195.2–262.2K / year

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

Europe (Remote)

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

Santa Clara, California, US (On-site)

$272–431.3K / year

NVIDIA Dynamo is a high-throughput, low-latency inference framework for serving generative AI and reasoning models across multi-node distributed environments.

Santa Clara, California, US (Hybrid)

$195–285K / year

At d-Matrix , we are focused on unleashing the potential of generative AI to power the transformation of technology.

Yokne'am, Northern District, IL (On-site)

NVIDIA is hiring exceptional software engineers to build and optimize the core inference infrastructure for large language models.

San Francisco, California, US (On-site)

Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on.

Shanghai, CN (On-site)

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years.

Tel Aviv-Yafo, Tel Aviv District, IL (On-site)

NVIDIA has been at the forefront of the deep learning revolution, pioneering innovations that have transformed the entire field.

London, England, GB (On-site)

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

Santa Clara, California, US (On-site)

$272–431.3K / year

NVIDIA is seeking a Principal Engineer to drive the performance of large-scale AI training and post-training workloads across NVIDIA’s full hardware…

Poland + 3 more (Remote)

PLN 221.3–507K / year

We are looking for a passionate and energized engineer to accelerate the integration of APIs across the CUDA-X math library software stack into…

San Francisco, California, US (Hybrid)

$320–405K / year

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.

New York, US (On-site)

$150–350K / year

About Us: AI needs a new infrastructure layer.

Toronto, Ontario, CA (Hybrid)

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.

San Francisco, California, US (On-site)

$175–280K / year

About Sesame Sesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in ways that feel…

Cambridge, Massachusetts, US (On-site)

$229–363.5K / year

About Suno We're building the world's first creative entertainment platform, where the entire world can feel the joy and fulfillment of making music.

San Francisco, California, US (On-site)

$250–380K / year

About the Team The Workload team is responsible for designing and running OpenAI’s LLM training and inference infrastructure that powers frontier…

Yokne'am, Northern District, IL (On-site)

We are hiring a Senior AI Engineer to build and operate production AI systems and infrastructure.

Santa Clara, California, US (On-site)

$224–356.5K / year

NVIDIA is searching for a senior or principal engineer who specializes in building cutting-edge infrastructure for large-scale foundation model…