108 LLM Inference Engineering jobs

Menlo Park, California, US (On-site)

Role Mission As HAI's LLM Inference Engineer, you will own the serving infrastructure that determines whether our breakthrough healthcare AI reaches…

Tel Aviv-Yafo, Tel Aviv District, IL (On-site)

We are seeking a Deep Learning Research Engineer to join our team and help develop the next generation of Large Language Model (LLM) inference algorithms.

Palo Alto, California, US (On-site)

$195.2–262.2K / year

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

Tel Aviv-Yafo, Tel Aviv District, IL (On-site)

We are seeking a highly motivated Senior Deep Learning Researcher to join our team!

Palo Alto, California, US (On-site)

$195.2–262.2K / year

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

Palo Alto, California, US (On-site)

$180–440K / year

SpaceXAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.

Yokne'am, Northern District, IL (On-site)

NVIDIA is hiring exceptional software engineers to build and optimize the core inference infrastructure for large language models.

Shanghai, CN (On-site)

NVIDIA has continuously reinvented itself over two decades.

San Francisco, California, US (On-site)

$300–350K / year

About Us: AI needs a new infrastructure layer.

Santa Clara, California, US (Hybrid)

$184–356.5K / year

At NVIDIA, we aren't just powering the AI revolution—we're accelerating it.

US (On-site)

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.

San Francisco, California, US (On-site)

$270–300K / year

About the role As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to our most…

Santa Clara, California, US (On-site)

$152–241.5K / year

NVIDIA's invention of the GPU 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing.

San Francisco, California, US (On-site)

$170–265K / year

Perplexity is looking for a technical program manager to be the connective tissue between our model providers, engineering, and product teams,…

San Francisco, California, US (Hybrid)

$350–850K / year

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.

Sunnyvale, California, US (Hybrid)

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.

Toronto, Ontario, CA (Hybrid)

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.

San Francisco, California, US (On-site)

$220–485K / year

We build and run the inference engine behind every Perplexity query and deploy dozens of model architectures at scale with tight latency and cost budgets.

San Francisco, California, US (On-site)

$215–260K / year

Crusoe is on a mission to accelerate the abundance of energy and intelligence .

Santa Clara, California, US (On-site)

$272–431.3K / year

NVIDIA Dynamo is a high-throughput, low-latency inference framework for serving generative AI and reasoning models across multi-node distributed environments.