119 LLM Inference Engineer jobs

Santa Clara, California, US (Hybrid)

$195–285K / year

At d-Matrix , we are focused on unleashing the potential of generative AI to power the transformation of technology.

Menlo Park, California, US (On-site)

Role Mission As HAI's LLM Inference Engineer, you will own the serving infrastructure that determines whether our breakthrough healthcare AI reaches…

Menlo Park, California, US (On-site)

ABOUT THE ROLE We’re seeking an inference systems engineer to build the distributed serving and high-performance networking layer behind our large…

Tel Aviv-Yafo, Tel Aviv District, IL (On-site)

We are seeking a Deep Learning Research Engineer to join our team and help develop the next generation of Large Language Model (LLM) inference algorithms.

Palo Alto, California, US (On-site)

$195.2–262.2K / year

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

Tel Aviv-Yafo, Tel Aviv District, IL (On-site)

NVIDIA has been at the forefront of the deep learning revolution, pioneering innovations that have transformed the entire field.

Shanghai, CN (On-site)

We are now looking for a Software Development Engineer to help TensorRT LLM and TensorRT Edge LLM projects!

London, England, GB (On-site)

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

Europe (Remote)

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

Zürich, CH (On-site)

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

Yokne'am, Northern District, IL (On-site)

NVIDIA is hiring exceptional software engineers to build and optimize the core inference infrastructure for large language models.

Shanghai, CN (On-site)

NVIDIA has continuously reinvented itself over two decades.

New York, US (On-site)

$150–350K / year

About Us: AI needs a new infrastructure layer.

Amsterdam, North Holland, NL (On-site)

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

London, England, GB (On-site)

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy.

US (On-site)

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.

San Francisco, California, US (On-site)

$270–300K / year

About the role As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to our most…

Santa Clara, California, US (On-site)

$152–241.5K / year

NVIDIA's invention of the GPU 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing.

United States (Remote)

$150–220K / year

Runpod is the AI Developer Cloud.

San Francisco, California, US (Hybrid)

$350–850K / year

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.