Home
Jobs
United States
Virginia
Herndon
TensorRT-LLM

TensorRT-LLM Jobs in Herndon, Virginia, United States

Browse 36 TensorRT-LLM jobs in Herndon, Virginia, United States on Inference Jobs.

36 jobs

2 wk. ago

D-

Principal LLM Inference Engineer

d-Matrix

United States (Remote)$195–285K Yearly

LLM Inference Engineering

AI Infrastructure Engineer

Python

C/C++

3 wk. ago

Software Engineer - Model Performance

Baseten

San Francisco, California, US or Remote (Worldwide)$180–360K Yearly

Software Engineering

Machine Learning Engineering

Python

C++

10 hr. ago Nebius logo

Senior ML Solutions Architect - Token Factory

Nebius

US or Remote (United States)$210–260K Yearly

Solutions Architecture

Machine Learning

Python

LLMs

2 wk. ago

Principal ML Solutions Architect - Token Factory

Nebius

United States (Remote)$208–261K Yearly

Principal Solutions Architect

ML Solutions Architect

Python

vLLM

2 wk. ago

Software Engineer- BIS (Baseten Inference Stack)

Baseten

United States (Remote)$180–360K Yearly

Software Engineering

Infrastructure Engineering

Distributed Systems

Kubernetes

7 days ago NVIDIA logo

Senior Solutions Architect, NVIDIA Cloud Partners

NVIDIA

Santa Clara, California, US or Remote (United States)$184–287.5K Yearly

7 days ago NVIDIA logo

Senior Solutions Architect, Generative AI Deployment and AIOps

NVIDIA

United States (Remote)$184–287.5K Yearly

Solutions Architecture

AI Engineering

Generative AI

Large Language Models (LLMs)

2 wk. ago

Forward Deployed Engineer, Ecosystem

Nebius

US or Remote (United States)$208.8–261K Yearly

Forward Deployed Engineering

Technical Partner Engineering

Python

vLLM

3 wk. ago

Engineering Manager - Forward Deployed Engineering (LLM)

Baseten

San Francisco, California, US or Remote (Worldwide)$260–380K Yearly

Engineering Management

Forward Deployed Engineering

Python

LLMs

7 days ago NVIDIA logo

Senior Deep Learning Frameworks CUDA Software Engineer

NVIDIA

Santa Clara, California, US or Remote (United States)$224–356.5K Yearly

Deep Learning Frameworks Engineering

CUDA Software Engineering

CUDA

PyTorch

3 wk. ago

AI and FSI Developer Technology Engineer - New College Grad 2026

NVIDIA

United States (Remote)$124–195.5K Yearly

AI Developer Technology Engineer

GPU Computing

CUDA

C/C++

3 days ago Nebius logo

Senior Sales Engineer

Nebius

United States (Remote)$152–228K Yearly

Sales Engineering

Solutions Engineering

AI Inference

GPU Computing

7 days ago NVIDIA logo

Solutions Architect - MedTech

NVIDIA

United States (Remote)$152–287.5K Yearly

Solutions Architecture

MedTech

C/C++

Python

3 days ago NVIDIA logo

Senior Manager, Software Engineering - NIM Factory

NVIDIA

United States (Remote)$272–431.3K Yearly

Senior Engineering Manager

Software Engineering Management

Python

Kubernetes

3 days ago SambaNova logo

Senior Software Engineer, ML Infrastructure

SambaNova

United States (Remote)$200–275K Yearly

3 wk. ago

Senior Software Architect, AI Systems and Networking

NVIDIA

United States (Remote)$224–431.3K Yearly

Software Architecture

AI Systems Engineering

C++

Rust

3 days ago Baseten logo

Software Engineer — GPU Networking & Distributed Systems

Baseten

San Francisco, California, US or Remote (Worldwide)$165–330K Yearly

7 days ago NVIDIA logo

Engineering Manager, Inference Benchmarking — AI Perf

NVIDIA

Worldwide (Remote)$224–356.5K Yearly

Engineering Management

Performance Engineering

LLM Inference

vLLM

3 days ago Nebius logo

ML Infrastructure Engineer

Nebius

Europe + 1 more (Remote)

ML Infrastructure Engineering

GPU Engineering

GPU

CUDA

6 days ago NVIDIA logo

Software Engineer, DGX Cloud AI Infrastructure

NVIDIA

United States (Remote)$140–224.3K Yearly

AI Infrastructure Engineering

Distributed Systems Engineering

PyTorch

NeMo

Jobs on Inference Jobs

Browse jobs on Inference Jobs.

JobsAI-ranked

Inference Jobs

Discover the latest AI roles from Inference Jobs.

Powered byCavuno

For Candidates

Jobs
Companies

For Companies

Post a job
Pricing

Resources

Locations
Salaries
Sitemap

About

About