Sign in Post a job Sign up

Home
Jobs

Jobs on Inference Jobs

Browse jobs on Inference Jobs.

JobsAI-ranked

Related Searches

Inference Jobs

Discover the latest AI roles from Inference Jobs.

Powered byCavuno

For Candidates

Jobs
Companies

For Companies

Post a job
Pricing

Resources

Locations
Salaries
Sitemap

About

About

© 2026 Inference Jobs. All rights reserved.

Terms of Service Privacy Policy Cookie Policy

32 LLM Inference jobs in New York, United States | Inference Jobs

Home
Jobs
United States
New York
LLM Inference

LLM Inference Jobs in New York, United States

Browse 32 LLM Inference jobs in New York, United States on Inference Jobs.

32 jobs

2 wk. ago

MO

Member of Technical Staff - Inference Research

Modal

New York, United States (On-site)$150–350K Yearly

ML Infrastructure Engineering

Speculative Decoding

2 wk. ago

MO

Member of Technical Staff - Post-Training Research

Modal

New York, United States (On-site)$150–350K Yearly

LLM Post-Training Research

LLM Post-Training

Reinforcement Learning

3 wk. ago

MO

Forward Deployed ML Engineer

Modal

New York, United States (On-site)$180–250K Yearly

Forward Deployed Engineer

Machine Learning Engineer

Machine Learning

2 days ago LangChain logo

LA

Research Engineer, LangSmith Engine

LangChain

New York, United States (On-site)

Research Engineering

Machine Learning Engineering

2 wk. ago

D-

Principal LLM Inference Engineer

d-Matrix

United States (Remote)$195–285K Yearly

LLM Inference Engineering

AI Infrastructure Engineer

2 wk. ago

BA

Software Engineer- BIS (Baseten Inference Stack)

Baseten

United States (Remote)$180–360K Yearly

Software Engineering

Infrastructure Engineering

Distributed Systems

2 wk. ago

TA

Technical Support Engineer (Inference) - US Weekends

Together AI

United States (Remote)$160–230K Yearly

Technical Support Engineering

Customer Success

3 wk. ago

BA

Software Engineer - Model Performance

Baseten

San Francisco, California, US or Remote (Worldwide)$180–360K Yearly

Software Engineering

Machine Learning Engineering

7 days ago NVIDIA logo

NV

Engineering Manager, Inference Benchmarking — AI Perf

NVIDIA

Worldwide (Remote)$224–356.5K Yearly

Engineering Management

Performance Engineering

3 wk. ago

CO

Audio Inference Engineer, Model Efficiency

Cohere

New York, US or Remote (Canada + 4 more)

AI Infrastructure

Machine Learning Engineer

3 days ago SambaNova logo

SA

Senior Software Engineer, ML Infrastructure

SambaNova

United States (Remote)$200–275K Yearly

Software Engineering

ML Infrastructure

2 wk. ago

NE

Principal ML Solutions Architect - Token Factory

Nebius

United States (Remote)$208–261K Yearly

Principal Solutions Architect

ML Solutions Architect

4 days ago OpenRouter logo

OP

Research Scientist

OpenRouter

United States (Remote)

Research Scientist

3 wk. ago

NV

Principal Deep Learning Algorithm Engineer

NVIDIA

United States (Remote)$272–431.3K Yearly

Deep Learning Engineering

AI/ML Engineering

3 wk. ago

CO

Staff Research Engineer, Model Efficiency

Cohere

New York, US or Remote (Worldwide)

Machine Learning

Machine Learning

Model Architecture

3 wk. ago

BA

Engineering Manager - Forward Deployed Engineering (LLM)

Baseten

San Francisco, California, US or Remote (Worldwide)$260–380K Yearly

Engineering Management

Forward Deployed Engineering

3 wk. ago

BA

Manager, Solutions Architect

Baseten

Worldwide (Remote)$165–330K Yearly

Solution Architecture

Solutions Engineering

3 days ago Nebius logo

NE

Senior Sales Engineer

Nebius

United States (Remote)$152–228K Yearly

Sales Engineering

Solutions Engineering

4 wk. ago

NV

Developer Relations Manager – AI Natives

NVIDIA

United States (Remote)$152–287.5K Yearly

Developer Relations

Developer Advocacy

3 days ago NVIDIA logo

NV

Senior Manager, Software Engineering - NIM Factory

NVIDIA

United States (Remote)$272–431.3K Yearly

Senior Engineering Manager

Software Engineering Management

Previous
1
2
Next

Related Searches

Inference Optimization

Software Engineering

Distributed Systems

Machine Learning

Speculative Decoding

Subscribe to this search

Get email updates when new jobs match this search.

Email address