AI Inference Jobs in New York, United States

Browse 66 AI Inference jobs in New York, United States on Inference Jobs.

66 jobs

1 wk. ago

CR

Senior Customer Success Manager, Managed Inference

Crusoe

New York, United States (On-site)$190–215K Yearly

Customer Success Management

Technical Account Management

Cloud Computing

Artificial Intelligence

24 hr. ago CoreWeave logo

CO

Director of Product Marketing, Agentic AI

CoreWeave

New York, United States (On-site)$198–264K Yearly

Product Marketing Director

AI Product Marketing

Product Marketing

Go-to-Market Strategy

3 wk. ago

CO

Business Development Manager- Physical AI

CoreWeave

New York, United States (On-site)$115–168K Yearly

Business Development Manager

Strategic Partnerships

NVIDIA Physical AI Ecosystem

Omniverse

1 wk. ago

MA

Engineering Lead, Inference

Mistral AI

New York, United States (Hybrid)

Engineering Leadership

API Engineering

Python

FastAPI

2 wk. ago

AN

Data Scientist, Platform Product

Anthropic

New York, New York, United States (Hybrid)$275–370K Yearly

Platform Product Analytics

Data Science & Analytics

Python

SQL

2 days ago LangChain logo

LA

Research Engineer, LangSmith Engine

LangChain

New York, United States (On-site)

Research Engineering

Machine Learning Engineering

LLMs

AI Agents

3 wk. ago

MO

ML Research Intern

Modal

New York, United States (On-site)$15K Monthly

ML Research

AI Research

Reinforcement Learning

Machine Learning

3 wk. ago

RA

Forward Deployed Engineer Lead

Reflection AI

New York, New York, United States (On-site)

Applied AI

Post-Training Engineering

Large Language Models

Reinforcement Learning Training

3 wk. ago

RA

Member of Technical Staff - Research Software Engineer - Safety Evaluations Infrastructure

Reflection AI

New York, New York, United States (On-site)

Research Software Engineer

Platform Engineering

Python

Containerization

3 wk. ago

MO

Member of Technical Staff - ML Performance

Modal

New York, United States (On-site)$150–350K Yearly

Engineering

Machine Learning Engineer

PyTorch

vLLM

2 wk. ago

MO

Member of Technical Staff - Post-Training Research

Modal

New York, United States (On-site)$150–350K Yearly

ML Research

LLM Post-Training Research

LLM Post-Training

Reinforcement Learning

2 wk. ago

TA

Technical Support Engineer (Inference) - US Weekends

Together AI

United States (Remote)$160–230K Yearly

Technical Support Engineering

Customer Success

Kubernetes

Python

3 wk. ago

CO

Sr. Engineering Manager, Inference

CoreWeave

United States (Remote)$188–303K Yearly

Engineering Management

AI/ML Platform Engineering

AI/ML Platform

Inference

2 wk. ago

D-

Principal LLM Inference Engineer

d-Matrix

United States (Remote)$195–285K Yearly

LLM Inference Engineering

AI Infrastructure Engineer

Python

C/C++

4 wk. ago

NV

Senior Compiler Engineer, AI Inference Platforms

NVIDIA

Santa Clara, California, US or Remote (United States)$152–241.5K Yearly

3 wk. ago

BA

Software Engineer - Voice AI (Inference Runtime)

Baseten

United States (Remote)$165–330K Yearly

Voice AI Engineering

ML Infrastructure Engineering

Python

STT (Speech-to-Text)

6 days ago NVIDIA logo

NV

Engineering Manager, Inference Benchmarking — AI Perf

NVIDIA

Worldwide (Remote)$224–356.5K Yearly

Engineering Management

Performance Engineering

LLM Inference

vLLM

3 wk. ago

CO

Audio Inference Engineer, Model Efficiency

Cohere

New York, US or Remote (Canada + 4 more)

AI Infrastructure

Machine Learning Engineer

C++

Python

4 wk. ago

NV

Distinguished Engineer - Dynamo

NVIDIA

United States (Remote)$320–488.8K Yearly

AI Infrastructure

Machine Learning Infrastructure

AI Inference

Rust

3 wk. ago

NV

Senior Deep Learning Performance Architect - LPU

NVIDIA

United States (Remote)$152–287.5K Yearly

Deep Learning Performance Architect

AI Inference

C++

Python