Inference Jobs in New York, United States

Browse 84 Inference jobs in New York, United States on Inference Jobs.

84 jobs

2 wk. ago

MO

Member of Technical Staff - Inference Research

Modal

New York, United States (On-site)$150–350K Yearly

Engineering

ML Infrastructure Engineering

LLM Inference

Speculative Decoding

4 wk. ago

CU

Software Engineer, Model Routing & Inference

Cursor

New York, United States (On-site)

1 wk. ago

CR

Senior Customer Success Manager, Managed Inference

Crusoe

New York, United States (On-site)$190–215K Yearly

Customer Success Management

Technical Account Management

Cloud Computing

Artificial Intelligence

1 wk. ago

MA

Engineering Lead, Inference

Mistral AI

New York, United States (Hybrid)

Engineering Leadership

API Engineering

Python

FastAPI

3 wk. ago

MO

ML Research Intern

Modal

New York, United States (On-site)$15K Monthly

ML Research

AI Research

Reinforcement Learning

Machine Learning

3 wk. ago

MO

Member of Technical Staff - Product (Backend)

Modal

New York, United States (On-site)$150–300K Yearly

3 wk. ago

MO

Member of Technical Staff - ML Performance

Modal

New York, United States (On-site)$150–350K Yearly

Engineering

Machine Learning Engineer

PyTorch

vLLM

3 wk. ago

MO

Forward Deployed ML Engineer

Modal

New York, United States (On-site)$180–250K Yearly

Forward Deployed Engineer

Machine Learning Engineer

Machine Learning

MLOps

3 wk. ago

CO

Business Development Manager- Physical AI

CoreWeave

New York, United States (On-site)$115–168K Yearly

Business Development Manager

Strategic Partnerships

NVIDIA Physical AI Ecosystem

Omniverse

2 wk. ago

MO

Member of Technical Staff - Post-Training Research

Modal

New York, United States (On-site)$150–350K Yearly

ML Research

LLM Post-Training Research

LLM Post-Training

Reinforcement Learning

2 wk. ago

AN

Data Scientist, GTM

Anthropic

New York, New York, United States (Hybrid)$285–380K Yearly

Data Science

Go-to-Market Analytics

Python

SQL

2 wk. ago

AN

Data Scientist, Platform Product

Anthropic

New York, New York, United States (Hybrid)$275–370K Yearly

Platform Product Analytics

Data Science & Analytics

Python

SQL

12 hr. ago CoreWeave logo

CO

Director of Product Marketing, Agentic AI

CoreWeave

New York, United States (On-site)$198–264K Yearly

Product Marketing Director

AI Product Marketing

Product Marketing

Go-to-Market Strategy

3 wk. ago

RA

Forward Deployed Engineer Lead

Reflection AI

New York, New York, United States (On-site)

Applied AI

Post-Training Engineering

Large Language Models

Reinforcement Learning Training

2 days ago LangChain logo

LA

Research Engineer, LangSmith Engine

LangChain

New York, United States (On-site)

Research Engineering

Machine Learning Engineering

LLMs

AI Agents

3 wk. ago

RA

Member of Technical Staff - Research Software Engineer - Safety Evaluations Infrastructure

Reflection AI

New York, New York, United States (On-site)

Research Software Engineer

Platform Engineering

Python

Containerization

2 wk. ago

D-

Principal LLM Inference Engineer

d-Matrix

United States (Remote)$195–285K Yearly

LLM Inference Engineering

AI Infrastructure Engineer

Python

C/C++

2 wk. ago

BA

Software Engineer- BIS (Baseten Inference Stack)

Baseten

United States (Remote)$180–360K Yearly

Software Engineering

Infrastructure Engineering

Distributed Systems

Kubernetes

3 wk. ago

CO

Sr. Engineering Manager, Inference

CoreWeave

United States (Remote)$188–303K Yearly

Engineering Management

AI/ML Platform Engineering

AI/ML Platform

Inference

3 wk. ago

CO

Staff Software Engineer, Inference Infrastructure

Cohere

San Francisco, California, US or Remote (Canada + 3 more)