Home
Jobs
United States
New York
ML Infrastructure

ML Infrastructure Jobs in New York, United States

Browse 89 ML Infrastructure jobs in New York, United States on Inference Jobs.

89 jobs

3 wk. ago

MO

Member of Technical Staff - ML Performance

Modal

New York, United States (On-site)$150–350K Yearly

Engineering

Machine Learning Engineer

PyTorch

vLLM

3 wk. ago

MO

Forward Deployed ML Engineer

Modal

New York, United States (On-site)$180–250K Yearly

Forward Deployed Engineer

Machine Learning Engineer

Machine Learning

MLOps

3 days ago Mirage logo

MI

Software Engineer, ML Products

Mirage

Manhattan, New York, New York, United States (On-site)$175–275K Yearly

Machine Learning Engineering

Software Engineering

Machine Learning

Agentic Systems

3 wk. ago

SC

Product Manager, Enterprise Core Platform

Scale

New York, United States (On-site)$205.6–300K Yearly

Platform Product Management

Technical Product Management

Platform Product Management

AI/ML Infrastructure

22 hr. ago CoreWeave logo

CO

Director of Product Marketing, Agentic AI

CoreWeave

New York, United States (On-site)$198–264K Yearly

Product Marketing Director

AI Product Marketing

Product Marketing

Go-to-Market Strategy

3 wk. ago

CO

Vice President, Americas Sales

CoreWeave

New York, United States (Hybrid)$310–345K Yearly

VP of Sales

Americas Sales Leadership

AI Infrastructure

Cloud Infrastructure

2 wk. ago

MO

Member of Technical Staff - Inference Research

Modal

New York, United States (On-site)$150–350K Yearly

Engineering

ML Infrastructure Engineering

LLM Inference

Speculative Decoding

1 wk. ago

CR

Enterprise Account Executive

Crusoe

New York, United States (On-site)$300–400K Yearly

Enterprise Account Executive

Cloud Go-To-Market (GTM)

Enterprise Sales

AI/ML Cloud Solutions

3 wk. ago

PI

Technical Product Marketing Manager

Pinecone

New York, New York, United States (On-site)$126–145K Yearly

Technical Marketing Manager

Product Marketing

AI/ML

Vector Search

3 wk. ago

MO

Member of Technical Staff - Python SDK

Modal

New York, United States (On-site)$150–350K Yearly

3 wk. ago

CO

Director, Deal Strategy & Execution

CoreWeave

New York, United States (On-site)$165–242K Yearly

Deal Strategy

Deal Desk

Sales Operations

3 days ago Scale logo

SC

Senior Software Engineer, Full-Stack - Enterprise Gen AI

Scale

New York, United States (On-site)$248.4–310.5K Yearly

Full-Stack Development

Software Engineering

Next.js

React

2 wk. ago

MO

Member of Technical Staff - Post-Training Research

Modal

New York, United States (On-site)$150–350K Yearly

ML Research

LLM Post-Training Research

LLM Post-Training

Reinforcement Learning

7 days ago Mirage logo

MI

Research Engineer, Generative Video

Mirage

New York, United States (On-site)$175–275K Yearly

Research Engineering

ML Engineering

Deep Learning Systems

PyTorch

4 wk. ago

CU

Software Engineer, Model Routing & Inference

Cursor

New York, United States (On-site)

2 wk. ago

OP

Software Engineer, Monetization ML Infrastructure

OpenAI

Worldwide (Remote)$293–441K Yearly

Machine Learning Infrastructure Engineering

ML Platform Engineer

Machine Learning Infrastructure

Distributed Systems

2 days ago SambaNova logo

SA

Senior Software Engineer, ML Infrastructure

SambaNova

United States (Remote)$200–275K Yearly

2 wk. ago

CO

Senior Software Engineer, Agent Infrastructure

Cohere

Worldwide (Remote)

3 days ago Nebius logo

NE

ML Infrastructure Engineer

Nebius

Europe + 1 more (Remote)

ML Infrastructure Engineering

GPU Engineering

GPU

CUDA

4 wk. ago

CO

Senior Technical Program Manager, Machine Learning Infrastructure

Cohere

Worldwide (Remote)

Technical Program Management

Engineering Program Management

Technical Program Management

Machine Learning Infrastructure