Home
Jobs
United States
New York
GPU Infrastructure

GPU Infrastructure Jobs in New York, United States

Browse 129 GPU Infrastructure jobs in New York, United States on Inference Jobs.

129 jobs

3 wk. ago

MO

Compute Strategy & Operations Lead

Modal

New York, United States (On-site)$200–300K Yearly

Compute Strategy

Infrastructure Operations

GPU Procurement

CPU Procurement

2 wk. ago

CR

Senior Staff Solutions Engineer (NYC)

Crusoe

New York, United States (On-site)$175–250K Yearly

Solutions Engineering

Cloud Infrastructure Engineering

Kubernetes

MLOps

3 wk. ago

CO

Staff Software Engineer

CoreWeave

Manhattan, New York, New York, United States (On-site)$188–275K Yearly

Software Engineering

Infrastructure Engineering

Go

Kubernetes

1 wk. ago

MO

Member of Technical Staff - Inference Research

Modal

New York, United States (On-site)$150–350K Yearly

Engineering

ML Infrastructure Engineering

LLM Inference

Speculative Decoding

1 wk. ago

CR

Senior Customer Success Manager, Managed Inference

Crusoe

New York, United States (On-site)$190–215K Yearly

Customer Success Management

Technical Account Management

Cloud Computing

Artificial Intelligence

3 wk. ago

MO

Forward Deployed ML Engineer

Modal

New York, United States (On-site)$180–250K Yearly

Forward Deployed Engineer

Machine Learning Engineer

Machine Learning

MLOps

2 days ago Reflection AI logo

RA

Member of Technical Staff - Compute Platform Lead

Reflection AI

New York, United States (On-site)

Infrastructure Engineering

Platform Engineering

Kubernetes

Multi-cloud Scheduling

1 day ago

RA

Member of Technical Staff - Research Software Engineer

Reflection AI

New York, United States (On-site)

Machine Learning Engineer

Research Software Engineer

PyTorch

JAX

1 day ago

RA

Member of Technical Staff - Compute Platform

Reflection AI

New York, United States (On-site)

3 wk. ago

CU

Software Engineer, Model Routing & Inference

Cursor

New York, United States (On-site)

1 wk. ago

MO

Member of Technical Staff - Post-Training Research

Modal

New York, United States (On-site)$150–350K Yearly

ML Research

LLM Post-Training Research

LLM Post-Training

Reinforcement Learning

2 wk. ago

NE

Head of Forward Deployment Engineering - Tavily

Nebius

New York, New York, United States (Hybrid)$230–310K Yearly

Forward Deployed Engineering

Solutions Engineering

Python

APIs

3 wk. ago

MO

Member of Technical Staff - Systems

Modal

New York, United States (On-site)$200–350K Yearly

1 wk. ago

CO

Staff Software Engineer, IAM

CoreWeave

New York, United States (On-site)$188–275K Yearly

Identity and Access Management (IAM)

Staff Software Engineering

Go

TypeScript

3 wk. ago

RA

Forward Deployed Engineer Lead

Reflection AI

New York, New York, United States (On-site)

Applied AI

Post-Training Engineering

Large Language Models

Reinforcement Learning Training

5 days ago CoreWeave logo

CO

Staff Storage Engineer, File & Block

CoreWeave

New York, United States (On-site)$207–303K Yearly

Storage Engineering

Infrastructure Engineering

RDMA

GPU Direct Storage

3 wk. ago

MO

Support Engineer

Modal

New York, United States (On-site)$150–220K Yearly

1 day ago

LA

Research Engineer, LangSmith Engine

LangChain

New York, United States (On-site)

Research Engineering

Machine Learning Engineering

LLMs

AI Agents

5 days ago Mirage logo

MI

Research Engineer, Generative Video

Mirage

New York, United States (On-site)$175–275K Yearly

Research Engineering

ML Engineering

Deep Learning Systems

PyTorch

1 wk. ago

OP

Software Engineer, GPU Infrastructure- ChatGPT Engineering

OpenAI

Worldwide (Remote)

Applied AI Engineering

GPU Infrastructure Engineering

GPU Infrastructure

Kubernetes