Home
Jobs
United States
New York
AI Infrastructure

AI Infrastructure Jobs in New York, United States

Browse 221 AI Infrastructure jobs in New York, United States on Inference Jobs.

221 jobs

3 days ago Scale logo

SC

Staff Infrastructure Software Engineer, Enterprise AI

Scale

New York, United States (On-site)$252–315K Yearly

Infrastructure Engineering

DevOps

Kubernetes

Terraform

1 day ago

CO

Director of Product Marketing, Agentic AI

CoreWeave

New York, United States (On-site)$198–264K Yearly

Product Marketing Director

AI Product Marketing

Product Marketing

Go-to-Market Strategy

3 wk. ago

RA

Member of Technical Staff - Research Software Engineer - Safety Evaluations Infrastructure

Reflection AI

New York, New York, United States (On-site)

Research Software Engineer

Platform Engineering

Python

Containerization

3 wk. ago

CO

Business Development Manager- Physical AI

CoreWeave

New York, United States (On-site)$115–168K Yearly

Business Development Manager

Strategic Partnerships

NVIDIA Physical AI Ecosystem

Omniverse

3 wk. ago

CO

Vice President, Americas Sales

CoreWeave

New York, United States (Hybrid)$310–345K Yearly

VP of Sales

Americas Sales Leadership

AI Infrastructure

Cloud Infrastructure

4 wk. ago

SC

Software Engineer, Data Infrastructure

Scale

New York, United States (On-site)$216–300K Yearly

Public Sector Engineering

Data Infrastructure Engineering

Rust

Go

3 days ago Modal logo

MO

Systems Engineering Manager

Modal

New York, United States (On-site)$250–350K Yearly

Engineering

Engineering Management

Cloud Infrastructure

Distributed Systems

3 days ago Scale logo

SC

Senior Software Engineer, Full-Stack - Enterprise Gen AI

Scale

New York, United States (On-site)$248.4–310.5K Yearly

Full-Stack Development

Software Engineering

Next.js

React

3 wk. ago

MO

Compute Strategy & Operations Lead

Modal

New York, United States (On-site)$200–300K Yearly

Compute Strategy

Infrastructure Operations

GPU Procurement

CPU Procurement

3 wk. ago

CR

Senior Staff Solutions Engineer (NYC)

Crusoe

New York, United States (On-site)$175–250K Yearly

Solutions Engineering

Cloud Infrastructure Engineering

Kubernetes

MLOps

2 wk. ago

PI

Senior/Staff Software Engineer, Search & Retrieval Infrastructure

Pinecone

New York, New York, United States (Hybrid)$190–270K Yearly

3 wk. ago

SC

Product Manager, Enterprise Core Platform

Scale

New York, United States (On-site)$205.6–300K Yearly

Platform Product Management

Technical Product Management

Platform Product Management

AI/ML Infrastructure

3 wk. ago

LA

Product Manager, LangSmith

LangChain

New York, United States (On-site)$180–215K Yearly

Product Management

Technical Product Management

Product Management

SaaS

2 wk. ago

DE

Engineering Lead, Strategic Deals

Decagon

New York, United States (On-site)$200–400K Yearly

Engineering Leadership

Technical Program Management

Software Engineering

Technical Leadership

1 wk. ago

CR

Senior Customer Success Manager, Managed Inference

Crusoe

New York, United States (On-site)$190–215K Yearly

Customer Success Management

Technical Account Management

Cloud Computing

Artificial Intelligence

3 days ago LangChain logo

LA

Research Engineer, LangSmith Engine

LangChain

New York, United States (On-site)

Research Engineering

Machine Learning Engineering

LLMs

AI Agents

7 days ago Reflection AI logo

RA

Member of Technical Staff - Platform Foundations

Reflection AI

New York, New York, United States (On-site)

Platform Engineering

Infrastructure Engineering

Cloud Infrastructure

Kubernetes

3 days ago Decagon logo

DE

Senior Software Engineer, Agent Orchestration

Decagon

New York, United States (On-site)$200–400K Yearly

3 wk. ago

RA

Forward Deployed Engineer Lead

Reflection AI

New York, New York, United States (On-site)

Applied AI

Post-Training Engineering

Large Language Models

Reinforcement Learning Training

3 wk. ago

BA

Sales Manager - Emerging

Baseten

New York, United States (Hybrid)$300–340K Yearly

Sales Management

Sales Leadership

Sales Management

Account Executive Management