ML Infrastructure Jobs in North Carolina, United States

Browse 72 ML Infrastructure jobs in North Carolina, United States on Inference Jobs.

72 jobs

2 wk. ago

OP

Software Engineer, Monetization ML Infrastructure

OpenAI

Worldwide (Remote)$293–441K Yearly

Machine Learning Infrastructure Engineering

ML Platform Engineer

Machine Learning Infrastructure

Distributed Systems

2 days ago SambaNova logo

SA

Senior Software Engineer, ML Infrastructure

SambaNova

United States (Remote)$200–275K Yearly

2 wk. ago

CO

Senior Software Engineer, Agent Infrastructure

Cohere

Worldwide (Remote)

3 days ago Nebius logo

NE

ML Infrastructure Engineer

Nebius

Europe + 1 more (Remote)

ML Infrastructure Engineering

GPU Engineering

GPU

CUDA

4 wk. ago

CO

Senior Technical Program Manager, Machine Learning Infrastructure

Cohere

Worldwide (Remote)

Technical Program Management

Engineering Program Management

Technical Program Management

Machine Learning Infrastructure

2 days ago NVIDIA logo

NV

Senior Software Engineer, AI Performance Analysis

NVIDIA

United States (Remote)$184–356.5K Yearly

AI Performance Engineering

Software Engineering

Python

C++

3 wk. ago

BA

Manager, Solutions Architect

Baseten

Worldwide (Remote)$165–330K Yearly

Solution Architecture

Solutions Engineering

AI/ML

LLM

2 days ago Nebius logo

NE

ML Solution Architect (Early Talent)

Nebius

United States (Remote)$102.00 – $126.00 Hourly

ML Solutions Architect

Machine Learning Engineer

Python

PyTorch

3 wk. ago

NV

Distinguished Engineer - Wireless Infrastructure

NVIDIA

United States (Remote)$320–488.8K Yearly

Wireless Infrastructure Engineering

Telecommunications Engineering

5G NR Physical Layer

MAC-Scheduler

3 wk. ago

NE

Technical Account Manager

Nebius

United States (Remote)$180–225K Yearly

Technical Account Management

Customer Success Engineering

Cloud Infrastructure

Distributed Systems

2 wk. ago

LA

Account CTO

Lambda

United States (Remote)$271–406K Yearly

Account CTO

Technical Account Management

Cloud Infrastructure

AI/ML Technologies

2 days ago NVIDIA logo

NV

Software Engineer, System Validation - EDA Infrastructure

NVIDIA

United States (Remote)$224–356.5K Yearly

3 wk. ago

BA

Senior Software Engineer - Model Training

Baseten

San Francisco, California, US or Remote (Worldwide)$165–330K Yearly

7 days ago NVIDIA logo

NV

Senior Compiler Engineer Infrastructure

NVIDIA

United States (Remote)$152–241.5K Yearly

Compiler Engineering

Compiler Infrastructure

C++

LLVM

3 wk. ago

CO

Sr. Engineering Manager, Inference

CoreWeave

United States (Remote)$188–303K Yearly

Engineering Management

AI/ML Platform Engineering

AI/ML Platform

Inference

6 days ago NVIDIA logo

NV

Senior Solutions Architect, AI Hyperscalers

NVIDIA

Santa Clara, California, US or Remote (United States)$184–356.5K Yearly

Solutions Architecture

AI/ML Engineering

Python

Linux

2 wk. ago

BA

Engineering Manager, Cloud Platform

Baseten

Worldwide (Remote)$165–330K Yearly

Cloud Platform Engineering

Platform Engineering

Kubernetes

Terraform

3 days ago Cohere logo

CO

Member of Technical Staff, Agentic Environments

Cohere

North America, Europe, Middle East, and Africa (Remote)

Machine Learning Engineering

AI Infrastructure Engineering

Python

JAX

2 wk. ago

EL

Infrastructure Security Engineer

ElevenLabs

Worldwide (Remote)

Security Engineering

Infrastructure Security

Python

TypeScript

3 wk. ago

OP

Data Center Compute, OpenHouse Savannah 2026

OpenAI

United States (Remote)$125–400K Yearly

Data Center Engineering

Infrastructure Engineering

Distributed Systems

ML Infrastructure