Home
Jobs
Canada
Ontario
Toronto
AI Infrastructure Engineering

AI Infrastructure Engineering Jobs in Toronto, Ontario, Canada

Browse 61 AI Infrastructure Engineering jobs in Toronto, Ontario, Canada on Inference Jobs.

61 jobs

3 wk. ago

Infrastructure and Platform Development Engineer

Tenstorrent

Toronto, Ontario, Canada (Hybrid)$100–500K Yearly

Infrastructure Engineering

DevOps

Kubernetes

Python

3 wk. ago

Member of Technical Staff - Sovereign AI

Cohere

Toronto, Ontario, Canada (Hybrid)

Machine Learning Engineer

AI Research Scientist

Python

ML Frameworks

3 wk. ago

ML Performance Benchmarking Engineer

Cerebras

Toronto, Ontario, Canada (Hybrid)

Performance Engineering

ML Infrastructure

Python

C++

1 day ago

Senior Software Engineer, AI Inference Systems

NVIDIA

Toronto, Ontario, Canada (Hybrid)CA$170–275K Yearly

AI/ML Infrastructure Engineering

GPU Computing

Python

C/C++

3 wk. ago

Senior Software Development Engineer in Test (SDET) - AI Cluster

Cerebras

Toronto, Ontario, Canada (Hybrid)

SDET

QA Automation Engineer

Python

Golang

3 wk. ago

Software Engineer - New Grad 2026

Cerebras

Toronto, Ontario, Canada (Hybrid)

3 wk. ago

Sr. Network Engineer

Tenstorrent

Toronto, Ontario, Canada (Hybrid)CA$100–500K Yearly

Network Engineering

Data Center Networking

Layer 2/Layer 3 Networking

BGP

3 wk. ago

Staff Software Engineer, GPU Inference

Cerebras

Toronto, Ontario, Canada (Hybrid)

GPU Inference Engineering

AI Infrastructure Engineering

C++

Python

1 wk. ago

DL Performance Software Engineer - LLM Inference

NVIDIA

Toronto, Ontario, Canada (Hybrid)CA$135–220K Yearly

DL Performance Engineering

LLM Inference Engineering

Python

C++

3 wk. ago

Senior AI Compute Engineer

NVIDIA

Worldwide (Remote)€66–149.5K Yearly

AI Infrastructure Engineering

AI Compute Engineering

GPU

Deep Learning

2 wk. ago

Technical Program Manager, Infrastructure

Baseten

Worldwide (Remote)$165–330K Yearly

Technical Program Management

Infrastructure Program Management

Technical Program Management

Infrastructure Management

2 days ago NVIDIA logo

Solutions Architect - NVIDIA Cloud Partners and Datacentre Infrastructure

NVIDIA

Worldwide (Remote)

Solutions Architecture

Datacentre Infrastructure Engineering

Solutions Architecture

Datacentre Infrastructure

1 wk. ago

Software Engineer, GPU Infrastructure- ChatGPT Engineering

OpenAI

Worldwide (Remote)

Applied AI Engineering

GPU Infrastructure Engineering

GPU Infrastructure

Kubernetes

2 wk. ago

Engineering Manager, FDE Infrastructure (NORAM)

Cohere

North America (Remote)

Engineering Management

Infrastructure Engineering

Cloud Infrastructure

Azure

7 hr. ago

Sr. AI Enablement Engineer

Harvey

Worldwide (Remote)$133.5–200.3K Yearly

AI Engineering

Integration Engineering

API Integration

OAuth

1 wk. ago

Security and Infrastructure Engineer

ada

Worldwide (Remote)

Infrastructure Security Engineering

Cloud Security

AWS

Azure

2 days ago OpenAI logo

Engineering Manager, Model Flywheel

OpenAI

Worldwide (Remote)$293–385K Yearly

Applied AI

Applied AI Engineering

Large Language Models

Distributed Infrastructure

3 wk. ago

Software Engineer, ChatGPT Infrastructure

OpenAI

San Francisco, California, US or Remote (Worldwide)$255–405K Yearly

Software Engineering

Infrastructure Engineering

Distributed Systems

System Design

5 days ago NVIDIA logo

Senior Reliability Engineer, DGX Cloud

NVIDIA

Santa Clara, California, US or Remote (Worldwide)$184–287.5K Yearly

Site Reliability Engineering

Reliability Engineering

Python

3 wk. ago

Senior Product Engineer - Training Platform

Baseten

San Francisco, California, US or Remote (Worldwide)$165–330K Yearly

Machine Learning Infrastructure

Distributed Systems Engineering

Kubernetes

PyTorch

Jobs on Inference Jobs

Browse jobs on Inference Jobs.

JobsAI-ranked

Inference Jobs

Discover the latest AI roles from Inference Jobs.

Powered byCavuno

For Candidates

Jobs
Companies

For Companies

Post a job
Pricing

Resources

Locations
Salaries
Sitemap

About

About