Home
Jobs
Canada
Ontario
Toronto
AI Infrastructure

AI Infrastructure Jobs in Toronto, Ontario, Canada

Browse 80 AI Infrastructure jobs in Toronto, Ontario, Canada on Inference Jobs.

80 jobs

3 wk. ago

TE

Infrastructure and Platform Development Engineer

Tenstorrent

Toronto, Ontario, Canada (Hybrid)$100–500K Yearly

Infrastructure Engineering

DevOps

Kubernetes

Python

3 wk. ago

CO

Member of Technical Staff - Sovereign AI

Cohere

Toronto, Ontario, Canada (Hybrid)

Machine Learning Engineer

AI Research Scientist

Python

ML Frameworks

21 hr. ago NVIDIA logo

NV

Senior Software Engineer, AI Inference Systems

NVIDIA

Toronto, Ontario, Canada (Hybrid)CA$170–275K Yearly

AI/ML Infrastructure Engineering

GPU Computing

Python

C/C++

2 wk. ago

CO

Enterprise Account Manager

CoreWeave

Toronto, Ontario, Canada (On-site)CA$165–242K Yearly

Enterprise Account Management

B2B Sales

Cloud Infrastructure

SaaS Sales

3 wk. ago

CE

Senior Software Development Engineer in Test (SDET) - AI Cluster

Cerebras

Toronto, Ontario, Canada (Hybrid)

SDET

QA Automation Engineer

Python

Golang

3 wk. ago

CE

ML Performance Benchmarking Engineer

Cerebras

Toronto, Ontario, Canada (Hybrid)

Performance Engineering

ML Infrastructure

Python

C++

3 wk. ago

TE

Sr. Network Engineer

Tenstorrent

Toronto, Ontario, Canada (Hybrid)CA$100–500K Yearly

Network Engineering

Data Center Networking

Layer 2/Layer 3 Networking

BGP

3 wk. ago

CE

Software Engineer - New Grad 2026

Cerebras

Toronto, Ontario, Canada (Hybrid)

3 wk. ago

CE

Staff Software Engineer, GPU Inference

Cerebras

Toronto, Ontario, Canada (Hybrid)

GPU Inference Engineering

AI Infrastructure Engineering

C++

Python

1 wk. ago

NV

DL Performance Software Engineer - LLM Inference

NVIDIA

Toronto, Ontario, Canada (Hybrid)CA$135–220K Yearly

DL Performance Engineering

LLM Inference Engineering

Python

C++

3 wk. ago

CE

Full Stack LLM Engineer

Cerebras

Toronto, Ontario, Canada (Hybrid)

Full-Stack LLM Engineer

Software Engineer

Python

PyTorch

2 wk. ago

RA

AI Compute and Infrastructure Counsel (Legal)

Reflection AI

Worldwide (Remote)

Legal Counsel

Infrastructure Legal

Cloud Capacity Agreements

Hardware Partnerships

1 wk. ago

CO

Global Public Policy Manager, Compute, Infrastructure & Sovereign AI

Cohere

United States + 1 more (Remote)$190–230K Yearly

Public Policy Manager

Government Relations

Public Policy

Technology Policy

2 wk. ago

BA

Technical Program Manager, Infrastructure

Baseten

Worldwide (Remote)$165–330K Yearly

Technical Program Management

Infrastructure Program Management

Technical Program Management

Infrastructure Management

3 wk. ago

NV

Senior AI Compute Engineer

NVIDIA

Worldwide (Remote)€66–149.5K Yearly

AI Infrastructure Engineering

AI Compute Engineering

GPU

Deep Learning

2 days ago NVIDIA logo

NV

Solutions Architect - NVIDIA Cloud Partners and Datacentre Infrastructure

NVIDIA

Worldwide (Remote)

Solutions Architecture

Datacentre Infrastructure Engineering

Solutions Architecture

Datacentre Infrastructure

2 wk. ago

NE

Field CTO – Retail & Commerce AI

Nebius

Worldwide (Remote)

5 days ago NVIDIA logo

NV

Senior DGX Cloud AI Infrastructure Software Engineer

NVIDIA

Worldwide (Remote)$184–356.5K Yearly

AI Infrastructure Engineer

Software Engineer

Python

C/C++

2 wk. ago

CO

Engineering Manager, FDE Infrastructure (NORAM)

Cohere

North America (Remote)

Engineering Management

Infrastructure Engineering

Cloud Infrastructure

Azure

1 wk. ago

OP

Software Engineer, GPU Infrastructure- ChatGPT Engineering

OpenAI

Worldwide (Remote)

Applied AI Engineering

GPU Infrastructure Engineering

GPU Infrastructure

Kubernetes