Topic

Local vs Cloud Inference

Latest viewpoints

Local models route most inference on-device for energy and cost savings.

Recent improvements in local open-source models and consumer accelerators allow 80-90% of inference queries to be routed on-device, yielding significant energy and cost savings, though data center accelerators still lead in raw efficiency per watt.

Jon Saad-Falcon Local vs Cloud Inference Source at 21:28

Leaders

Jensen Huang

CEO, Nvidia

Last interview Sep 2, 2026

Howard Lutnick

Public business viewpoint profile

Last interview Sep 2, 2026

Sam Altman

CEO, OpenAI

Last interview Sep 2, 2026

Elon Musk

CEO, SpaceX / Tesla

Last interview Sep 1, 2026

Julien Bek

Partner, Sequoia Capital

Last interview Aug 24, 2026

Thibault Sottiaux

Engineer, OpenAI

Last interview Aug 24, 2026

Matthew Berman

Influencer, Forward Future

Last interview Aug 24, 2026

David Senra

Podcaster, Senra Show

Last interview Aug 23, 2026

LeAnn Foster

Founder, EUTHENICS

Last interview Aug 22, 2026

Eric Ho

CEO, Goodfire

Last interview Aug 21, 2026