Topic

Heterogeneous Inference Infrastructure

Latest viewpoints

Specialized systems for inference phases improve interactivity and TCO.

Inference is highly heterogeneous across phases, and co-designing specialized systems for prefill, decode, attention, and MoE kernels can improve interactivity and TCO, though full-stack integration with networking and data center design adds complexity.

Misha Smelyanskiy Heterogeneous Inference Infrastructure Source at 47:04

Leaders

Jensen Huang

CEO, Nvidia

Last interview Sep 2, 2026

Howard Lutnick

Public business viewpoint profile

Last interview Sep 2, 2026

Sam Altman

CEO, OpenAI

Last interview Sep 2, 2026

Elon Musk

CEO, SpaceX / Tesla

Last interview Sep 1, 2026

Julien Bek

Partner, Sequoia Capital

Last interview Aug 24, 2026

Thibault Sottiaux

Engineer, OpenAI

Last interview Aug 24, 2026

Matthew Berman

Influencer, Forward Future

Last interview Aug 24, 2026

David Senra

Podcaster, Senra Show

Last interview Aug 23, 2026

LeAnn Foster

Founder, EUTHENICS

Last interview Aug 22, 2026

Eric Ho

CEO, Goodfire

Last interview Aug 21, 2026