Topic

Mixture of Experts

Latest viewpoints

Sparse experts can combine large capacity with computational efficiency

Dean says mixture-of-experts architectures allow models to maintain very large capacity while activating only the components most useful for a particular token or request, improving efficiency over dense models.

Jeff Dean Mixture of Experts Source at 7:00

Large efficiency gains signaled mixture-of-experts would matter

Dean says the researchers recognized mixture-of-experts as an important idea because experiments showed roughly a tenfold improvement in training-compute-to-quality ratios compared with dense models.

Jeff Dean Mixture of Experts Source at 7:53

Leaders

Jensen Huang

CEO, Nvidia

Last interview Sep 2, 2026

Howard Lutnick

Public business viewpoint profile

Last interview Sep 2, 2026

Sam Altman

CEO, OpenAI

Last interview Sep 2, 2026

Elon Musk

CEO, SpaceX / Tesla

Last interview Sep 1, 2026

Julien Bek

Partner, Sequoia Capital

Last interview Aug 24, 2026

Thibault Sottiaux

Engineer, OpenAI

Last interview Aug 24, 2026

Matthew Berman

Influencer, Forward Future

Last interview Aug 24, 2026

David Senra

Podcaster, Senra Show

Last interview Aug 23, 2026

LeAnn Foster

Founder, EUTHENICS

Last interview Aug 22, 2026

Eric Ho

CEO, Goodfire

Last interview Aug 21, 2026