Topic

Production Evals

Latest viewpoints

Evals should closely reflect real production usage

Karanam says evaluation environments should resemble both production use and training environments, with evals drawn directly from how users actually interact with the product.

Arjun Karanam Production Evals Source at 3:56

Agent tasks should be replayable for evaluation

Karanam argues that companies should build infrastructure capable of replaying user tasks so prior interactions can be rolled out again for evaluation and improvement.

Arjun Karanam Production Evals Source at 4:13

Leaders

Jensen Huang

CEO, Nvidia

Last interview Sep 2, 2026

Howard Lutnick

Public business viewpoint profile

Last interview Sep 2, 2026

Sam Altman

CEO, OpenAI

Last interview Sep 2, 2026

Elon Musk

CEO, SpaceX / Tesla

Last interview Sep 1, 2026

Julien Bek

Partner, Sequoia Capital

Last interview Aug 24, 2026

Thibault Sottiaux

Engineer, OpenAI

Last interview Aug 24, 2026

Matthew Berman

Influencer, Forward Future

Last interview Aug 24, 2026

David Senra

Podcaster, Senra Show

Last interview Aug 23, 2026

LeAnn Foster

Founder, EUTHENICS

Last interview Aug 22, 2026

Eric Ho

CEO, Goodfire

Last interview Aug 21, 2026