Viewpoint
First-principles estimates are a valuable engineering skill
First-principles estimates are a valuable engineering skill
Dean emphasizes back-of-the-envelope calculations for evaluating whether proposed technical approaches are feasible and for comparing their likely performance before implementation.
- Speaker
- Jeff Dean
- Source timestamp
- 24:22
More from this interview
- Sparse experts can combine large capacity with computational efficiency
- Large efficiency gains signaled mixture-of-experts would matter
- Scaling neural networks produced major gains across several fields
- Deep learning unified previously separate technical disciplines
- Machine learning frameworks should abstract away computing infrastructure
- TensorFlow should have adopted eager execution earlier
- TensorFlow contrib created unnecessary fragmentation for users
- Gemini benefited from being multimodal from its beginning
- Improving coding can strengthen broader reasoning capabilities
- Broad exposure helps researchers connect previously separate ideas
- Ambitious research should combine tractability with unresolved challenges
- Trying uncertain ideas is part of successful research
- Agentic AI brings benefits alongside growing security risks
- Autonomous cyber behavior could create substantially greater harm
- AI cybersecurity capabilities strengthen both attackers and defenders
- Some AI risks may require legal and regulatory responses
- Machine learning improving machine learning is not a new concept
- Automated loops could improve many components of model development
- Scientific discovery can be organized as iterative feedback loops
- Discovery Loop aims to automate science and engineering workflows
- Multidisciplinary models could coordinate complex scientific problem solving
- Faster parallel experimentation could improve discovery quality
- Scientific discoveries should be distributed for broad societal benefit
- A small focused company can concentrate on one mission
- Large platforms can amplify the impact of AI technology