Viewpoint
Scientific discovery can be organized as iterative feedback loops
Scientific discovery can be organized as iterative feedback loops
Dean says many scientific and engineering problems share a structure of decomposition, hypothesis generation, implementation, evaluation, and feedback, making them suitable for increasingly automated iterative systems.
- Speaker
- Jeff Dean
- Topic
- Scientific Discovery
- Source timestamp
- 37:24
More from this interview
- Sparse experts can combine large capacity with computational efficiency
- Large efficiency gains signaled mixture-of-experts would matter
- Scaling neural networks produced major gains across several fields
- Deep learning unified previously separate technical disciplines
- Machine learning frameworks should abstract away computing infrastructure
- TensorFlow should have adopted eager execution earlier
- TensorFlow contrib created unnecessary fragmentation for users
- Gemini benefited from being multimodal from its beginning
- Improving coding can strengthen broader reasoning capabilities
- Broad exposure helps researchers connect previously separate ideas
- Ambitious research should combine tractability with unresolved challenges
- First-principles estimates are a valuable engineering skill
- Trying uncertain ideas is part of successful research
- Agentic AI brings benefits alongside growing security risks
- Autonomous cyber behavior could create substantially greater harm
- AI cybersecurity capabilities strengthen both attackers and defenders
- Some AI risks may require legal and regulatory responses
- Machine learning improving machine learning is not a new concept
- Automated loops could improve many components of model development
- Discovery Loop aims to automate science and engineering workflows
- Multidisciplinary models could coordinate complex scientific problem solving
- Faster parallel experimentation could improve discovery quality
- Scientific discoveries should be distributed for broad societal benefit
- A small focused company can concentrate on one mission
- Large platforms can amplify the impact of AI technology