Viewpoint
AI progress needs experience alongside model intelligence
AI progress needs experience alongside model intelligence
Karanam argues that models are rapidly becoming more intelligent, but they still behave as if every interaction were their first day on the job because they do not accumulate experience from prior work.
- Speaker
- Arjun Karanam
- Topic
- AI Experience Gap
- Source timestamp
- 0:39
More from this interview
- Agent interactions should become signals for future improvement
- Continual learning can create systems that compound with use
- Feedback should update either models or their surrounding harness
- Full agent traces should include tools and sub-agents
- Corrective behavior provides richer feedback than simple ratings
- Evals should closely reflect real production usage
- Agent tasks should be replayable for evaluation
- Harnesses should enable orchestration instead of rigid workflows
- Agents should access the same capabilities as users
- Tool responses should expose informative execution details
- Open weights enable companies to continually improve owned models
- Model routers can match intelligence to task requirements
- Continual learning should optimize the whole intelligence system
- Learning can avoid direct training on customer data
- Corrective feedback gives stronger reward signals than dissatisfaction
- Feedback scope determines where learned information should live
- Continual learning is most compelling near capability frontiers