Viewpoint
Agent UX can generate useful implicit feedback
Agent UX can generate useful implicit feedback
Chase argues that thoughtful agent UX can capture behavioral feedback from users even when they do not explicitly provide thumbs-up or thumbs-down ratings.
- Speaker
- Harrison Chase
- Source timestamp
- 16:16
More from this interview
- Agents combine a harness, model, and context
- A harness brings context to the model when needed
- Most agents share a simple model-and-tools loop
- Middleware can customize the core agent loop
- Start general and specialize as requirements become clearer
- Out-of-distribution tasks require more harness customization
- Custom harnesses should preserve model-native tool patterns
- Mission-critical agents should have task-specific benchmarks
- Agent benchmarks should measure more than accuracy
- Poor context often causes agent failures
- Detailed traces are necessary for debugging agents
- Production traces can drive continuous agent improvement
- Trace data can improve every major agent component
- Agent improvement can be partially automated from traces
- Benchmark comparisons can reveal techniques worth adopting
- Harness customization exists on a spectrum
- Predictability can justify more controlled agent architectures