Viewpoint

Distillation is a standard model-building technique, not inherently improper.

Distillation is a standard model-building technique, not inherently improper.

Alex describes distillation as a common method for transferring capabilities from larger models to smaller or specialized models, while recognizing that providers can prohibit competitive distillation through their terms.

Source timestamp
57:46

More from this interview