An MSU/UA PATENT Lab paper describing the principles of ROC driven prompt distillation. It closes the gap between frontier models and on-premise LLMs allowing for offline deployments, without any cloud vendor dependencies. In my example it is used to train an installment loan lead underwriting filter.

Continue reading “Distillation by Prompt: On-Premise LLM Calibration”