The Example Store Is Model State
Consider a classifier that retrieves labeled examples for an incoming query and gives them to an LLM to choose a label. This is a form of k-nearest-neighbor classification with an LLM decision rule: the store supplies the examples and the LLM decides how they imply a label. More