News

Showing 103 of 103 posts

Infini-gram: LLM-scale *-gram models

Recently, I watched a presentation on Infini-grams, which utilize a suffix array to avoid precomputing nn-grams and allow for arbitrary context lengths, up to a suffix that is found in the training data.

This sparked my interest as I had worked on a …