gzip

Can gzip Be a Language Model?

An author explored language modeling with the OS-native gzip compressor, with no neural network or learned parameters. Leveraging the compression-prediction equivalence, priming it with a corpus and feeding a prompt yields continuations that are incoherent but clearly informed by the text.