GGUF is a model serialization format for Machine Learning models with built in quantization.
How Does GGUF Work?
There is an excellent guide to the format by Vicki Boykiss (mirror) that explains different file formats and the need for GGUF models.
Search
Jul 07, 20241 min read
GGUF is a model serialization format for Machine Learning models with built in quantization.
There is an excellent guide to the format by Vicki Boykiss (mirror) that explains different file formats and the need for GGUF models.