Update README.md
Browse files
README.md
CHANGED
@@ -35,9 +35,9 @@ This repo contains GGUF format model files for [Infosys's NT-Java-1.1B](https://
|
|
35 |
<!-- README_GGUF.md-about-gguf start -->
|
36 |
### About GGUF
|
37 |
|
38 |
-
GGUF
|
39 |
|
40 |
-
|
41 |
|
42 |
* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
|
43 |
* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
|
|
|
35 |
<!-- README_GGUF.md-about-gguf start -->
|
36 |
### About GGUF
|
37 |
|
38 |
+
GGUF, introduced by the llama.cpp team on August 21st, 2023, is a new format designed to replace the outdated GGML, which is no longer maintained by llama.cpp. GGUF boasts several improvements over GGML, such as enhanced tokenization, support for special tokens, and metadata capabilities. It is also designed with extensibility in mind.
|
39 |
|
40 |
+
Below is a partial list of clients and libraries known to support GGUF:
|
41 |
|
42 |
* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
|
43 |
* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
|