Upload folder using huggingface_hub (#1)

- efea41c07cf9d0c7e8f66fba6a28bfc0972e017f5907f336ff8a2e7d49a0c298 (506049601b6bcc12079b4fa32059a2935fbd4f1c)
- 9404ecdbf03e4acc6e87e3716b13f73fb7e2571b7b7339db1753d712bda4dce1 (a248aa0a8e932044cecff9fabef7572b1d1671e4)
- 8a9cc704035980b3be818b272ec4be38829d5dc3232651c8c654451a595de1c3 (e00cb4c77c3744b71349c35ec707fe1d73d5245f)
- 4c249691cb652cfb0ceb1fc3772a5ea9156a6ab895b5307bcbc75e1bd6f30e26 (8515de73092fa9f6d1e810eb82787ac150e9966a)
- 50ae8ca571efa52b9debb7d47bd6794195c98e1ff3b5695397d86cd5020ed0df (ac68e35faa8fe248cbcac50821338d22817f4b74)
- 78cb9122395a6b5b24e75de1d46e18e7c3862c83e5b3e1e05fc27004076e7783 (842a3be0b68f67f486d8b3939f5485d16d6db7a0)

.gitattributes

@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+MathCoder2-Mistral-7B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+MathCoder2-Mistral-7B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+MathCoder2-Mistral-7B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+MathCoder2-Mistral-7B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+MathCoder2-Mistral-7B.fp16.gguf filter=lfs diff=lfs merge=lfs -text
+MathCoder2-Mistral-7B-GGUF_imatrix.dat filter=lfs diff=lfs merge=lfs -text

MathCoder2-Mistral-7B-GGUF_imatrix.dat

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b785f21c0c9a260960e89ff065672383e4ad972f2e68414d27cd7e95066daebb
+size 4988146

MathCoder2-Mistral-7B.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7d868f6d9113c08c6a4c769bffd44bc9d3dc68a6252e25a87913545c417f8a72
+size 5131410304

MathCoder2-Mistral-7B.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:78772b0c3c7ae3d1f22d4d4facbf61fafbada641834735e2c50d9a5892adab4d
+size 4997716864

MathCoder2-Mistral-7B.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0baa0d9c2417615c743c5a33f36d9ff4138e54841348fcb326cd6874179f18d2
+size 5942066048

MathCoder2-Mistral-7B.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:562a0e31f56bde9f089ef6fc475f8492596e68b071d34f625870fe9e700bb93c
+size 7695858560

MathCoder2-Mistral-7B.fp16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:20b52879fc335a1e2a7bcb60e1ae2ee51675d4df6de09afa716ea5c4369264c8
+size 14484732576

README.md

@@ -0,0 +1,46 @@
+---
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- text-generation
+- text-generation
+model_name: MathCoder2-Mistral-7B-GGUF
+base_model: MathGenie/MathCoder2-Mistral-7B
+inference: false
+model_creator: MathGenie
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+---
+# [MaziyarPanahi/MathCoder2-Mistral-7B-GGUF](https://huggingface.co/MaziyarPanahi/MathCoder2-Mistral-7B-GGUF)
+- Model creator: [MathGenie](https://huggingface.co/MathGenie)
+- Original model: [MathGenie/MathCoder2-Mistral-7B](https://huggingface.co/MathGenie/MathCoder2-Mistral-7B)
+
+## Description
+[MaziyarPanahi/MathCoder2-Mistral-7B-GGUF](https://huggingface.co/MaziyarPanahi/MathCoder2-Mistral-7B-GGUF) contains GGUF format model files for [MathGenie/MathCoder2-Mistral-7B](https://huggingface.co/MathGenie/MathCoder2-Mistral-7B).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.