pankajmathur
/

model_101

Text Generation

text-generation-inference

Model card Files Files and versions Community

pankajmathur commited on Nov 9, 2023

Commit

b132119

·

1 Parent(s): 9f0c960

Update README.md

Files changed (1) hide show

README.md +6 -0

README.md CHANGED Viewed

@@ -75,6 +75,12 @@ This model required upto 45GB GPU VRAM in 4bit so it can be loaded directly on S
 So, if you have access to Machine with 45GB GPU VRAM and have installed [OobaBooga Web UI](https://github.com/oobabooga/text-generation-webui) on it.
 You can just download this model by using HF repo link directly on OobaBooga Web UI "Model" Tab/Page & Just use **load-in-4bit** option in it.
 <br>

 So, if you have access to Machine with 45GB GPU VRAM and have installed [OobaBooga Web UI](https://github.com/oobabooga/text-generation-webui) on it.
 You can just download this model by using HF repo link directly on OobaBooga Web UI "Model" Tab/Page & Just use **load-in-4bit** option in it.
+![model_load_screenshot](https://huggingface.co/pankajmathur/model_101/resolve/main/oobabooga_model_load_screenshot.png)
+After that go to Default Tab/Page on OobaBooga Web UI and **copy paste above prompt format into Input** and Enjoy!
+![default_input_screenshot](https://huggingface.co/pankajmathur/model_101/resolve/main/default_input_screenshot.png)
 <br>