cgus
/

GGUF
English
biology
medical
chemistry
imatrix
conversational
cgus commited on
Commit
9e339c3
·
verified ·
1 Parent(s): 0417a5e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -1
README.md CHANGED
@@ -15,7 +15,10 @@ tags:
15
  Original model: [biomed-Qwen2-VL-2B-Instruct](https://huggingface.co/AdaptLLM/biomed-Qwen2-VL-2B-Instruct) by [AdaptLLM](https://huggingface.co/AdaptLLM)
16
  Based on: [Qwen2-VL-2B](https://huggingface.co/Qwen/Qwen2-VL-2B) by [Qwen](https://huggingface.co/Qwen)
17
  ## Quantization notes
18
- Made with llama.cpp-b4608 with imatrix based on exllamav2 default dataset.
 
 
 
19
 
20
  # Original model card
21
  # Adapting Multimodal Large Language Models to Domains via Post-Training
 
15
  Original model: [biomed-Qwen2-VL-2B-Instruct](https://huggingface.co/AdaptLLM/biomed-Qwen2-VL-2B-Instruct) by [AdaptLLM](https://huggingface.co/AdaptLLM)
16
  Based on: [Qwen2-VL-2B](https://huggingface.co/Qwen/Qwen2-VL-2B) by [Qwen](https://huggingface.co/Qwen)
17
  ## Quantization notes
18
+ Made with llama.cpp-b4608 with imatrix based on exllamav2 default dataset.
19
+ I was curious to try to quantize this model but I don't have qualifications to evaluate the result.
20
+ I briefly checked it with KoboldCpp with multiple images, sometimes it was right, sometimes wrong.
21
+ There's a big possibility that it requires a good knowledge about its capabilities and scope for proper use.
22
 
23
  # Original model card
24
  # Adapting Multimodal Large Language Models to Domains via Post-Training