Update README.md
Browse files
README.md
CHANGED
@@ -15,7 +15,10 @@ tags:
|
|
15 |
Original model: [biomed-Qwen2-VL-2B-Instruct](https://huggingface.co/AdaptLLM/biomed-Qwen2-VL-2B-Instruct) by [AdaptLLM](https://huggingface.co/AdaptLLM)
|
16 |
Based on: [Qwen2-VL-2B](https://huggingface.co/Qwen/Qwen2-VL-2B) by [Qwen](https://huggingface.co/Qwen)
|
17 |
## Quantization notes
|
18 |
-
Made with llama.cpp-b4608 with imatrix based on exllamav2 default dataset.
|
|
|
|
|
|
|
19 |
|
20 |
# Original model card
|
21 |
# Adapting Multimodal Large Language Models to Domains via Post-Training
|
|
|
15 |
Original model: [biomed-Qwen2-VL-2B-Instruct](https://huggingface.co/AdaptLLM/biomed-Qwen2-VL-2B-Instruct) by [AdaptLLM](https://huggingface.co/AdaptLLM)
|
16 |
Based on: [Qwen2-VL-2B](https://huggingface.co/Qwen/Qwen2-VL-2B) by [Qwen](https://huggingface.co/Qwen)
|
17 |
## Quantization notes
|
18 |
+
Made with llama.cpp-b4608 with imatrix based on exllamav2 default dataset.
|
19 |
+
I was curious to try to quantize this model but I don't have qualifications to evaluate the result.
|
20 |
+
I briefly checked it with KoboldCpp with multiple images, sometimes it was right, sometimes wrong.
|
21 |
+
There's a big possibility that it requires a good knowledge about its capabilities and scope for proper use.
|
22 |
|
23 |
# Original model card
|
24 |
# Adapting Multimodal Large Language Models to Domains via Post-Training
|