Novaciano commited on
Commit
305f517
·
verified ·
1 Parent(s): 433db07

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -70
README.md CHANGED
@@ -1,70 +1,32 @@
1
- ---
2
- base_model: carsenk/llama3.2_1b_2025_uncensored_v2
3
- datasets:
4
- - mlabonne/FineTome-100k
5
- - microsoft/orca-math-word-problems-200k
6
- - m-a-p/CodeFeedback-Filtered-Instruction
7
- - cognitivecomputations/dolphin-coder
8
- - PawanKrd/math-gpt-4o-200k
9
- - V3N0M/Jenna-50K-Alpaca-Uncensored
10
- - FreedomIntelligence/medical-o1-reasoning-SFT
11
- language:
12
- - en
13
- library_name: transformers
14
- license: llama3.2
15
- pipeline_tag: text-generation
16
- tags:
17
- - llama
18
- - unsloth
19
- - uncensored
20
- - llama-3.2
21
- - llama.cpp
22
- - gguf
23
- - inference
24
- - llama-cpp
25
- - gguf-my-repo
26
- ---
27
-
28
- # Novaciano/llama3.2_1b_2025_uncensored_v2-Q5_K_M-GGUF
29
- This model was converted to GGUF format from [`carsenk/llama3.2_1b_2025_uncensored_v2`](https://huggingface.co/carsenk/llama3.2_1b_2025_uncensored_v2) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
30
- Refer to the [original model card](https://huggingface.co/carsenk/llama3.2_1b_2025_uncensored_v2) for more details on the model.
31
-
32
- ## Use with llama.cpp
33
- Install llama.cpp through brew (works on Mac and Linux)
34
-
35
- ```bash
36
- brew install llama.cpp
37
-
38
- ```
39
- Invoke the llama.cpp server or the CLI.
40
-
41
- ### CLI:
42
- ```bash
43
- llama-cli --hf-repo Novaciano/llama3.2_1b_2025_uncensored_v2-Q5_K_M-GGUF --hf-file llama3.2_1b_2025_uncensored_v2-q5_k_m-imat.gguf -p "The meaning to life and the universe is"
44
- ```
45
-
46
- ### Server:
47
- ```bash
48
- llama-server --hf-repo Novaciano/llama3.2_1b_2025_uncensored_v2-Q5_K_M-GGUF --hf-file llama3.2_1b_2025_uncensored_v2-q5_k_m-imat.gguf -c 2048
49
- ```
50
-
51
- Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
52
-
53
- Step 1: Clone llama.cpp from GitHub.
54
- ```
55
- git clone https://github.com/ggerganov/llama.cpp
56
- ```
57
-
58
- Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
59
- ```
60
- cd llama.cpp && LLAMA_CURL=1 make
61
- ```
62
-
63
- Step 3: Run inference through the main binary.
64
- ```
65
- ./llama-cli --hf-repo Novaciano/llama3.2_1b_2025_uncensored_v2-Q5_K_M-GGUF --hf-file llama3.2_1b_2025_uncensored_v2-q5_k_m-imat.gguf -p "The meaning to life and the universe is"
66
- ```
67
- or
68
- ```
69
- ./llama-server --hf-repo Novaciano/llama3.2_1b_2025_uncensored_v2-Q5_K_M-GGUF --hf-file llama3.2_1b_2025_uncensored_v2-q5_k_m-imat.gguf -c 2048
70
- ```
 
1
+ ---
2
+ base_model: carsenk/llama3.2_1b_2025_uncensored_v2
3
+ datasets:
4
+ - mlabonne/FineTome-100k
5
+ - microsoft/orca-math-word-problems-200k
6
+ - m-a-p/CodeFeedback-Filtered-Instruction
7
+ - cognitivecomputations/dolphin-coder
8
+ - PawanKrd/math-gpt-4o-200k
9
+ - V3N0M/Jenna-50K-Alpaca-Uncensored
10
+ - FreedomIntelligence/medical-o1-reasoning-SFT
11
+ - allura-org/r_shortstories_24k
12
+ language:
13
+ - en
14
+ - es
15
+ library_name: transformers
16
+ license: llama3.2
17
+ pipeline_tag: text-generation
18
+ tags:
19
+ - llama
20
+ - unsloth
21
+ - uncensored
22
+ - nsfw
23
+ - 1b
24
+ - 4-bit
25
+ - llama-3.2
26
+ - llama.cpp
27
+ - gguf
28
+ - inference
29
+ - koboldcpp
30
+ ---
31
+
32
+ # L3.2 1B Uncensored Short Stories Q5_K_M-GGUF