ggml-mllm / config.toml
matthoffner's picture
Update config.toml
217f5be
raw
history blame
141 Bytes
model="samantha-13B-GGML/samantha-13b.ggmlv3.q4_0.bin"
use_mmap="True"
use_mlock="True"
n_threads="6"
n_ctx="2048"
n_gpu_layers="50"
ngl="60"