ggml-mllm / config.toml
matthoffner's picture
Update config.toml
c627bc6
raw
history blame
128 Bytes
model="guanaco-7B-GGML/guanaco-7B.ggmlv3.q4_0.bin"
use_mmap="True"
use_mlock="True"
n_threads="8"
n_ctx="4096"
n_gpu_layers="50"