If you need to use llama.cpp to call multiple models with low resources, managing multiple clients and memory can be tough. I found llama-swap that allows you to define a central client and swap models based on the model name, freeing up memory
👉#AI
#AI