llama-swap

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

What is llama-swap?

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc