Install llama-swap with winget
266(latest)
winget install -e --id mostlygeek.llama-swap
Download the instant installer and run!
llama-swap is a light weight, transparent proxy server that provides automatic model swapping to llama.cpp's server.
Information
Version266(latest)
Updated15 hours ago
Package IDmostlygeek.llama-swap
CopyrightCopyright (c) 2024 Benson Wong