Install llama-swap with winget
264(latest)
winget install -e --id mostlygeek.llama-swap
Download the instant installer and run!
llama-swap is a light weight, transparent proxy server that provides automatic model swapping to llama.cpp's server.
Information
Version264(latest)
Updated23 hours ago
Package IDmostlygeek.llama-swap
CopyrightCopyright (c) 2024 Benson Wong