llama-swap

by mostlygeek

Install llama-swap with winget

winget install -e --id mostlygeek.llama-swap

Download the instant installer and run!

llama-swap is a light weight, transparent proxy server that provides automatic model swapping to llama.cpp's server.

Information

Publishermostlygeek
Version266(latest)
Updated15 hours ago
LicenseMIT
Package IDmostlygeek.llama-swap
CopyrightCopyright (c) 2024 Benson Wong