llama-swap

by mostlygeek

Install llama-swap with winget

winget install -e --id mostlygeek.llama-swap

Download the instant installer and run!

llama-swap is a light weight, transparent proxy server that provides automatic model swapping to llama.cpp's server.

Information

Publishermostlygeek
Version264(latest)
Updated23 hours ago
LicenseMIT
Package IDmostlygeek.llama-swap
CopyrightCopyright (c) 2024 Benson Wong