llmserve

Any model. Any backend. One TUI to serve them all.

Quick install (macOS / Linux) curl -fsSL https://llmserve.axjns.dev/install.sh | sh

Homebrew brew tap AlexsJones/llmserve && brew install llmserve

Cargo cargo install llmserve

GitHub Releases crates.io

Sister project: llmfit — find which models fit your hardware