API reference#
Paths, ports and the hardware envelope this project targets. |
|
Which GPU is in the machine, and what may be claimed for it. |
|
Which physical disk backs a path, and whether a faster one is going spare. |
|
The curated model list, and the arithmetic that decides what fits. |
|
Read what a GGUF says about itself, without loading it. |
|
Survey what is published, and price it against the card in this machine. |
|
The llama.cpp build this project runs, and the ones it measures against. |
|
What the engine is told to guess with, and which backend each setting wins on. |
|
Lifecycle for the llama.cpp server. |
|
Background model downloads with real progress. |
|
Checks that answer "will this machine run the stack" before it is asked to. |
|
One description of the machine, in one shape, served by |
|
The control panel: a loopback-only web UI for starting, stopping and downloading models. |
|
The |