API reference#
Paths, ports and the hardware envelope this project targets. |
|
Which GPU is in the machine, and what may be claimed for it. |
|
The curated model list, and the arithmetic that decides what fits. |
|
Lifecycle for the llama.cpp server. |
|
Background model downloads with real progress. |
|
Checks that answer "will this machine run the stack" before it is asked to. |
|
One description of the machine, in one shape, for every front end. |
|
The control panel: a loopback-only web UI for starting, stopping and downloading models. |
|
The control panel on a text console, for a machine with no browser on it. |
|
The |