API reference#

lllm3090.config

Paths, ports and the hardware envelope this project targets.

lllm3090.hardware

Which GPU is in the machine, and what may be claimed for it.

lllm3090.catalog

The curated model list, and the arithmetic that decides what fits.

lllm3090.engine

Lifecycle for the llama.cpp server.

lllm3090.downloads

Background model downloads with real progress.

lllm3090.preflight

Checks that answer "will this machine run the stack" before it is asked to.

lllm3090.state

One description of the machine, in one shape, for every front end.

lllm3090.panel

The control panel: a loopback-only web UI for starting, stopping and downloading models.

lllm3090.tui

The control panel on a text console, for a machine with no browser on it.

lllm3090.cli

The lllm3090 command.