1
A GitHub project packages local LLM runners, shared model storage, persistent chat history, and a LAN-accessible Python web UI into a USB or SSD workflow. The privacy and air-gap claims are worth reading with care because the retained page also describes initial downloads, portable executables, model weights, and port 3333 access on the local network.
discussion (0)