NightRun

NightRun: an LLM runtime that boots from USB, no operating system underneath

License: MIT


Description:

NightRun is a Rust-based UEFI-resident local LLM runtime that boots from USB or Raspberry Pi, loads a quantized model into RAM, and chats on a framebuffer without Linux, Windows, or a network stack.

Leave a Comment