Description:
KoboldCpp is a single-file, install-free AI text-generation app for GGML and GGUF models, inspired by KoboldAI. It runs on CPU or GPU, includes a KoboldAI Lite UI, supports image generation, Whisper recognition, and TTS, with ready-made binaries for Windows, macOS, and Linux.