RunLocalAI
gui
Open source
free
4.4/5

KoboldCPP

Single-file llama.cpp distribution focused on roleplay and creative writing. Bundles a web UI, image gen, and the Kobold API.

By Fredoline Eruo·Last verified May 6, 2026·7,500 GitHub stars

Overview

Single-file llama.cpp distribution focused on roleplay and creative writing. Bundles a web UI, image gen, and the Kobold API.

Pros

  • Single executable
  • Bundled web UI with chat/instruct/story modes
  • Wide hardware support

Cons

  • Utilitarian UI
  • Optimized for chat/RP — less ideal for agents

Compatibility

Operating systems
macOS
Linux
Windows
GPU backends
NVIDIA CUDA
AMD ROCm
Vulkan
CLBlast
CPU
LicenseOpen source · free

Get KoboldCPP

GitHub
https://github.com/LostRuins/koboldcpp

Frequently asked

Is KoboldCPP free?

Yes — KoboldCPP is free to download and use and open-source under a permissive license.

What operating systems does KoboldCPP support?

KoboldCPP supports macOS, Linux, Windows.

Which GPUs work with KoboldCPP?

KoboldCPP supports NVIDIA CUDA, AMD ROCm, Vulkan, CLBlast, CPU. CPU-only inference is also possible but slow.

Reviewed by RunLocalAI Editorial. See our editorial policy for how we evaluate tools.