Jan

Fully offline

Privacy-first desktop chat with a curated model catalog. Llama / Mistral / Qwen one click from the app.

Editorial verdict: “Best one-binary desktop chat. Curated catalog removes 'which model?' decision paralysis.

Chat UI
Free
AGPL-3.0
4.5 / 5
GitHub ★ 28,000

Compatibility at a glance

Which runtime + OS combos this app works against. Source of truth for "will it run on my setup?"

§ Runtimes supported
llama-cppollamaopenai-compat
§ OS / platform
macoslinuxwindows
§ Hardware + model hint
Minimum VRAM
4 GB
Recommended starter model
Llama 3.1 8B Q4_K_M

What it is

Jan is the right pick if you want a local chat app that works without touching a terminal or Docker. It ships as a single desktop binary for macOS, Linux, or Windows, and its curated catalog lets you download Llama 3.1 8B or Mistral with one click—no deciding which variant to grab. The app runs fully offline using its embedded llama.cpp runtime, but can also point at external Ollama or OpenAI-compatible endpoints if you need that flexibility. The tradeoff: its RAG and file-upload features are less mature than Open WebUI’s, so don’t expect polished document workflows yet. For a no-fuss, privacy-first chat UI that gets you from install to first message in under three minutes, Jan delivers.

✓ Strengths

  • +Single-binary install — no terminal required
  • +Curated model catalog with one-click download
  • +Built-in OpenAI-compatible API server

△ Caveats

  • Smaller ecosystem than Open WebUI
  • RAG / file-upload features are less mature