Khoj

Hybrid (offline or cloud)

Self-hosted AI assistant for your notes, emails, docs. Web + mobile + desktop, all local-first.

Editorial verdict: “Best 'AI second brain' app. Self-hosted, local-first, works against Obsidian.

RAG app
Freemium
AGPL-3.0
4.3 / 5
GitHub ★ 18,000

Compatibility at a glance

Which runtime + OS combos this app works against. Source of truth for "will it run on my setup?"

§ Runtimes supported
ollamallama-cppopenai-compatanthropic
§ OS / platform
linuxmacoswindowsiosandroidweb
§ Hardware + model hint
Minimum VRAM
8 GB
Recommended starter model
Llama 3.1 8B Q4_K_M

What it is

For solo users running Ollama on a laptop or desktop, Khoj turns local notes, emails, and PDFs into a searchable chat interface. It bridges directly to Ollama or llama.cpp, and works well with an 8B model like Llama 3.1 8B Q4_K_M on 8 GB VRAM. The Obsidian integration is its strongest feature—indexing is local-first, with cloud sync as an opt-in fallback. Cross-platform coverage (web, iOS, Android, desktop) is genuine, not an afterthought. Be aware that indexing a large corpus is slow on initial run, and features like image generation require cloud.

✓ Strengths

  • +Genuinely cross-platform (mobile apps work)
  • +Strong Obsidian integration
  • +Self-host + cloud sync is well-designed

△ Caveats

  • Initial index of a large corpus is slow
  • Some niche features (image generation) require cloud