Khoj CLI

Fully offline

Terminal entry into Khoj's local AI assistant. Use grep, get answers, never leave the shell.

Editorial verdict: “Best terminal companion for note-summarization workflows. Pipe-friendly.

Productivity
Free
AGPL-3.0
4.2 / 5
GitHub ★ 18,000

Compatibility at a glance

Which runtime + OS combos this app works against. Source of truth for "will it run on my setup?"

§ Runtimes supported
ollamallama-cppopenai-compat
§ OS / platform
macoslinuxwindows
§ Hardware + model hint
Minimum VRAM
4 GB
Recommended starter model
Llama 3.1 8B Q4_K_M

What it is

For solo Ollama users who live in the terminal, Khoj CLI turns your shell into a local document assistant. Pipe any text—grep output, log files, notes—into `khoj 'summarize this'` and get answers without leaving the command line. It bridges to Ollama, llama.cpp, or any OpenAI-compatible runtime, and works offline with models as small as Llama 3.1 8B Q4_K_M on 4 GB VRAM. The trade-off: you need the Khoj server running in the background, which adds a dependency not everyone wants. Best for note-summarization workflows where speed and pipe compatibility matter more than a GUI.

✓ Strengths

  • +Pipe-friendly — slots into shell workflows naturally
  • +Same local-runtime backing as Khoj proper
  • +Open-source

△ Caveats

  • Needs Khoj server running
  • Less discoverable than GUI

About the Productivity category

Note-taking, knowledge management, or workflow apps with AI.