RunLocalAI
gui
Open source
free
4.4/5

AnythingLLM

Document-oriented LLM frontend with workspaces. Connects to Ollama, LM Studio, OpenAI, Anthropic, etc. Strong document RAG.

By Fredoline Eruo·Last verified May 6, 2026·32,000 GitHub stars

Overview

Document-oriented LLM frontend with workspaces. Connects to Ollama, LM Studio, OpenAI, Anthropic, etc. Strong document RAG.

Pros

  • Document-first design
  • Multi-backend
  • Workspace concept

Cons

  • More setup than Open WebUI

Compatibility

Operating systems
macOS
Linux
Windows
Docker
GPU backends
any (proxies)
LicenseOpen source · free

Get AnythingLLM

Official site
https://anythingllm.com
GitHub
https://github.com/Mintplex-Labs/anything-llm

Frequently asked

Is AnythingLLM free?

Yes — AnythingLLM is free to download and use and open-source under a permissive license.

What operating systems does AnythingLLM support?

AnythingLLM supports macOS, Linux, Windows, Docker.

Which GPUs work with AnythingLLM?

AnythingLLM supports any (proxies). CPU-only inference is also possible but slow.

Reviewed by RunLocalAI Editorial. See our editorial policy for how we evaluate tools.