RUNLOCALAIv38
->Will it run?Best GPUCompareTroubleshootStartLearnPulseModelsHardwareToolsBench
Run check
RUNLOCALAI

Independently operated catalog for local-AI hardware and software. Hand-written verdicts. Source-cited claims. Reproducible commands when we have them.

OP·Fredoline Eruo
DIR
  • Models
  • Hardware
  • Tools
  • Benchmarks
TOOLS
  • Will it run?
  • Compare hardware
  • Cost vs cloud
  • Choose my GPU
  • Prompting kits
  • Quick answers
REF
  • All buyer guides
  • Learn local AI
  • Methodology
  • Glossary
  • Errors KB
  • Trust
EDITOR
  • About
  • Author
  • How we make money
  • Editorial policy
  • Contact
LEGAL
  • Privacy
  • Terms
  • Sitemap
MAIL · MONTHLY DIGEST
Get monthly local AI changes
Monthly recap. No spam.
DISCLOSURE

Some links on this site are affiliate links (Amazon Associates and other first-class retailers). When you buy through them, we earn a small commission at no extra cost to you. Affiliate links do not influence our verdicts — there are cards we rate highly that we don't have affiliate relationships with, and cards that sell well that we refuse to recommend. Read more →

© 2026 runlocalai.coIndependently operated
RUNLOCALAI · v38
← Home·/apps·RAG app

Verba

Hybrid (offline or cloud)

Weaviate's open-source RAG demo turned production. Strong defaults, opinionated stack.

Editorial verdict: “Best for 'don't make me choose chunking strategy' teams. Opinionated stack works.”

RAG app
Free
BSD-3-Clause
★ 4.2 / 5
GitHub ★ 7,500
↗ GitHub

Compatibility at a glance

Which runtime + OS combos this app works against. Source of truth for "will it run on my setup?"

§ Runtimes supported
ollamaopenai-compatanthropic
§ OS / platform
linuxmacoswindows
§ Hardware + model hint
Minimum VRAM
8 GB
Recommended starter model
Llama 3.1 8B + Weaviate embeddings
→ Build the rest of the stack with /stack-builder→ Pick a GPU for this app

What it is

Verba is for teams that want to ship an internal-doc chat app without debating chunking strategies or vector store choices. Point it at your data, pick an Ollama or OpenAI-compatible backend, and the opinionated pipeline handles ingestion, embedding, retrieval, and generation with sensible defaults. The React UI surfaces citation tracing out of the box, which makes it easier to trust answers. You'll need at least 8 GB VRAM for a Llama 3.1 8B model plus Weaviate embeddings. The tradeoff is that you're tied to Weaviate as the vector store — swapping it out requires manual work, so this isn't the right pick if you want to mix and match components freely.

✓ Strengths

  • +Opinionated stack — fewer decisions
  • +Clean React UI with citation tracing
  • +Excellent default chunking + retrieval params

△ Caveats

  • −Tied to Weaviate (or you do the swap yourself)
  • −Less flexible than PrivateGPT if you want to swap components

About the RAG app category

Document retrieval + chat, fully offline-capable.

§ Other rag app apps
PrivateGPT

Best when air-gap compliance is the requirement. Less polished than AnythingLLM, more configurable.

Khoj

Best 'AI second brain' app. Self-hosted, local-first, works against Obsidian.

Where to go from here

Stack Builder →

Pre-filled with this app's recommended use case + budget tier. Get the full rig + runtime + model picks.

Back to /apps →

The full directory — filter by category, runtime, OS, privacy posture, or VRAM.

Runtimes (/tools) →

What this app talks to: Ollama, vLLM, llama.cpp, MLX, LM Studio. The upstream layer.

Community benchmarks →

Did this app work for you on a specific rig? Submit the benchmark — it powers the model + hardware pages.