RUNLOCALAIv38
->Will it run?Best GPUCompareTroubleshootStartLearnPulseModelsHardwareToolsBench
Run check
RUNLOCALAI

Independently operated catalog for local-AI hardware and software. Hand-written verdicts. Source-cited claims. Reproducible commands when we have them.

OP·Fredoline Eruo
DIR
  • Models
  • Hardware
  • Tools
  • Benchmarks
TOOLS
  • Will it run?
  • Compare hardware
  • Cost vs cloud
  • Choose my GPU
  • Prompting kits
  • Quick answers
REF
  • All buyer guides
  • Learn local AI
  • Methodology
  • Glossary
  • Errors KB
  • Trust
EDITOR
  • About
  • Author
  • How we make money
  • Editorial policy
  • Contact
LEGAL
  • Privacy
  • Terms
  • Sitemap
MAIL · MONTHLY DIGEST
Get monthly local AI changes
Monthly recap. No spam.
DISCLOSURE

Some links on this site are affiliate links (Amazon Associates and other first-class retailers). When you buy through them, we earn a small commission at no extra cost to you. Affiliate links do not influence our verdicts — there are cards we rate highly that we don't have affiliate relationships with, and cards that sell well that we refuse to recommend. Read more →

© 2026 runlocalai.coIndependently operated
RUNLOCALAI · v38
← Home·/apps·Chat UI

Odysseus

Hybrid (offline or cloud)

PewDiePie's self-hosted AI workspace: chat, agents, deep research, and a hardware-aware model Cookbook in one local-first dashboard.

Editorial verdict: “The most visible on-ramp to local AI yet — its hardware-aware Cookbook makes it a genuine beginner pick, but it's young and 'janky' by its own README; treat Agent mode's shell access with caution.”

Chat UI
Free
MIT
★ 4.0 / 5
GitHub ★ 30,000
↗ Homepage↗ GitHub↗ Docs

Compatibility at a glance

Which runtime + OS combos this app works against. Source of truth for "will it run on my setup?"

§ Runtimes supported
ollamallama-cppvllmopenai-compat
§ OS / platform
macoslinuxwindowsweb
§ Hardware + model hint
Minimum VRAM
4 GB
Recommended starter model
Llama 3.1 8B Q4_K_M
→ Build the rest of the stack with /stack-builder→ Pick a GPU for this app

What it is

Odysseus is a free, open-source, self-hosted AI workspace from Felix Kjellberg (PewDiePie), released May 31, 2026 under the MIT license. It is **not a model or a chatbot** — it is a single dashboard for talking to language models you run on your own hardware: chat, autonomous agents, deep research, email/calendar, notes, image generation, and model serving. The standout piece for newcomers is the **Cookbook**: it scans your hardware and recommends compatible models (VRAM-aware, GGUF/FP8/AWQ, fit-scored), then downloads and serves them via llama.cpp or vLLM — directly addressing the "will it run on my GPU?" problem. **Agent mode** (built on opencode) hands the model tools — MCP, web, files, shell, skills, memory — to run whole tasks. **Deep Research** does multi-step gather-read-synthesize runs; **Compare** does blind multi-model testing. Stack: Python 3.11, FastAPI, SQLite, ChromaDB, Docker. Runs locally against Ollama, llama.cpp, and vLLM, and can also connect OpenAI / OpenRouter / GitHub Copilot APIs. Quick start: clone the repo, `cp .env.example .env`, `docker compose up -d --build`; default UI at http://localhost:7000. It exploded on launch — 30,000+ GitHub stars in the first 48 hours — and its real significance is reach: someone with 110M+ subscribers pushing local, self-hosted AI into mainstream culture. **The privacy caveat that matters:** Odysseus is private *only when you use local models*. Connect a cloud API (OpenAI, Anthropic) and your data leaves for those servers exactly like ChatGPT — the local-first promise applies to the local path only. **Security note:** Agent mode with shell + MCP is a full remote-code-execution surface; don't point it at production systems or sensitive repos.

✓ Strengths

  • +Hardware-aware Cookbook: scans your GPU, recommends + serves compatible models (VRAM/quant-aware) — solves the #1 local-AI hurdle
  • +All-in-one: chat, agents (MCP/tools/shell), deep research, compare, email/calendar, notes, image gen in one dashboard
  • +Local-first + no telemetry when run against local models; MIT licensed, no accounts or subscriptions
  • +Supports Ollama, llama.cpp, and vLLM; massive mainstream reach is pulling new users into local AI

△ Caveats

  • −Privacy only holds for local models — connecting cloud APIs (OpenAI/Anthropic) ships data off exactly like ChatGPT
  • −Self-described as 'janky'; very new (launched May 2026), overlaps with mature tools like Open WebUI
  • −Agent mode (shell + MCP) is a full RCE surface — risky if pointed at production or sensitive systems
  • −You operate it: GPU costs, ops, and security patches are on you (not 'free cloud ChatGPT'); Windows GPU serving needs WSL2

About the Chat UI category

Web or desktop chat client that connects to your local runtime.

§ Other chat ui apps
AnythingLLM

Best fast-RAG app. Workspace model is the right abstraction for doc-corpora chat.

LibreChat

Best if you mix local + cloud models in the same workflow. Strong team features.

Jan

Best one-binary desktop chat. Curated catalog removes 'which model?' decision paralysis.

Open WebUI

Best default chat UI for solo Ollama users. Pick this first; switch only if you outgrow it.

Where to go from here

Stack Builder →

Pre-filled with this app's recommended use case + budget tier. Get the full rig + runtime + model picks.

Back to /apps →

The full directory — filter by category, runtime, OS, privacy posture, or VRAM.

Runtimes (/tools) →

What this app talks to: Ollama, vLLM, llama.cpp, MLX, LM Studio. The upstream layer.

Community benchmarks →

Did this app work for you on a specific rig? Submit the benchmark — it powers the model + hardware pages.