RUNLOCALAIv38
->Will it run?Best GPUCompareTroubleshootStartLearnPulseModelsHardwareToolsBench
Run check
RUNLOCALAI

Independently operated catalog for local-AI hardware and software. Hand-written verdicts. Source-cited claims. Reproducible commands when we have them.

OP·Fredoline Eruo
DIR
  • Models
  • Hardware
  • Tools
  • Benchmarks
TOOLS
  • Will it run?
  • Compare hardware
  • Cost vs cloud
  • Choose my GPU
  • Prompting kits
  • Quick answers
REF
  • All buyer guides
  • Learn local AI
  • Methodology
  • Glossary
  • Errors KB
  • Trust
EDITOR
  • About
  • Author
  • How we make money
  • Editorial policy
  • Contact
LEGAL
  • Privacy
  • Terms
  • Sitemap
MAIL · MONTHLY DIGEST
Get monthly local AI changes
Monthly recap. No spam.
DISCLOSURE

Some links on this site are affiliate links (Amazon Associates and other first-class retailers). When you buy through them, we earn a small commission at no extra cost to you. Affiliate links do not influence our verdicts — there are cards we rate highly that we don't have affiliate relationships with, and cards that sell well that we refuse to recommend. Read more →

© 2026 runlocalai.coIndependently operated
RUNLOCALAI · v38
Hermes 3 Llama 3.1 8B / on / NVIDIA GeForce RTX 3080 16GB (Mobile)
Fits comfortably

Running Hermes 3 Llama 3.1 8B on NVIDIA GeForce RTX 3080 16GB (Mobile)

NVIDIA GeForce RTX 3080 16GB (Mobile) runs Hermes 3 Llama 3.1 8B comfortably at Q8_0 with 6 GB of headroom for context.

By Fredoline Eruo·Latest benchmark evidence Jun 2, 2026

Model size

8B params
Hermes 3 Llama 3.1 8B →

Memory available

16 GB
NVIDIA GeForce RTX 3080 16GB (Mobile) →

Recommended quant

Q8_0
Highest quality that fits

Quick start with Ollama

1. Install
ollama pull hermes3:8b
2. Run
ollama run hermes3:8b

Default quant in Ollama is Q4_K_M. To use a different quant, append it: hermes3:8b-q5_K_M.

Variants and what fits

QuantizationFile sizeVRAM requiredFits on NVIDIA GeForce RTX 3080 16GB (Mobile)?
Q4_K_M4.9 GB6 GB
Yes
Q8_08.5 GB10 GB
Yes

Real benchmarks

ToolQuantContexttok/sVRAM usedDateEvidenceExport
—Q4_K_M4,09681.5 tok/s—Jun 2, 2026Measured here
operator: fred-oline
DetailSourceJSON

Frequently asked

Can NVIDIA GeForce RTX 3080 16GB (Mobile) run Hermes 3 Llama 3.1 8B?

NVIDIA GeForce RTX 3080 16GB (Mobile) runs Hermes 3 Llama 3.1 8B comfortably at Q8_0 with 6 GB of headroom for context.

What quantization should I use?

Q8_0 is the highest-quality variant of Hermes 3 Llama 3.1 8B that fits in 16 GB VRAM. Lower-bit quants will be smaller but lose some quality.

How fast will it be?

Measured at 81.5 tok/s on this combination in our testing.

See also: Hermes 3 Llama 3.1 8B, NVIDIA GeForce RTX 3080 16GB (Mobile), all benchmarks.

Reviewed by RunLocalAI Editorial. See our editorial policy.