Editorial
RunLocalAI measured

Trendyol LLM Asure 12B on NVIDIA GeForce RTX 3080 16GB (Mobile)

Measured 3 mo ago.

Why trust this benchmark?

Measurement

tok/s
43.4
TTFT
391 ms
VRAM used
—
RAM used
—
Power
—
Quant
Q4_K_M
Context
4K
Run date
2026-06-02
Source
owner
Type
measured

V36.52 rigor detail

Protocol →
Cold-start decode
43.74 tok/sTTFT 5164 ms
Steady-state median
43.35 tok/sP5 43.1 · P95 43.4
Runs captured
5
Scenario
Single-stream
Editorial notes

5-run capture · variance 0.8% · scenario single-stream · runtime ollama

Evidence

What this row provides for independent review. Missing fields lower confidence; they are shown explicitly instead of hidden.

Source link
Open source
Evidence manifest
Open manifest
Command
Available
Raw logs
Not provided
Raw results
1 files
Log hash
618ca08b4886...
Operator
fred-oline
Runtime
ollama version is 0.24.0
Driver
571.96
CUDA / ROCm / Metal
12.8
OS
Microsoft Windows [Version 10.0.26200.8457]
Run count
5
Raw stats
Available
Environment notes
Not provided

Why this confidence tier?

High confidence

Confidence is rule-based. Every factor below contributed to the tier. We never expose a single numeric score; the tier label is auditable through this explanation alone.

Factors
  • +Measured by RunLocalAI editorial
How to improve this benchmark's confidence

Cohort intelligence

How this measurement compares to the rest of the corpus. Only comparable rows (same model + hardware first, with relaxations labelled) are used. We never average across runtimes or quant formats unless explicitly told to.

Insufficient comparison data. Insufficient cohort (0 comparable measurements). Outlier detection requires ≥5.

Same model, different hardware

3 matching rows

What this model looks like on adjacent hardware. Drives the 'should I upgrade?' question.

Median tok/s
79.1
Spread
61.5 – 82.0
CoV
12%
  • 61.5 tok/srtx-5080ollama version is 0.24.0Q4_K_MEditorial
  • 79.1 tok/srtx-5080ollama-local-apiunknownEditorial
  • 82.0 tok/srtx-5080ollama version is 0.24.0Q4_K_MEditorial

Same hardware, different model

12 matching rows

What else this rig can run at the same quant bucket.

Median tok/s
67.6
Spread
38.3 – 80.4
CoV
24%
  • 43.3 tok/srtx-3080-16gb-mobileollama version is 0.24.0Q4_K_MEditorial
  • 40.4 tok/srtx-3080-16gb-mobileollama version is 0.24.0Q4_K_MEditorial
  • 38.3 tok/srtx-3080-16gb-mobileollama version is 0.24.0Q4_K_MEditorial
  • 65.7 tok/srtx-3080-16gb-mobileollama version is 0.24.0Q4_K_MEditorial
  • 66.0 tok/srtx-3080-16gb-mobileollama version is 0.24.0Q4_K_MEditorial
  • +7 more

Reproduce this benchmark

Got the same model + hardware combo? Run the same measurement and submit your numbers. We'll pre-fill model, hardware, quant, and context — you just add your tok/s, VRAM, runtime version. If your numbers match within ±15%, this benchmark gets a confidence lift and a reproduction badge.

Reproduce this benchmark →

Related

Drill into the entity pages for this measurement.

Cite or export

Reference this benchmark in your work. Multiple formats; CC-BY attribution required.

Cite this benchmark or paste it into a README. Copy-to-clipboard; license is CC-BY-4.0 (attribution to RunLocalAI required).

OG card (PNG)
1200x630, social-preview ready
Download SVG
vector card, scales cleanly
Embed this benchmark
Paste into a Reddit thread, blog post, or README — attribution baked in.
<a href="https://www.runlocalai.co/benchmarks/366" rel="noopener">RunLocalAI: Trendyol LLM Asure 12B on NVIDIA GeForce RTX 3080 16GB (Mobile) — 43.4 tok/s</a>

Direct download: .json · .md · .bib · .svg

Next recommended step

Got the same model + hardware? Run it and submit your numbers — successful reproductions lift this benchmark's confidence tier.

Reproduce this benchmark
OrCompare other measurements for Trendyol LLM Asure 12B on NVIDIA GeForce RTX 3080 16GB (Mobile)See the benchmark roadmap