Visual diagram
CC-BY-4.0

Benchmark request lifecycle

Seven states, three side branches, one terminal node. The state names match the schema enum exactly so contributors and operators read the same vocabulary.

Last reviewed 2026-05-08 · By Fredoline Eruo, Independent Local AI Researcher.

Benchmark request lifecycle — seven statesState diagram showing the seven request lifecycle states: pending, accepted, claimed, measured (terminal), rejected, duplicate, archived. Solid arrows trace the happy path pending to measured. Dashed arrows show side transitions to rejected, duplicate, and archived.triage okclaimsubmit resultout of scopematches existingstalereleasependingsubmitted · awaiting triageacceptedscoped · queued for an operatorclaimedoperator commits · runningmeasuredresult published · terminalrejectedout-of-scope or unverifiableduplicatematches existing benchmarkarchivedno operator picks it upSide states (terminal)Happy pathRunLocalAI · CC-BY-4.0

The states

pending — submitted; awaiting triage. Editors decide whether the request is in scope, well-formed, and measurable. accepted — the request has been scoped and is queued for an operator with the right hardware. claimed — an operator has committed to running it; this is a soft lock, not a hard one. The operator can release the claim back to accepted at any time.

measured — the result has been published and tied to the request. This is the terminal happy-path state. The triple gains a measurement; subsequent reproductions attach to that measurement, not back to the request.

rejected — the request was out of scope (asking us to measure a hosted API, for example), or the configuration was unverifiable. duplicate — the request matches an existing benchmark already in the catalog; the contributor is pointed at the existing row. archived — accepted, but no operator picked it up within the freshness window. Archived requests can be revived by anyone.

The color encoding follows queue conventions used elsewhere on the site: amber for waiting (pending), blue for ready (accepted), purple for in-flight (claimed), green for done (measured), red for declined (rejected), gray for resolved- but-not-measured (duplicate, archived). The vocabulary is load-bearing — every list view, admin action, and email template uses these exact strings.

Embed snippet

<a href="https://runlocalai.co/resources/benchmark-request-lifecycle" rel="noopener">RunLocalAI: Benchmark Request Lifecycle</a>

License: CC-BY-4.0.

Next steps

Submit a triple you want measured.