Changelog
Every change to the SupraBench API, in reverse-chronological order. Subscribe via Atom or watch the GitLab repository.
v1 — Live for Partners Paid demand-gated
The /v1/ API is live and answering requests today —
but only for invite-only Partner keys (free, for
non-profit / research / open-source projects). The self-serve paid
tiers (Starter / Pro / Enterprise) flip on once the waitlist hits
launch threshold; the surface area below is what's already shipped
and what paid keys will use unchanged.
v1 — Surface frozen (April 18, 2026)
- Added:
GET /v1/models— list ranked models with optional tag filter. - Added:
GET /v1/models/:slug— full per-bench score breakdown. - Added:
GET /v1/benches— list benchmarks with quality ratings. - Added:
GET /v1/best?tag=...— top-N models for a capability tag. - Added:
GET /v1/tags— full tag taxonomy with counts. - Added:
GET /v1/export.json— single-shot full snapshot, Pro+ only. - Auth: Bearer-token format
sb_live_+ 64 hex chars. - Limits: per-tier rate (60 / 300 / 1 200 / custom rpm) and quota (10k / 100k / 1M / custom monthly) buckets.
- Errors: 11 stable
error.codevalues across 401, 402, 403, 404, 422, 429, 500, 503. - Caching: 5-min TTL on rankings, 1-h on tags, 24-h on bulk export.
- Versioning: URL-based major (
/v1/); RFC 8594Sunsetheader for deprecations.
Legend
- Added — new endpoint, field or feature. Always backward-compatible within a major version.
- Changed — behaviour tweak that's not a breaking change (perf, error message wording, internal limits).
- Deprecated — endpoint or field marked for removal. Comes with a
Sunsetresponse header at least 6 months before disappearance. - Removed — actually deleted. Triggers a major-version bump if it changed observable behaviour.
- Fixed — bug fix. Always backward-compatible.
- Security — fix with security implications. We email all active subscribers immediately.
Subscribe to updates
- Email: every active subscriber gets release notes for material changes (added endpoints, deprecations, security fixes).
- RSS / Atom:
https://gitlab.com/florian-fischer-group/suprabench/-/tags?format=atom - GitLab tags: each released version is tagged in the open-source repo.
- Programmatic: a future
GET /v1/_metaendpoint will return current API version, last-deployed-at and a link to the latest changelog entry.