Back to dashboard
`docs/design/search-quality-eval.md` Phase 1.1 (Class C deprecation-aware, paired-comparison mode)

Search-quality version diff: v1.1.0 → v1.2.0 (deprecation pairs)

For each (query, modern_uri, legacy_uri) triple: run cupertino search "<query>" --limit 10, classify the outcome as modern_wins (modern rank < legacy rank), legacy_wins, tied, modern_only (only modern in top-10), legacy_only, or both_missing. The Class C concern is that the ranker should prefer the modern Swift form on every pair; an agent grounded on cupertino search "URL" should land on apple-docs://foundation/url (Swift struct), not apple-docs://foundation/nsurl (legacy ObjC class).

Measured 2026-05-21·Strong

Headline result
modern-wins rate 90.00% → 100.00%
Method & sourceBrowse all citationsNo metric token detected — see sources.html

Read in detail

Each card opens its own page. The headline and charts above are all you need at a glance; the cards are for the why and how.