15 (query, sql_filter) pairs. For each:
- Compute
relevant_uris = {row.doc_uri for row in doc_symbols WHERE <filter>} - Run
cupertino search "<query>" --limit 10 - Compute P@1, P@5, P@10 against
relevant_urismembership
Read-only SQLite via file:...?mode=ro. No writes anywhere.
Harness source: /tmp/cupertino-search-eval-symbol-attribute.py. Full JSON dump: /tmp/cupertino-search-eval-symbol-attribute-20260520.json.