Chaim
411ee18786
Chair review of the FU-5 gold-set surfaced one internal_committee record whose
case_name was a code ("ARAR-24-9002") rather than a real name. Per the chair's
citation (ערר 9002/24 קרקעות ירושלים 2 בע"מ נ' הוועדה המקומית ירושלים, נבו
13.8.2025, a s.197 compensation appeal), case_name corrected in the DB to
"קרקעות ירושלים 2" (case_number 9002-24 and citation_formatted were already
correct; only 1 such code-named record exists corpus-wide). Re-bootstrapped the
gold-set (the known-item query is now the real name) and refreshed baseline
(aggregate unchanged — the case retrieves identically under the corrected name).
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
70 lines
1.4 KiB
JSON
70 lines
1.4 KiB
JSON
{
|
|
"gold_size": 77,
|
|
"retrieval_config": {
|
|
"MULTIMODAL_ENABLED": true,
|
|
"VOYAGE_RERANK_ENABLED": true,
|
|
"VOYAGE_MODEL": "voyage-3",
|
|
"MULTIMODAL_TEXT_WEIGHT": 0.5,
|
|
"MULTIMODAL_RRF_K": 60,
|
|
"BM25_HYBRID_ENABLED": true
|
|
},
|
|
"overall": {
|
|
"P@5": 0.1922,
|
|
"R@5": 0.9351,
|
|
"nDCG@5": 0.8545,
|
|
"P@10": 0.1013,
|
|
"R@10": 0.987,
|
|
"nDCG@10": 0.8718,
|
|
"MRR": 0.8367
|
|
},
|
|
"by_corpus": {
|
|
"internal_decisions": {
|
|
"P@5": 0.1963,
|
|
"R@5": 0.963,
|
|
"nDCG@5": 0.887,
|
|
"P@10": 0.1019,
|
|
"R@10": 1.0,
|
|
"nDCG@10": 0.899,
|
|
"MRR": 0.871
|
|
},
|
|
"precedent_library": {
|
|
"P@5": 0.1826,
|
|
"R@5": 0.8696,
|
|
"nDCG@5": 0.778,
|
|
"P@10": 0.1,
|
|
"R@10": 0.9565,
|
|
"nDCG@10": 0.808,
|
|
"MRR": 0.7562
|
|
}
|
|
},
|
|
"by_practice_area": {
|
|
"betterment_levy": {
|
|
"P@5": 0.1897,
|
|
"R@5": 0.9231,
|
|
"nDCG@5": 0.8595,
|
|
"P@10": 0.1,
|
|
"R@10": 0.9744,
|
|
"nDCG@10": 0.8761,
|
|
"MRR": 0.8432
|
|
},
|
|
"compensation_197": {
|
|
"P@5": 0.2,
|
|
"R@5": 1.0,
|
|
"nDCG@5": 1.0,
|
|
"P@10": 0.1,
|
|
"R@10": 1.0,
|
|
"nDCG@10": 1.0,
|
|
"MRR": 1.0
|
|
},
|
|
"rishuy_uvniya": {
|
|
"P@5": 0.2,
|
|
"R@5": 0.9706,
|
|
"nDCG@5": 0.861,
|
|
"P@10": 0.1029,
|
|
"R@10": 1.0,
|
|
"nDCG@10": 0.8708,
|
|
"MRR": 0.8346
|
|
}
|
|
},
|
|
"generated_at": "20260531T154736Z"
|
|
} |