fix(goldset): score panel open by default + sparse-negatives hint
The validator score panel was collapsed by default, so taggers thought nothing was happening. Now open by default, with a caption explaining the metrics measure "not-a-holding" detection and become meaningful as more "לא הלכה" items are tagged (showing the current negative count while it's small). Verified: tsc --noEmit 0. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
@@ -71,9 +71,12 @@ function isTagged(it: GoldsetItem): boolean {
|
|||||||
|
|
||||||
function ScorePanel({ batch }: { batch: string }) {
|
function ScorePanel({ batch }: { batch: string }) {
|
||||||
const { data } = useGoldsetScore(batch);
|
const { data } = useGoldsetScore(batch);
|
||||||
const [open, setOpen] = useState(false);
|
const [open, setOpen] = useState(true);
|
||||||
if (!data || data.labeled === 0) return null;
|
if (!data || data.labeled === 0) return null;
|
||||||
const rows = Object.entries(data.validators);
|
const rows = Object.entries(data.validators);
|
||||||
|
// negatives so far (truly "not a holding") = tp+fn of any validator.
|
||||||
|
const af = data.validators.any_flag;
|
||||||
|
const negatives = af ? af.tp + af.fn : 0;
|
||||||
return (
|
return (
|
||||||
<div className="rounded-lg border border-rule bg-surface">
|
<div className="rounded-lg border border-rule bg-surface">
|
||||||
<button
|
<button
|
||||||
@@ -88,6 +91,12 @@ function ScorePanel({ batch }: { batch: string }) {
|
|||||||
</button>
|
</button>
|
||||||
{open && (
|
{open && (
|
||||||
<div className="px-4 pb-3 overflow-x-auto">
|
<div className="px-4 pb-3 overflow-x-auto">
|
||||||
|
<p className="text-[0.72rem] text-ink-muted mb-2">
|
||||||
|
המדדים מודדים זיהוי <strong>"לא-הלכה"</strong> (יישום / ציטוט-קטוע / אי-הכרעה...).
|
||||||
|
{negatives < 10
|
||||||
|
? ` עד כה תויגו רק ${negatives} פריטי "לא הלכה" — המספרים יהפכו משמעותיים ככל שיצטברו עוד (במיוחד מבקט המסומנים).`
|
||||||
|
: " precision גבוה = מעט אזעקות-שווא; recall גבוה = תופס את רוב ה'לא-הלכה'."}
|
||||||
|
</p>
|
||||||
<table className="w-full text-sm tabular-nums">
|
<table className="w-full text-sm tabular-nums">
|
||||||
<thead>
|
<thead>
|
||||||
<tr className="text-ink-muted text-[0.72rem] border-b border-rule">
|
<tr className="text-ink-muted text-[0.72rem] border-b border-rule">
|
||||||
|
|||||||
Reference in New Issue
Block a user