The agent watches a full college volleyball match and lists every point that ended as a block: the set, the score after the point, the player or players credited with the block, the opposing hitter who was blocked, and the setter who fed that attack. The reference holds 18 block points.
What a good answer has to get right, and how the verifier checks it
- Every block point is found, and none is invented
- An entry is tied to a reference block by the set and the exact score after the point, which is unique within a set. The score is an F1, so missed blocks and entries for points that were not blocks both cost.
- The blockers are credited
- The set of credited blockers must be exact: a solo block and a shared block are different answers.
- The blocked hitter is named
- The hitter whose attack was stopped must be right.
- The setter is named
- The setter who fed the attack must be right. This has to be followed back through the rally; it cannot be read from the celebration after the point.
- One slip in attribution earns half
- An entry with exactly one of the three attributions wrong earns 0.5 instead of 1. With two or more wrong it earns nothing. Exact matches are assigned first, so a half-right entry cannot take the place of a fully right one.
How the checks become one score
Score = F1 over credit: precision = credit / entries listed, recall = credit / 18, where credit is 1 per fully right block and 0.5 per block with one attribution wrong. A last name alone is accepted where it is unambiguous.
What scores zero
No solution file or one that cannot be read, an empty list, or a list in which no entry has the right set and score with at most one attribution wrong.
Outside the score: one further block point, in set 2 at 1-2, whose official record is corrupted. An entry for it is set aside: it earns nothing and costs nothing. The verifier also reports how many block points were found regardless of attribution, as a diagnostic.