Overview
Rather than a task being applied uniformly across all rows, conditional rubrics allow for rows to be pre-filtered on somerun_condition.
Filtered out rows receive a "skipped" status. They appear as empty in the evaluation results table
and are excluded from evaluation dashboard calculations.
The following example filters out rows where the subject is not 'math'.
guided_decoding.
Format
Therun_condition object is a discriminated union on op with the following properties supported:
- Leaf types:
const,var(item locator references) - Comparison ops:
eq,ne,lt,lte,gt,gte - Set ops:
in,not_in - Logical ops:
and,or,not,is_null,is_not_null