Overview
Rather than a task being applied uniformly across all rows, conditional rubrics allow for rows to be pre-filtered on somerun_condition.
Filtered out rows receive a "skipped" status. They appear as empty in the evaluation results table
and are excluded from evaluation dashboard calculations.
The following example filters out rows where the subject is not 'math'.
Run conditions are currently supported via the SDK only for auto evaluations of type guided_decoding.
Format
Therun_condition object is a discriminated union on op with the following properties supported:
- Leaf types:
const,var(item locator references) - Comparison ops:
eq,ne,lt,lte,gt,gte - Set ops:
in,not_in - Logical ops:
and,or,not,is_null,is_not_null