Add a new test criteria (LLM judge, contributor question, etc.) to an existing evaluation. Gated: rejected if any contributor annotation task has been claimed or completed. Kicks off the evaluation workflow so the new task runs against existing items.
Documentation Index
Fetch the complete documentation index at: https://docs.gp.scale.com/llms.txt
Use this file to discover all available pages before exploring further.
New test criteria to add to the evaluation. Rejected when contributor annotation tasks for this evaluation have already been claimed or completed. Triggers a rerun so the new task executes against existing items.
Successful Response
The identity that created the entity.
The tags associated with the entity
failed, completed, running "evaluation"Reason for evaluation status
Progress of the evaluation's underlying async job
Tasks executed during evaluation. Populated with optional task view.
Metadata key-value pairs for the evaluation
Number of task errors across all items in this evaluation.