Update Test Criteria Configuration
Replace the full configuration of a single test criteria, identified by its alias.
The alias must match an existing test criteria on the evaluation, and the replacement configuration is validated against the evaluation’s current items before being applied. The request is rejected if the evaluation is archived, if no test criteria matches the alias, or if any contributor annotation task for the evaluation has already been claimed or completed — at that point labelers are in-flight and mutating the task definition would corrupt their work.
Authorizations
Headers
Body
Full replacement for the test criteria's configuration JSON. Only allowed when no contributor annotation tasks for this evaluation have been claimed or completed.
Response
Successful Response
The identity that created the entity.
The tags associated with the entity
failed, completed, running "evaluation"Reason for evaluation status
Progress of the evaluation's underlying async job
Tasks executed during evaluation. Populated with optional task view.
- ChatCompletionEvaluationTask
- GenericInferenceEvaluationTask
- ApplicationVariantV1EvaluationTask
- AgentexOutputEvaluationTask
- MetricEvaluationTask
- AutoEvaluationQuestionTask
- AutoEvaluationGuidedDecodingEvaluationTask
- AutoEvaluationAgentEvaluationTask
- ContributorEvaluationQuestionTask
- CustomFunctionEvaluationTask
Metadata key-value pairs for the evaluation
Number of task errors across all items in this evaluation.

