POST
/
v4
/
evaluation-configs

Authorizations

​
x-api-key
string
headerrequired

Headers

​
x-selected-account-id
string | null

Body

application/json
​
question_set_id
string
required
​
account_id
string
required

The ID of the account that owns the given entity.

​
evaluation_type
default: llm_auto

Evaluation type

Available options:
llm_auto
​
studio_project_id
string
​
auto_evaluation_model
enum<string>
default: gpt-4-turbo-2024-04-09

The name of the model to be used for auto-evaluation

Available options:
llama-3-1-70b-instruct,
gpt-4-turbo-2024-04-09

Response

200 - application/json
​
evaluation_type
enum<string>
required

Evaluation type

Available options:
studio,
llm_auto,
human,
llm_benchmark
​
question_set_id
string
required
​
id
string
required

The unique identifier of the entity.

​
created_at
string
required

The date and time when the entity was created in ISO format.

​
account_id
string
required

The ID of the account that owns the given entity.

​
created_by_user_id
string
required

The user who originally created the entity.

​
studio_project_id
string
​
auto_evaluation_model
enum<string>

The name of the model to be used for auto-evaluation

Available options:
gpt-4-32k-0613,
gpt-4-turbo-preview,
gpt-4-turbo-2024-04-09,
llama-3-70b-instruct,
llama-3-1-70b-instruct
List Evaluation ConfigsGet Evaluation Config