POST
/
v4
/
evaluation-configs

Authorizations

​
x-api-key
string
header
required

Headers

​
x-selected-account-id
string | null

Body

application/json
​
account_id
string
required

The ID of the account that owns the given entity.

​
question_set_id
string
required
​
auto_evaluation_model
enum<string>
default:
gpt-4-turbo-2024-04-09

The name of the model to be used for auto-evaluation

Available options:
llama-3-1-70b-instruct,
gpt-4-turbo-2024-04-09
​
evaluation_type
default:
llm_auto

Evaluation type

Available options:
llm_auto
​
studio_project_id
string

Response

200 - application/json
​
account_id
string
required

The ID of the account that owns the given entity.

​
created_at
string
required

The date and time when the entity was created in ISO format.

​
created_by_user_id
string
required

The user who originally created the entity.

​
evaluation_type
enum<string>
required

Evaluation type

Available options:
studio,
llm_auto,
human,
llm_benchmark
​
id
string
required

The unique identifier of the entity.

​
question_set_id
string
required
​
auto_evaluation_model
enum<string>

The name of the model to be used for auto-evaluation

Available options:
gpt-4-32k-0613,
gpt-4-turbo-preview,
gpt-4-turbo-2024-04-09,
llama-3-70b-instruct,
llama-3-1-70b-instruct
​
studio_project_id
string
List Evaluation ConfigsGet Evaluation Config