POST
/
v4
/
evaluation-configs
JavaScript
import SGPClient from 'sgp';

const client = new SGPClient({
  apiKey: 'My API Key',
});

const evaluationConfig = await client.evaluationConfigs.create({
  account_id: 'account_id',
  question_set_id: 'question_set_id',
});

console.log(evaluationConfig.id);
{
  "evaluation_type": "studio",
  "question_set_id": "<string>",
  "studio_project_id": "<string>",
  "auto_evaluation_model": "gpt-4-32k-0613",
  "auto_evaluation_parameters": {
    "temperature": 1,
    "batch_size": 13
  },
  "id": "<string>",
  "created_at": "2023-11-07T05:31:56Z",
  "account_id": "<string>",
  "created_by_user_id": "<string>",
  "created_by_identity_type": "user"
}

Authorizations

x-api-key
string
header
required

Headers

x-selected-account-id
string

Body

application/json
question_set_id
string
required
account_id
string
required

The ID of the account that owns the given entity.

evaluation_type
default:llm_auto

Evaluation type

Available options:
TitleConst
Evaluation Typellm_auto
Evaluation Typellm_benchmark
studio_project_id
string
auto_evaluation_model
enum<string>
default:gpt-4-turbo-2024-04-09

The name of the model to be used for auto-evaluation

Available options:
llama-3-1-70b-instruct,
gpt-4-turbo-2024-04-09,
llama-3-70b-instruct-bedrock,
gpt-4o,
gpt-4o-mini,
gpt-4.1,
gpt-4.1-mini,
gpt-4.1-nano,
o1,
o3,
o3-mini,
o4-mini
auto_evaluation_parameters
object

Execution parameters for auto-evaluation

Response

Successful Response

evaluation_type
enum<string>
required

Evaluation type

Available options:
studio,
llm_auto,
human,
llm_benchmark
question_set_id
string
required
id
string
required

The unique identifier of the entity.

created_at
string<date-time>
required

The date and time when the entity was created in ISO format.

account_id
string
required

The ID of the account that owns the given entity.

created_by_user_id
string
required

The user who originally created the entity.

created_by_identity_type
enum<string>
required

The type of identity that created the entity.

Available options:
user,
service_account
studio_project_id
string
auto_evaluation_model
enum<string>

The name of the model to be used for auto-evaluation

Available options:
gpt-4-32k-0613,
gpt-4-turbo-preview,
gpt-4-turbo-2024-04-09,
gpt-4o-2024-05-13,
gpt-4o,
gpt-4o-mini-2024-07-18,
gpt-4o-mini,
gpt-4.1,
gpt-4.1-mini,
gpt-4.1-nano,
o1,
o1-mini,
o3,
o3-mini,
o3-mini-2025-01-31,
o4-mini,
gpt-oss-120b,
gpt-oss-20b,
llama-3-70b-instruct,
llama-3-1-70b-instruct,
llama-3-70b-instruct-bedrock
auto_evaluation_parameters
object

Execution parameters for auto-evaluation