Models
List Models
Dataset Items
Evaluations
Evaluation Items
Models
List Models
GET
/
v5
/
models
curl --request GET \
--url https://api.egp.scale.com/v5/models \
--header 'x-api-key: <api-key>'
{
"object": "list",
"items": [
{
"id": "<string>",
"object": "model",
"name": "<string>",
"model_type": "generic",
"model_vendor": "openai",
"vendor_configuration": {
"model_image": {
"registry": "<string>",
"repository": "<string>",
"tag": "<string>",
"predict_route": "/predict",
"command": [
"<string>"
],
"streaming_predict_route": "<string>",
"streaming_command": [
"<string>"
],
"request_schema": {},
"response_schema": {},
"env_vars": {},
"readiness_delay": 120,
"healthcheck_route": "/readyz"
},
"model_infra": {
"endpoint_type": "sync",
"cpus": "<string>",
"gpus": 0,
"gpu_type": "nvidia-tesla-t4",
"memory": "8Gi",
"storage": "16Gi",
"min_workers": 0,
"max_workers": 1,
"per_worker": 10,
"high_priority": false,
"labels": {},
"public_inference": false
}
},
"status": "failed",
"model_metadata": {},
"created_at": "2023-11-07T05:31:56Z",
"created_by_user_id": "<string>"
}
],
"limit": 100,
"total": 123,
"has_more": true
}
Authorizations
Query Parameters
Available options:
openai
, cohere
, vertex_ai
, anthropic
, azure
, gemini
, launch
, llmengine
, model_zoo
, bedrock
, xai
Required range:
1 <= x <= 1000
Response
200
application/json
Successful Response
The response is of type object
.
curl --request GET \
--url https://api.egp.scale.com/v5/models \
--header 'x-api-key: <api-key>'
{
"object": "list",
"items": [
{
"id": "<string>",
"object": "model",
"name": "<string>",
"model_type": "generic",
"model_vendor": "openai",
"vendor_configuration": {
"model_image": {
"registry": "<string>",
"repository": "<string>",
"tag": "<string>",
"predict_route": "/predict",
"command": [
"<string>"
],
"streaming_predict_route": "<string>",
"streaming_command": [
"<string>"
],
"request_schema": {},
"response_schema": {},
"env_vars": {},
"readiness_delay": 120,
"healthcheck_route": "/readyz"
},
"model_infra": {
"endpoint_type": "sync",
"cpus": "<string>",
"gpus": 0,
"gpu_type": "nvidia-tesla-t4",
"memory": "8Gi",
"storage": "16Gi",
"min_workers": 0,
"max_workers": 1,
"per_worker": 10,
"high_priority": false,
"labels": {},
"public_inference": false
}
},
"status": "failed",
"model_metadata": {},
"created_at": "2023-11-07T05:31:56Z",
"created_by_user_id": "<string>"
}
],
"limit": 100,
"total": 123,
"has_more": true
}