An overview of Scale Generative Platform’s Inference Capabilities
claude-3.5-sonnet
scale-gp
claude-3.5-sonnet
it’s anthropic/claude-3-5-sonnet-20240620
We need to do this because we have many providers, some of which provide the same model.
anthropic
, openai
, llmengine
etc.
openai/gpt-4o
or anthropic/claude-3-5-sonnet-20240620
For a complete list of model names for models not hosted on SGP (e.g., OpenAI and Anthropic models), you can view the documentation for the open source project we use to route to the correct provider here https://docs.litellm.ai/docs/providers
For models hosted on SGP, you can visit https://llm-engine.scale.com/model_zoo/ to get the model names. Note that for these models, the provider is llmengine
.