> ## Documentation Index
> Fetch the complete documentation index at: https://docs.gp.scale.com/llms.txt
> Use this file to discover all available pages before exploring further.

# SGP Overview

> Overview of SGP

## Overview

The Scale GenAI Platform empowers modern enterprises to rapidly develop, test and deploy Generative AI applications for custom use cases, using their proprietary data assets.

The platform supports two distinct workflows related to Generative AI application development.
The first one is **Agent Building and Execution**, or the act of having an agent that runs.
The second one is **Agent Operations**, or the act of managing the agent, reviewing the data that it outputs, and improving that agent.

<img src="https://mintcdn.com/scalegp/PXJzYavEL11OqpKz/images/nextgen-evaluation/overview/Sgp-Overview-Diagram.png?fit=max&auto=format&n=PXJzYavEL11OqpKz&q=85&s=a45e02ffb7da7355ecedf9bf6bcebd60" alt="overview-diagram" width="2150" height="1010" data-path="images/nextgen-evaluation/overview/Sgp-Overview-Diagram.png" />

The ultimate goal of SGP is to enable teams of developers to be able to build and improve multiple agents specializing in multiple goals all on the same platform. SGP helps every Enterprise build and maintain a portfolio of agents.

## Agentex - Agent Building and Execution

### View Agents in the Platform

The agent builder view shows a list of all the agents that are currently being built or monitored in your account.

<img src="https://mintcdn.com/scalegp/TJSx3Jn9QFSSQ-uS/images/nextgen-evaluation/overview/agent-overview.png?fit=max&auto=format&n=TJSx3Jn9QFSSQ-uS&q=85&s=8fc9de8881f20d2b31113c1a4a9f912e" alt="agent-overview" width="3454" height="1688" data-path="images/nextgen-evaluation/overview/agent-overview.png" />

Clicking into an agent allows users to interact with an agent, monitor the agent, and view evaluations performed by an agent.
Users can also see the deployment history of the agent.

<img src="https://mintcdn.com/scalegp/PXJzYavEL11OqpKz/images/nextgen-evaluation/overview/agent-overview-specific-agent.png?fit=max&auto=format&n=PXJzYavEL11OqpKz&q=85&s=8268258e2a2b77e4ac88517414b50a5d" alt="agent-overview" width="3784" height="1826" data-path="images/nextgen-evaluation/overview/agent-overview-specific-agent.png" />

### Building Agents with Agentex

SGP's goal for building agents is to provide the most developer friendly framework and environment possible. At the core, building agents is just writing code.
Our goal is for all developers to continue developing in the environment they are most familiar with at the fastest speed possible.

#### Example Agent

This is an example of a medical assistant agent we built, a medical assistant that helps users find doctors at a specific hospital based on their symptoms. The agent diagnoses their symptom and then directs them to a doctor.

<img src="https://mintcdn.com/scalegp/PXJzYavEL11OqpKz/images/nextgen-evaluation/overview/agent-overview-example-agent.png?fit=max&auto=format&n=PXJzYavEL11OqpKz&q=85&s=2de43ebcbf3fcc057172bc9dda63966f" alt="agent-overview" width="2628" height="1398" data-path="images/nextgen-evaluation/overview/agent-overview-example-agent.png" />

#### Agentex Building Framework and Philosophy.

In today's world, pulling an agent from the internet is easy, most agent frameworks focus on helping users get started on writing an agent. The problem that SGP Agentex aims to solve is to help users quickly get from a locally developed agent into a fully functional production quality agent other people can use.
Backend - Agentex provides a simple CLI that enables users to run the agent locally.
Frontend - Agentex also provides the ability to run a local UI very quickly to allow users to test.
Users can then go to their local machine and run an agent.

<img src="https://mintcdn.com/scalegp/PXJzYavEL11OqpKz/images/nextgen-evaluation/overview/agent-overview-agent-ui.png?fit=max&auto=format&n=PXJzYavEL11OqpKz&q=85&s=01c1604e19f9792fe58a51db69abae52" alt="agent-overview" width="2636" height="1254" data-path="images/nextgen-evaluation/overview/agent-overview-agent-ui.png" />

This experience enables a fast development cycle:

* User can test exactly what's going on.
* User can make alterations to the code and change the behavior.
* User can test again.

Agentex has a built a continuous deployment pipeline that takes changes from the agent and pushes them through a series of steps, and automatically deploys your agent for you.

<img src="https://mintcdn.com/scalegp/PXJzYavEL11OqpKz/images/nextgen-evaluation/overview/agent-overview-ci-cd-pipeline.png?fit=max&auto=format&n=PXJzYavEL11OqpKz&q=85&s=4e7a77f0e6ee3bb45a22a3ea6b9989f3" alt="agent-overview-ci-cd-pipeline" width="2758" height="1426" data-path="images/nextgen-evaluation/overview/agent-overview-ci-cd-pipeline.png" />

After making changes, users will automaticaly be able to see on the platform the deployment history of the agent.

<img src="https://mintcdn.com/scalegp/PXJzYavEL11OqpKz/images/nextgen-evaluation/overview/agent-overview-specific-agent-deployment.png?fit=max&auto=format&n=PXJzYavEL11OqpKz&q=85&s=1a30055c93c84ac41f0d3ad0ce1d3845" alt="agent-overview" width="3784" height="1826" data-path="images/nextgen-evaluation/overview/agent-overview-specific-agent-deployment.png" />

### Interacting with Agents through Agentex

A user can interact with an agent by clicking "Open Agent" on the page of the specific Agent.

<img src="https://mintcdn.com/scalegp/PXJzYavEL11OqpKz/images/nextgen-evaluation/overview/agent-overview-specific-agent-click-open-agent.png?fit=max&auto=format&n=PXJzYavEL11OqpKz&q=85&s=62ba89ac782abcf82e5301b1e2ff6315" alt="agent-overview" width="3772" height="911" data-path="images/nextgen-evaluation/overview/agent-overview-specific-agent-click-open-agent.png" />

This will take users to a **fully deployed, hosted version** of the agent developers and end users can interact with.

<img src="https://mintcdn.com/scalegp/PXJzYavEL11OqpKz/images/nextgen-evaluation/overview/agent-overview-deployed-agent.png?fit=max&auto=format&n=PXJzYavEL11OqpKz&q=85&s=aa1865d1af9c667b653c361f8a4bb9d5" alt="agent-overview-deployed-agent" width="2758" height="1462" data-path="images/nextgen-evaluation/overview/agent-overview-deployed-agent.png" />

Since this is a live deployment, all interactions captured from this deployment will show up in our tracing interface (see below as part of Agent Operations) to assist developers with monitoring their application.

## AgentOps- Agent Monitoring and Improvements

### Tracing Agents with AgentOps

All agents built and deployed with Agentex (like in the example above) will have their interactions automatically show up in the tracing library.

<img src="https://mintcdn.com/scalegp/bfTNCUMX53f6WbCD/images/nextgen-evaluation/overview/agent-overview-tracing-demo.png?fit=max&auto=format&n=bfTNCUMX53f6WbCD&q=85&s=3e56970677b63db673584e3887925d0f" alt="agent-overview-tracing-demo" width="2760" height="1466" data-path="images/nextgen-evaluation/overview/agent-overview-tracing-demo.png" />

The AgentOps Tracing Platform also has an SDK that allows users to upload their own traces to get the same experience.

Users can also see specific details on the execution of the agent in the tracing view.

<img src="https://mintcdn.com/scalegp/TJSx3Jn9QFSSQ-uS/images/nextgen-evaluation/overview/agent-overview-tracing-demo-details.png?fit=max&auto=format&n=TJSx3Jn9QFSSQ-uS&q=85&s=5522e1eef4ec902d217395066a513759" alt="agent-overview-tracing-demo-details" width="3454" height="1688" data-path="images/nextgen-evaluation/overview/agent-overview-tracing-demo-details.png" />

Users can see the input, output, and all the steps the agent went through for the execution. Engineers can use this data to understand what tools the agent is calling, what steps the agents are going through for reasoning, and how the agent is performing and make adjustements to the agent.

<img src="https://mintcdn.com/scalegp/bfTNCUMX53f6WbCD/images/nextgen-evaluation/overview/agent-overview-tracing-details-output.png?fit=max&auto=format&n=bfTNCUMX53f6WbCD&q=85&s=da1816932183153695e6ac9844553dcb" alt="agent-overview-tracing-demo-details-output" width="1896" height="830" data-path="images/nextgen-evaluation/overview/agent-overview-tracing-details-output.png" />

To learn more about tracing, refer to the [tracing](/docs/v5/tracing/overview) section.

### Evaluating Agents with AgentOps

After identifying areas that can be improved from your agents, the AgentOps platform supports developers in running evaluations on their agents.

Users can create evaluation datasets through traces and then run evaluations on the platform.

<img src="https://mintcdn.com/scalegp/TJSx3Jn9QFSSQ-uS/images/nextgen-evaluation/overview/agent-overview-evaluations.png?fit=max&auto=format&n=TJSx3Jn9QFSSQ-uS&q=85&s=2cef82717fae2711ef22cda362dcc93f" alt="agent-overview-evaluations" width="3454" height="1688" data-path="images/nextgen-evaluation/overview/agent-overview-evaluations.png" />

The platform supports two types of evaluations:

* **LLM-as-a-Judge:** Have an LLM evaluate the dataset
* **Contributor Evaluation:** Have humans annotate the dataset

To learn more about evaluations, refer to the [evaluations](/docs/v5/next-gen-evaluation/overview) section.

### Summary

The combination of all these tools supports the agent development lifecycle.

1. Developing the local agent.
2. Review and deploy the local agent.
3. Test the deployed agent.
4. Monitor the deployed agent through traces.
5. Segment out evaluations from traces.

Enterprises that scale agents need to stop worrying about the overhead of development and focus on the business logic.
SGP is a platform designed to enable that.

<img src="https://mintcdn.com/scalegp/bfTNCUMX53f6WbCD/images/nextgen-evaluation/overview/agent-overview-summary.png?fit=max&auto=format&n=bfTNCUMX53f6WbCD&q=85&s=b0cfda4339dd1dabea1650486117f8df" alt="agent-overview-summary" width="2150" height="978" data-path="images/nextgen-evaluation/overview/agent-overview-summary.png" />
