> ## Documentation Index
> Fetch the complete documentation index at: https://docs.gp.scale.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Contributor Evaluation

> Defer evaluation tasks to human contributors.

## Create Evaluation

### Navigate to the Evaluate tab and click "Create evaluation".

<img src="https://mintcdn.com/scalegp/2sSrpizRElJqluR6/images/nextgen-evaluation/create-evaluation.png?fit=max&auto=format&n=2sSrpizRElJqluR6&q=85&s=ac97aa300f96b6d6a673417f7e4d70b8" alt="create-evaluation" width="3366" height="1700" data-path="images/nextgen-evaluation/create-evaluation.png" />

### Add Evaluation Details

Add in Evaluation name, description (optional), tags (optional), and select a dataset.

<img src="https://mintcdn.com/scalegp/2sSrpizRElJqluR6/images/nextgen-evaluation/evaluation-details.png?fit=max&auto=format&n=2sSrpizRElJqluR6&q=85&s=4c36a9cf9f0b7ddb332a11d7bfb39159" alt="create-evaluation" width="3374" height="1712" data-path="images/nextgen-evaluation/evaluation-details.png" />

### Add Contributor Evaluation

Contributor Evaluation lets you set up an evaluation that is labeled by humans.

<img src="https://mintcdn.com/scalegp/2sSrpizRElJqluR6/images/nextgen-evaluation/contributor-evaluation-selection.png?fit=max&auto=format&n=2sSrpizRElJqluR6&q=85&s=9316cd7565f258d6f2e3dba051975a59" alt="create-evaluation" width="1568" height="824" data-path="images/nextgen-evaluation/contributor-evaluation-selection.png" />

### Configure Contributor Evaluation

Configure the contributor Evaluation.

#### Annotation Layout configuration

The first step is to configure the data pieces that your contributors will see. You can select which columns you want the data to appear, and you can also configure how the data in the columns will show up.
<div> For example, for this configuration: </div>

<img src="https://mintcdn.com/scalegp/2sSrpizRElJqluR6/images/nextgen-evaluation/contributor-evaluation-configuration.png?fit=max&auto=format&n=2sSrpizRElJqluR6&q=85&s=1cad81017e5d959628bdbb2d228cdbbb" alt="create-evaluation" width="1244" height="986" data-path="images/nextgen-evaluation/contributor-evaluation-configuration.png" />

<div> Annotators will see this layout when they label. </div>

<img src="https://mintcdn.com/scalegp/2sSrpizRElJqluR6/images/nextgen-evaluation/contributor-evaluation-view.png?fit=max&auto=format&n=2sSrpizRElJqluR6&q=85&s=c80d0ef4189e6db996de2a6f9e0116e2" alt="create-evaluation" width="3384" height="1680" data-path="images/nextgen-evaluation/contributor-evaluation-view.png" />

#### Select Questions

Next, select the questions you want your contributor to answer. You can select a pre-existing question, or you can add a new one in this workflow.

<img src="https://mintcdn.com/scalegp/2sSrpizRElJqluR6/images/nextgen-evaluation/contributor-evaluation-select-question.png?fit=max&auto=format&n=2sSrpizRElJqluR6&q=85&s=fcead6dd6a0d36ff83679e8e45553dbe" alt="create-evaluation" width="1276" height="778" data-path="images/nextgen-evaluation/contributor-evaluation-select-question.png" />

<img src="https://mintcdn.com/scalegp/2sSrpizRElJqluR6/images/nextgen-evaluation/contributor-evaluation-selected-question.png?fit=max&auto=format&n=2sSrpizRElJqluR6&q=85&s=0c01d8f6fdefeb66c51c6c91849ca560" alt="create-evaluation" width="1250" height="772" data-path="images/nextgen-evaluation/contributor-evaluation-selected-question.png" />

<div> The questions that you select will show up in the right hand side of the data the contributors will see. </div>

<img src="https://mintcdn.com/scalegp/2sSrpizRElJqluR6/images/nextgen-evaluation/contributor-evaluation-question-view.png?fit=max&auto=format&n=2sSrpizRElJqluR6&q=85&s=50dd493d3b006e1082c50341125e20d8" alt="create-evaluation" width="3394" height="1684" data-path="images/nextgen-evaluation/contributor-evaluation-question-view.png" />

### Create Evaluation

Select the rows on the dataset you want to run the evaluation, and click **Create Evaluation**.

<img src="https://mintcdn.com/scalegp/2sSrpizRElJqluR6/images/nextgen-evaluation/contributor-evaluation-create.png?fit=max&auto=format&n=2sSrpizRElJqluR6&q=85&s=be4f08083d7ba95eff78965f2c322efc" alt="create-evaluation" width="3372" height="1714" data-path="images/nextgen-evaluation/contributor-evaluation-create.png" />

### Annotate evaluations

When you create an annotation, you can now navigate to that evaluation and see the a tab for **Annotation Tasks**. You or assigned labelers can now start labeling these tasks.

<img src="https://mintcdn.com/scalegp/2sSrpizRElJqluR6/images/nextgen-evaluation/contributor-evaluation-annotation-task.png?fit=max&auto=format&n=2sSrpizRElJqluR6&q=85&s=5ef2bfa43f22a08a8c805c2fdc052f74" alt="create-evaluation" width="3416" height="1510" data-path="images/nextgen-evaluation/contributor-evaluation-annotation-task.png" />

## View Evaluation Results

### Completed annotations.

After all the tasks have been annotated, the tasks will show up as completed on the annotation tasks table.

<img src="https://mintcdn.com/scalegp/2sSrpizRElJqluR6/images/nextgen-evaluation/contributor-evaluations-completed.png?fit=max&auto=format&n=2sSrpizRElJqluR6&q=85&s=c78b4e7896dc4c60a578fbc229ddf880" alt="create-evaluation" width="3406" height="1358" data-path="images/nextgen-evaluation/contributor-evaluations-completed.png" />

### Data

The results will show up as a one column for each question on the data table.

<img src="https://mintcdn.com/scalegp/2sSrpizRElJqluR6/images/nextgen-evaluation/contributor-eval-results-data.png?fit=max&auto=format&n=2sSrpizRElJqluR6&q=85&s=f81aedf789f48e24360a4c54572734a1" alt="create-evaluation" width="3406" height="1592" data-path="images/nextgen-evaluation/contributor-eval-results-data.png" />

### Overview

The results will also show up as a graph with the visual representation of the evaluation result on the overview page.

<img src="https://mintcdn.com/scalegp/2sSrpizRElJqluR6/images/nextgen-evaluation/contributor-eval-results-overview.png?fit=max&auto=format&n=2sSrpizRElJqluR6&q=85&s=524cee05217ced729653a9f2051b81f2" alt="create-evaluation" width="3412" height="1636" data-path="images/nextgen-evaluation/contributor-eval-results-overview.png" />
