Compass is an AI-powered workflow builder that enables enterprise engineers to import data, transform it using LLMs or Python, analyze it to inform various decisions, and perform relevant actions in one interface.
You can access Compass in SGP (Scale GenAI Platform) through the Workflows tab. If you don’t see the tab on your SGP, please contact us.The basic building block in Compass is called a card. Cards can produce data, transform data, or perform actions on data. When you start a new Compass session, you can add cards to build your workflow.Each card has its own interface appropriate for its function. Think of it like a form that you have to fill out to tell the card what you want it to do. For example, the Python card appropriately has a code editor for you to write the code to transform the data you have imported in a previous step.Cards stack upon each other, allowing you to perform rich transformations or analyses over the previous card’s data. As an example, we can take a CSV that has different LLM completions against a prompt and have an LLM judge it against ground truth for evals.Compass sessions are long-lived, so you can run cards that take extended periods of time (for example, model evaluations using reasoning LLMs on thousands of rows) without losing your work. You can save cards while iterating, then run them later when you’re ready. Each session has a unique URL identifier that gives you persistent access to your session.
Compass offers a variety of cards for pulling, transforming, and performing actions on data. Additional cards will be added based on enterprise use case requirements. Some of the most useful cards include:
Traces: Read data from the SGP Traces tab
CSV: Read data directly from a CSV file
Python: Transform your data using Python
Call LLM: Generate a text prompt from a template for each row of your dataset and evaluate it using an LLM
Chart: Generate visualizations from your transformed dataset
Most cards are available in SGP > Workflows > Playground. Compass instances deployed in customer VPCs may have a limited set of available cards based on customer requirements.
If you have a sequence of Compass cards that you run over and over, you can save them as a Compass workflow so that you can easily load and re-run them again later.If you have a sequence of Compass cards that you run repeatedly, you can save them as a workflow to easily load and re-run them later.A powerful feature of Compass workflows is the ability to execute them on a schedule. Within the Save Workflow modal, toggle the Set a Schedule option and configure your desired schedule. Scheduled workflows allow you to automate repetitive tasks.
Creating a custom Compass card to support your specific enterprise use case is straightforward. If your organization has functionality requirements, please contact us. Additional core cards will be announced soon.
