Launch Week 02 wrapped — explore all five launches
Confident AI
Docs
Pricing
Products
LLM Evaluation
LLM Evaluation

Benchmark LLM systems with research-backed metrics.

LLM Observability
LLM Observability

Trace, monitor, and alert on production LLM systems.

AI Red Teaming
AI Red Teaming

Stress-test LLM apps against adversarial attacks.

AI Governance
AI Governance

Enforce AI standards and controls across teams.

Book a DemoSign Up
Book a DemoSign Up

Introduction to Synthetic Data Generation

Generate synthetic goldens from your own data sources

Included on the Enterprise plan. Book a demo, opens in a new tab. Included on the Team plan. Not included on the Starter plan. Not included on the Free plan.

Overview

Synthetic data generation allows you to automatically create high-quality goldens from your existing data sources — documents stored in Google Drive, messages in Slack channels, pages in Notion, or files in SharePoint. Instead of manually writing goldens one by one, you can connect a data source and let Confident AI generate evaluation-ready goldens at scale.

How It Works

At a high level, synthetic data generation follows three steps:

  1. Connect a Data Source

    Navigate to Project Settings > Data Sources and connect an external source such as Google Drive, Slack, Notion, or SharePoint. Each source type requires its own set of credentials.

  2. Create a Generation Config

    Under Datasets > Automations, create a generation configuration that points to your data source. You can control parameters like the maximum number of goldens generated per context chunk.

  3. Generate

    Click Generate and Confident AI will pull documents from your data source, chunk them into contexts, and use an LLM to synthesize goldens — complete with inputs, expected outputs, and context fields.

Supported Data Sources

Google Drive

Connect a shared folder and generate goldens from .txt, .pdf, and .docx files.

Slack

Generate goldens from channel message histories.

Notion

Pull page content and generate goldens from your knowledge base.

SharePoint

Connect via Azure AD and generate goldens from SharePoint files.

Next Steps

Data Source Connectors

Learn how to set up credentials and connect each supported data source.

Manage Datasets

Learn how to review, finalize, and manage the goldens that were generated.

Curating datasets across your team?Keep collaboration, annotation, and dataset quality organized at scaleBook a demo

Last updated on

Built byConfident AI