Knowledge Base

Connect external data sources to build a knowledge base for evaluation dataset generation.

The Knowledge Base lets you connect external platforms or upload documents directly so Confident AI can automatically generate evaluation datasets from your existing content, rather than creating test cases manually.

Knowledge Base

Supported sources

SourceConnection methodDescription
Google DriveCredentialsSync documents from a specific Google Drive folder
SharePointCredentialsSync documents from Microsoft SharePoint
SlackCredentialsSync messages from Slack channels
NotionCredentialsSync content from Notion pages and databases
SnowflakeCredentialsQuery data from a Snowflake database
SalesforceOAuthSync data from your Salesforce org
DocumentsFile uploadUpload files directly as a knowledge base

Create a data source

  1. Navigate to Project SettingsKnowledge Base
  2. Click New Data Source
  3. Enter a unique Name for the data source
  4. Select a Type from the dropdown
  5. Click Create — you are taken to the data source detail page to configure credentials

Configure credentials

Each source type requires different credentials. Open the data source detail page to fill them in.

Google Drive

FieldDescription
Service Account JSONPaste the full JSON from a Google Cloud service account with read access to the folder
Folder URLURL of the Google Drive folder to sync (e.g. https://drive.google.com/drive/folders/...)

SharePoint

FieldDescription
Tenant IDYour Azure tenant identifier (UUID)
Client IDYour Azure app registration client ID
Client SecretYour Azure app registration secret

Slack

FieldDescription
Bot TokenA Slack bot token starting with xoxb-

Notion

FieldDescription
Integration TokenYour Notion integration secret (starts with secret_)

Snowflake

FieldDescription
HostYour Snowflake account hostname (e.g. xy12345.us-east-1.snowflakecomputing.com)
RoleThe Snowflake role to use (e.g. ACCOUNTADMIN)
WarehouseThe virtual warehouse to use (e.g. COMPUTE_WH)
DatabaseThe database name (e.g. ANALYTICS)
SchemaThe schema name (e.g. PUBLIC)
UsernameYour Snowflake username
PasswordYour Snowflake password

After filling in all fields, click Save — Confident AI will attempt to connect immediately.

Salesforce

Salesforce uses OAuth rather than static credentials.

  1. Open the Salesforce data source detail page
  2. Click Connect Salesforce
  3. Choose Production (login.salesforce.com) or Sandbox (test.salesforce.com)
  4. Click Continue to Salesforce — you will be redirected to authorize Confident AI
  5. After authorization, you are returned to the detail page and the connection is established automatically

To switch orgs or refresh access, click Reconnect Salesforce at any time.

Documents

The Documents source lets you upload files directly rather than pulling from an external platform.

Supported file types: .txt, .pdf, .docx, .md, .markdown, .mdx

Maximum file size: 25 MB per file

To upload documents:

  1. Open the Documents data source detail page
  2. Drag and drop files onto the upload area, or click to browse
  3. Uploaded files appear in the documents list immediately

To remove a document, click the delete icon on its row. Multiple files can be uploaded in a single operation.

Sync (connector sources)

For all sources except Documents, data is pulled from the external platform via sync. Two sync modes are available from the data source detail page:

  • Manual sync — click Sync to pull the latest data on demand
  • Automatic sync — select a sync frequency from the schedule dropdown to keep data current automatically
FrequencyInterval
Manual sync onlyNo automatic sync
Every hourHourly
Every 2 hoursEvery 2 hours
Every 6 hoursEvery 6 hours
Every 12 hoursEvery 12 hours
Every 24 hoursDaily

The Last synced timestamp on the detail page shows when data was last pulled successfully. Sync and the schedule dropdown are disabled until the data source is connected.

Manage data sources

From the Knowledge Base list, each row has action buttons to Sync, Edit, or Delete a data source. Deleting a data source is permanent and cannot be undone.

Knowledge Base is a premium feature. You must be on the Premium plan or above to create data sources.