Integrations

Connect Slack, Discord, Microsoft Teams, PagerDuty, email, Linear, or GitHub Issues to your project.

Integrations connect your project to external tools for notifications and project management. Every active integration receives events based on the notification toggles you configure.

Project Integrations

Notifications

Send notifications to your team via chat, email, or on-call workflows. Each notification integration lets you independently toggle which events trigger a notification — see Notification Events for the full list.

Slack

Connects Confident AI to a Slack workspace via OAuth. Once connected, select a public channel where notifications will be posted.

To set up Slack:

  1. Navigate to Project SettingsIntegrations
  2. Click Slack
  3. Click Connect to Slack — you will be redirected to Slack to authorize the integration
  4. After authorization, select a channel from the dropdown
  5. Click Save

Discord

Connects Confident AI to a Discord server via OAuth. Once connected, select the channel where notifications will be posted.

To set up Discord:

  1. Navigate to Project SettingsIntegrations
  2. Click Discord
  3. Click Connect to Discord — you will be redirected to Discord to authorize the integration
  4. After authorization, select a channel from the dropdown
  5. Click Save

Microsoft Teams

Sends notifications to a Microsoft Teams channel via an incoming webhook URL.

To set up Microsoft Teams:

  1. Navigate to Project SettingsIntegrations
  2. Click Microsoft Teams
  3. Paste your Teams incoming webhook URL into the Webhook Endpoint field (learn how to create one here)
  4. Click Save

Email

Sends notifications to selected project members by email.

To set up email:

  1. Navigate to Project SettingsIntegrations
  2. Click Email
  3. Select one or more project members from the dropdown
  4. Click Save

PagerDuty

Routes notifications to PagerDuty using an Events API v2 routing key.

To set up PagerDuty:

  1. Navigate to Project SettingsIntegrations
  2. Click PagerDuty
  3. Paste your PagerDuty Events API v2 routing key into the Routing Key field
  4. Click Save

You can find your routing key in PagerDuty under ServicesService Directory → your service → Integrations.

Project Management

File tickets from traces directly into your team’s work management tools. Unlike notification integrations, project management integrations are triggered manually from the trace detail view — not by events.

Linear

Connects Confident AI to a Linear workspace via OAuth. Once connected, select the team where tickets will be filed. You can then open Linear tickets directly from any trace in the Observatory.

To set up Linear:

  1. Navigate to Project SettingsIntegrations
  2. Click Linear
  3. Click Connect to Linear — you will be redirected to Linear to authorize the integration
  4. After authorization, select a team from the dropdown
  5. Click Save

GitHub Issues

Installs the Confident AI GitHub App on your GitHub organization or account, then selects the repository where issues will be filed. You can then open GitHub issues directly from any trace in the Observatory.

To set up GitHub Issues:

  1. Navigate to Project SettingsIntegrations
  2. Click GitHub Issues
  3. Click Install GitHub App — you will be redirected to GitHub to install the app on your org or account
  4. After installation, select a repository from the dropdown
  5. Click Save

To fully remove Confident AI’s GitHub access, uninstall the app from your GitHub organization settings after disconnecting here.

Notification events

Each notification integration lets you toggle individual event types on or off after connecting. The events available depend on the integration.

EventDescriptionSupported by
Notify on Test Run CompleteFires whenever a test run completes in your projectSlack, Discord, Teams, Email, PagerDuty
Notify on CommentFires whenever a comment is posted on a trace, span, thread, or test caseSlack, Discord
Notify on AlertFires whenever a project alert is triggeredSlack, Discord, Teams, Email, PagerDuty

You must connect and save an integration before its notification toggles become active.