Launch Week 3: Five days of launches

Project Integrations

Connect Slack, Discord, Microsoft Teams, PagerDuty, email, Jira, Linear, or GitHub Issues to your project.

Integrations connect your project to external tools for notifications, project management, and CI quality gates. Every active notification integration receives events based on the notification settings you configure.

Project Integrations

Notifications

Send notifications to your team via chat, email, or on-call workflows. Each notification integration lets you independently toggle which events trigger a notification — see Notification Events for the full list.

Slack

Connects Confident AI to a Slack workspace via OAuth. Once connected, select a public channel where notifications will be posted.

To set up Slack:

  1. Navigate to Project Settings → Integrations
  2. Click Slack
  3. Click Connect to Slack — you will be redirected to Slack to authorize the integration
  4. After authorization, select a channel from the dropdown
  5. Click Save

Discord

Connects Confident AI to a Discord server via OAuth. Once connected, select the channel where notifications will be posted.

To set up Discord:

  1. Navigate to Project Settings → Integrations
  2. Click Discord
  3. Click Connect to Discord — you will be redirected to Discord to authorize the integration
  4. After authorization, select a channel from the dropdown
  5. Click Save

Microsoft Teams

Sends notifications to a Microsoft Teams channel via an incoming webhook URL.

To set up Microsoft Teams:

  1. Navigate to Project Settings → Integrations
  2. Click Microsoft Teams
  3. Paste your Teams incoming webhook URL into the Webhook Endpoint field (learn how to create one here)
  4. Click Save

Email

Sends notifications to selected project members by email. Each event has its own list of recipients.

To set up email:

  1. Navigate to Project Settings → Integrations
  2. Click Email
  3. Under each event you want emailed (Notify on Test Run Complete, Notify on Alert, Notify on Report Generation), select one or more project members from the dropdown
  4. Click Save under that event

PagerDuty

Routes notifications to PagerDuty using an Events API v2 routing key.

To set up PagerDuty:

  1. Navigate to Project Settings → Integrations
  2. Click PagerDuty
  3. Paste your PagerDuty Events API v2 routing key into the Routing Key field
  4. Click Save

Project Management

File tickets from traces directly into your team's work management tools. Unlike notification integrations, project management integrations are triggered manually from the trace detail view — not by events.

Linear

Connects Confident AI to a Linear workspace via OAuth. Once connected, select the team where tickets will be filed. You can then open Linear tickets directly from any trace's detail view.

To set up Linear:

  1. Navigate to Project Settings → Integrations
  2. Click Linear
  3. Click Connect to Linear — you will be redirected to Linear to authorize the integration
  4. After authorization, select a team from the dropdown
  5. Click Save

GitHub Issues

Installs the Confident AI GitHub App on your GitHub organization or account, then selects the repository where issues will be filed. You can then open GitHub issues directly from any trace's detail view.

To set up GitHub Issues:

  1. Navigate to Project Settings → Integrations
  2. Click GitHub Issues
  3. Click Install GitHub App — you will be redirected to GitHub to install the app on your org or account
  4. After installation, select a repository from the dropdown
  5. Click Save

Jira

Connects Confident AI to a Jira site via OAuth. Once connected, select the Jira project and issue type for new issues. You can then open Jira issues directly from any trace's detail view.

To set up Jira:

  1. Navigate to Project Settings → Integrations
  2. Click Jira
  3. Click Connect to Jira — you will be redirected to Atlassian to authorize the integration
  4. After authorization, select a Project and an Issue type (and a Site, if you have access to more than one)
  5. Click Save

CI / Quality Gates

Block pull and merge requests on evaluation results and catch regressions before merge. Each has its own setup guide:

  • PR Eval Gate — gates GitHub pull requests. See PR Eval Gate.
  • MR Eval Gate — gates GitLab merge requests. See MR Eval Gate.
  • Code Scanning — scans pull requests for AI-application code vulnerabilities. See Code Scanning.

Notification events

Each notification integration lets you toggle individual event types on or off after connecting (for email, you choose recipients per event instead). The events available depend on the integration.

EventDescriptionSupported by
Notify on Test Run CompleteFires whenever a test run completes in your projectSlack, Discord, Teams, Email, PagerDuty
Notify on CommentFires whenever a comment is posted on a trace, span, thread, or test caseSlack, Discord
Notify on AlertFires whenever a project alert is triggeredSlack, Discord, Teams, Email, PagerDuty
Notify on Report GenerationFires whenever a report is generatedEmail

Alert notifications also have an Alert Severities setting: only alerts at the selected severities are delivered to that integration, and selecting none stops alert notifications for it.

Setting this up for your organization?Set up the controls your team needs before a wider rolloutTalk to us

Last updated on

Built byConfident AI