Project Integrations
Connect Slack, Discord, Microsoft Teams, PagerDuty, email, Jira, Linear, or GitHub Issues to your project.
Integrations connect your project to external tools for notifications, project management, and CI quality gates. Every active notification integration receives events based on the notification settings you configure.
Notifications
Send notifications to your team via chat, email, or on-call workflows. Each notification integration lets you independently toggle which events trigger a notification — see Notification Events for the full list.
Slack
Connects Confident AI to a Slack workspace via OAuth. Once connected, select a public channel where notifications will be posted.
To set up Slack:
- Navigate to Project Settings → Integrations
- Click Slack
- Click Connect to Slack — you will be redirected to Slack to authorize the integration
- After authorization, select a channel from the dropdown
- Click Save
Discord
Connects Confident AI to a Discord server via OAuth. Once connected, select the channel where notifications will be posted.
To set up Discord:
- Navigate to Project Settings → Integrations
- Click Discord
- Click Connect to Discord — you will be redirected to Discord to authorize the integration
- After authorization, select a channel from the dropdown
- Click Save
Microsoft Teams
Sends notifications to a Microsoft Teams channel via an incoming webhook URL.
To set up Microsoft Teams:
- Navigate to Project Settings → Integrations
- Click Microsoft Teams
- Paste your Teams incoming webhook URL into the Webhook Endpoint field (learn how to create one here)
- Click Save
Sends notifications to selected project members by email. Each event has its own list of recipients.
To set up email:
- Navigate to Project Settings → Integrations
- Click Email
- Under each event you want emailed (Notify on Test Run Complete, Notify on Alert, Notify on Report Generation), select one or more project members from the dropdown
- Click Save under that event
PagerDuty
Routes notifications to PagerDuty using an Events API v2 routing key.
To set up PagerDuty:
- Navigate to Project Settings → Integrations
- Click PagerDuty
- Paste your PagerDuty Events API v2 routing key into the Routing Key field
- Click Save
Project Management
File tickets from traces directly into your team's work management tools. Unlike notification integrations, project management integrations are triggered manually from the trace detail view — not by events.
Linear
Connects Confident AI to a Linear workspace via OAuth. Once connected, select the team where tickets will be filed. You can then open Linear tickets directly from any trace's detail view.
To set up Linear:
- Navigate to Project Settings → Integrations
- Click Linear
- Click Connect to Linear — you will be redirected to Linear to authorize the integration
- After authorization, select a team from the dropdown
- Click Save
GitHub Issues
Installs the Confident AI GitHub App on your GitHub organization or account, then selects the repository where issues will be filed. You can then open GitHub issues directly from any trace's detail view.
To set up GitHub Issues:
- Navigate to Project Settings → Integrations
- Click GitHub Issues
- Click Install GitHub App — you will be redirected to GitHub to install the app on your org or account
- After installation, select a repository from the dropdown
- Click Save
Jira
Connects Confident AI to a Jira site via OAuth. Once connected, select the Jira project and issue type for new issues. You can then open Jira issues directly from any trace's detail view.
To set up Jira:
- Navigate to Project Settings → Integrations
- Click Jira
- Click Connect to Jira — you will be redirected to Atlassian to authorize the integration
- After authorization, select a Project and an Issue type (and a Site, if you have access to more than one)
- Click Save
CI / Quality Gates
Block pull and merge requests on evaluation results and catch regressions before merge. Each has its own setup guide:
- PR Eval Gate — gates GitHub pull requests. See PR Eval Gate.
- MR Eval Gate — gates GitLab merge requests. See MR Eval Gate.
- Code Scanning — scans pull requests for AI-application code vulnerabilities. See Code Scanning.
Notification events
Each notification integration lets you toggle individual event types on or off after connecting (for email, you choose recipients per event instead). The events available depend on the integration.
| Event | Description | Supported by |
|---|---|---|
| Notify on Test Run Complete | Fires whenever a test run completes in your project | Slack, Discord, Teams, Email, PagerDuty |
| Notify on Comment | Fires whenever a comment is posted on a trace, span, thread, or test case | Slack, Discord |
| Notify on Alert | Fires whenever a project alert is triggered | Slack, Discord, Teams, Email, PagerDuty |
| Notify on Report Generation | Fires whenever a report is generated |
Alert notifications also have an Alert Severities setting: only alerts at the selected severities are delivered to that integration, and selecting none stops alert notifications for it.
Setting this up for your organization?Set up the controls your team needs before a wider rolloutTalk to usLast updated on