Guides
End-to-end walkthroughs that combine Confident AI features in implementation workflows.
Overview
Guides are end-to-end walkthroughs for common Confident AI implementation workflows.
Use these guides when you want to see how multiple Confident AI features work together in a real setup, with the relevant code and configuration in one place.
End-to-End Guides
Choose a guide based on the workflow you want to implement:
Build Test Runs from Traces
Open a test run, stream your app's traces into it as test cases, and let Confident AI evaluate each one at the trace and component level — over the API or OpenTelemetry.
Build Filtered Views from a URL
Construct a link that opens a Confident AI page with your filters already applied — share it, bookmark it, or generate it from CI.
Generating Reports for Stakeholders
Plan what leadership cares about, build it into a custom Executive Report template, and automate delivery so a curated report reaches your stakeholders on a schedule.
Evaluate MCP Servers
Set up distributed tracing for MCP hosts and servers, then evaluate whether your agent calls the right tools with the right arguments against a dataset before you ship.
Vibe Code Your Administration
Install the confident-client Agent Skill and drive the Admin SDK from Cursor, Claude Code, or Codex — creating projects, inviting members, and provisioning keys with plain-English prompts.
Provision Projects for Agents on the Fly
Use this guide to provision a dedicated Confident AI project for each agent your users build, then route its traces into the correct project.
Authenticate AI Connections with Client Credentials
Connect to an OAuth2-protected endpoint (Azure AD / Microsoft Entra ID or Auth0) by having Confident AI fetch a Bearer token before every request.
Set Up Long-Running AI Connections
Evaluate agents that take minutes to respond by enabling Async Responses on your AI connection and posting results back through the Evals API.
Set Up the Confident Agent in an Air-Gapped Environment
Deploy the Confident Agent in an air-gapped or egress-restricted network using outbound-only WebSocket Secure (WSS) connectivity.
Standardize Onboarding with Custom Agent Skills
Use this guide to serve project-specific onboarding and governance instructions to Claude Code, Codex, Cursor, and other coding agents.