Integrations
Confident AI supports a wide range of integrations to seamlessly fit into your existing workflow. Whether you're using native SDKs or third-party frameworks, we've got you covered.
Overview
Integrations come in handy for two different workflows:
- When you wish to trace your LLM app, and
- When you wish to run evals in development
All integrations support the former use case. For running evals in development, you'll need to check in each individual integration's documentation pages to know whether they are capable of running end-to-end, component-level, and multi-turn evals.
Connecting this to your stack?Bring traces and evals into the tools your team already usesTalk to an expertOpenTelemetry (OTEL)
OpenTelemetry is an open-source, vendor-neutral observability framework. Confident AI natively accepts OTEL traces at https://otel.confident-ai.com, making it the best option for teams that:
- Use any programming language (not just Python/TypeScript)
- Already have an OTEL-based observability stack
- Want a standards-based approach to tracing with no vendor lock-in
- Need distributed tracing across multiple services
OpenTelemetry Setup
Full quickstart and attribute reference for exporting OTEL traces to Confident AI.
Distributed Tracing
Correlate traces across multiple services and microservices.
Third-Party Integrations
Auto-instrument your LLM application with one-line integrations for popular frameworks and providers.
OpenAI
Chat completion and responses APIs.
LangChain
Framework for building AI applications.
Pydantic AI
Type-safe agent framework for Python.
LangGraph
Graph-based framework for stateful AI applications.
OpenAI Agents
OpenAI's agent framework for intelligent assistants.
LlamaIndex
Data framework for RAG systems and knowledge agents.
Crew AI
Multi-agent orchestration for collaborative AI workflows.
Vercel AI SDK
The TypeScript AI SDK by Vercel for all AI-based applications.
Strands Agents
AWS open-source agent framework with native OTel tracing.
Google ADK
Google's Agent Development Kit for building multi-agent systems.
smolagents
Add AI tracing to smolagents agent runs, planning, steps, and local tools in Python with confident-trace.
Agno
Add AI tracing to Agno agents, teams, tools, and workflows in Python with confident-trace.
Claude Agent SDK
Trace Claude Agent SDK invocations in Python and configure experimental native OpenTelemetry export with confident-trace.
Cloud Runtimes
Send OpenTelemetry traces from agents deployed on AWS, Microsoft Azure, and Google Cloud to Confident AI. Each guide covers the hosted agent's exporter configuration and the platform-specific setup.
AWS Bedrock AgentCore
Send traces from agents hosted on Amazon Bedrock AgentCore Runtime to Confident AI.
Microsoft Foundry
Send OpenTelemetry traces from Microsoft Foundry hosted agents to Confident AI.
Google Gemini Enterprise
Trace agents on Google Agent Runtime, formerly Vertex AI Agent Engine, with Confident AI.
LLM Gateways
If you use an LLM gateway or proxy, these integrations automatically capture traces across all the providers you route through.
Last updated on