Integrations
Confident AI supports a wide range of integrations to seamlessly fit into your existing workflow. Whether you're using native SDKs or third-party frameworks, we've got you covered.
Overview
Integrations come in handy for two different workflows:
- When you wish to trace your LLM app, and
- When you wish to run evals in development
All integrations support the former use case. For running evals in development, you'll need to check in each individual integration's documentation pages to know whether they are capable of running end-to-end, component-level, and multi-turn evals.
Connecting this to your stack?Bring traces and evals into the tools your team already usesTalk to an expertOpenTelemetry (OTEL)
OpenTelemetry is an open-source, vendor-neutral observability framework. Confident AI natively accepts OTEL traces at https://otel.confident-ai.com, making it the best option for teams that:
- Use any programming language (not just Python/TypeScript)
- Already have an OTEL-based observability stack
- Want a standards-based approach to tracing with no vendor lock-in
- Need distributed tracing across multiple services
OpenTelemetry Setup
Full quickstart and attribute reference for exporting OTEL traces to Confident AI.
Distributed Tracing
Correlate traces across multiple services and microservices.
Third-Party Integrations
Auto-instrument your LLM application with one-line integrations for popular frameworks and providers.
OpenAI
Chat completion and responses APIs.
LangChain
Framework for building AI applications.
Pydantic AI
Type-safe agent framework for Python.
LangGraph
Graph-based framework for stateful AI applications.
OpenAI Agents
OpenAI's agent framework for intelligent assistants.
LlamaIndex
Data framework for RAG systems and knowledge agents.
Crew AI
Multi-agent orchestration for collaborative AI workflows.
Vercel AI SDK
The TypeScript AI SDK by Vercel for all AI-based applications.
Strands Agents
AWS open-source agent framework with native OTel tracing.
Google ADK
Google's Agent Development Kit for building multi-agent systems.
LLM Gateways
If you use an LLM gateway or proxy, these integrations automatically capture traces across all the providers you route through.
