Launch Week 02 wrapped — explore all five launches
Confident AI
Docs
Pricing
Products
LLM Evaluation
LLM Evaluation

Benchmark LLM systems with research-backed metrics.

LLM Observability
LLM Observability

Trace, monitor, and alert on production LLM systems.

AI Red Teaming
AI Red Teaming

Stress-test LLM apps against adversarial attacks.

AI Governance
AI Governance

Enforce AI standards and controls across teams.

Book a DemoSign Up
Book a DemoSign Up

Setup and Installation

Create an account and install DeepEval

Overview

To use Confident AI, you will need to setup initially through DeepEval, our open-source SDK for running LLM evals. You'll need to:

  • Create a free account
  • Login with your Confident API key in DeepEval

Login with your API key

  1. Install DeepEval

    At the root of your project directory, install deepeval:

    pip install -U deepeval

  2. Create an account

    Navigate to app.confident-ai.com and create a free account. Once logged in, you'll be able to access your project API key from the dashboard.

  3. Set API key as env variable

    Set your project API key as an environment variable:

    export CONFIDENT_API_KEY="confident_us..."

    Alternatively, you can login directly using DeepEval:

    deepeval login

    This will prompt you to enter your API key and save it locally.

Next Steps

Now that you have Confident AI set up, the next section will guide you through LLM evaluation in development. This is where you'll learn to systematically test and improve your AI applications before deployment.

Rolling this out for your team?Plan the fastest path from setup to a production evaluation workflowTalk to us
Built byConfident AI