Launch Week 02 wrapped — explore all five launches

Red Teaming Quickstart (No-Code)

Run your first risk assessment in the platform UI — no code required.

Included on the Enterprise plan. Book a demo, opens in a new tab. Not included on the Team plan. Not included on the Starter plan. Not included on the Free plan.

Overview

This quickstart walks you through running your first no-code risk assessment on Confident AI. By the end of this guide, you'll have:

  • Connected your AI app to Confident AI
  • Configured your first security framework
  • Run a risk assessment on your AI application and viewed it on the dashboard

No-code risk assessments let any team member analyze an AI application for security and compliance issues directly in the Confident AI platform.

How it works

Risk assessments follow a simple 4-step process:

  1. Connect your AI application — configure an AI Connection so Confident AI can communicate with your system.
  2. Define a security framework — select or create a framework (e.g., OWASP Top 10 for LLMs, MITRE ATLAS) that contains vulnerabilities and attacks of your choice.
  3. Generate and execute attacks — automatically generate adversarial inputs and send them to your AI application.
  4. Evaluate and assess risk — Confident AI analyzes responses, detects successful exploitations, and generates a structured risk assessment report.

Here's a visual representation of the data flow during a risk assessment:

sequenceDiagram
    participant User as You
    participant Platform as Confident AI
    participant Framework as Security Framework
    participant AI as Your AI App

    User->>Platform: Start Risk Assessment

    Platform->>Framework: Load vulnerabilities & attacks

    loop For each vulnerability and attack
        Framework-->>Platform: Generate adversarial input
        Platform->>AI: Send attack (adversarial input)
        AI-->>Platform: Return response
        Platform->>Framework: Evaluate response (jailbreak? policy violation?)
        Framework-->>Platform: Risk result
    end

    Platform-->>User: Risk Assessment Report Generated
    Note over User,Platform: View CVSS score, vulnerabilities, attack surface

Run your first risk assessment

  1. Connect Your AI App

    First, set up an AI Connection so Confident AI can communicate with your app.

    Setup AI Connection
    1. Navigate to Project SettingsAI Connections
    2. Click New AI Connection
    3. Give it a unique identifying name
    4. Configure the endpoint, payload, and output key path
    5. Click Save
  2. Create a Framework

    A framework defines the vulnerabilities and attacks that will be used in your assessment.

    Add a Framework on Confident AI
    1. Navigate to the Frameworks tab
    2. Click Add Framework
    3. Select a template (e.g., OWASP, NIST, MITRE ATLAS) or create a custom framework
    4. Click Save

    You can edit vulnerabilities, attacks, and priorities anytime from the framework configuration page.

  3. Run the Assessment

    From your framework configuration page, click Run Assessment and select the AI Connection you want to test.

    Create a risk assessment

    Confident AI will generate adversarial inputs from your framework and send them to your app.

  4. View Results

    Once the assessment completes, your report will be available in the risk profile section.

    Viewing risk assessment results

    The report includes:

    • Executive Summary — overall pass rate, vulnerability coverage, and critical issues
    • Test Cases — every adversarial input and your AI's response
    • CVSS Score & Overview — risk score distribution and exploitability breakdown by vulnerability

    Done ✅. You've run your first no-code risk assessment. You can also download a PDF report with the full breakdown and remediation recommendations.

Red teaming generates adversarial inputs, most AI models have guardrails that prevent it from generating harmful outputs, hence we recommend uncensored or neutral models for generations. Here's a list of reliable models you can use for red teaming:

ModelParamsGuardrails
huihui-ai/Llama-3.3-70B-Instruct-abliterated:featherless-ai70BUncensored
NousResearch/Hermes-3-Llama-3.1-70B:featherless-ai70BNeutral
huihui-ai/Qwen2.5-72B-Instruct-abliterated:featherless-ai72BUncensored
dphn/dolphin-2.9.2-qwen2-72b:featherless-ai72BUncensored
dphn/dolphin-2.9-llama3-70b:featherless-ai70BUncensored
huihui-ai/Mistral-Small-24B-Instruct-2501-abliterated:featherless-ai24BUncensored
dphn/dolphin-2.9.3-mistral-nemo-12b:featherless-ai12BUncensored
NousResearch/Hermes-3-Llama-3.1-8B:featherless-ai8BNeutral
mlabonne/NeuralDaredevil-8B-abliterated:featherless-ai8BUncensored
huihui-ai/Qwen2.5-7B-Instruct-abliterated-v3:featherless-ai7BUncensored

Uncensored models have their safety guardrails removed; Neutral models are minimally aligned with low refusal rates and the most reliable structured output. You can use these models by setting your Platform Model to Hugging Face provider along with your credentials.

Next steps

Now that you've run your first risk assessment, dive deeper into the platform:

Securing AI for production?Find safety gaps before users, auditors, or attackers doBook a security briefing

Last updated on

Built byConfident AI