Launch Week 02 wrapped — explore all five launches
Confident AI
Docs
Pricing
Products
LLM Evaluation
LLM Evaluation

Benchmark LLM systems with research-backed metrics.

LLM Observability
LLM Observability

Trace, monitor, and alert on production LLM systems.

AI Red Teaming
AI Red Teaming

Stress-test LLM apps against adversarial attacks.

AI Governance
AI Governance

Enforce AI standards and controls across teams.

Book a DemoSign Up
Book a DemoSign Up

August 21, 2026

  • Enterprise
  • Self-Hosting

v2.5.0

Release v2.5.0 adds public dashboard sharing, model-parameter conflict handling for Anthropic and Portkey models, and several operator-facing model configuration updates. It also includes simulation capability propagation, clickable resource rows across the UI, and a few deployment and integration fixes.

Highlights

  • Public dashboards can now be shared, served read-only, and queried through public resources.
  • Model settings now support topK and improved handling of topP and conflicting provider parameters.
  • Simulation model and capabilities are now propagated into test cases and related workflows.
  • Clickable shared resource rows were added across multiple settings and observatory tables.

New Features

  • Public Dashboards — Added dashboard sharing routes, public resources, and read-only rendering for publicly shared dashboards.
  • Model Parameter Conflicts — Added support for deriving and exposing conflicting model parameter groups from the catalog and applying them during eval argument resolution.
  • TopK Model Setting — Added a topK model setting and wired it through backend persistence and frontend submission.
  • Simulation Model Propagation — Added simulation model fields and related UI support for showing the simulation model on test cases.

Improvements

  • Shared Resource Rows — Added a shared ResourceRow component and reused it across multiple observatory and settings lists for consistent row interactions.
  • Inline Dashboard Editing — Allowed editing a dashboard title and description inline from the dashboard page.
  • Conflict-Aware Model Settings — Kept conflicting model parameters mutually exclusive in the frontend and normalized empty settings before diffing.

Fixes

  • Prompt Commit TopP Handling — Stopped forcing topP when a prompt commit leaves it unset, and treated unset topP as disabled in the frontend.
  • Public Dashboard Query Scoping — Fixed public dashboard queries to scope to the saved widget and requested dashboard, including correct filter handling.
  • Portkey Integration — Fixed parameter conflict resolution for Portkey by resolving conflicts against the resolved gateway model.
  • Saved Model Settings Cleanup — Dropped saved parameters that the selected model does not support before sending model setting updates.

Upgrade Notes

Apply the updated model catalog generation so Anthropic family-keyed settings and conflict groups are available, and review any integrations or scripts that depend on topP being defaulted. If you use public dashboards or Portkey, verify the new public resource routes and conflict resolution behavior after upgrade.

Built byConfident AI