Launch Week 02 wrapped — explore all five launches
Confident AI
Docs
Pricing
Products
LLM Evaluation
LLM Evaluation

Benchmark LLM systems with research-backed metrics.

LLM Observability
LLM Observability

Trace, monitor, and alert on production LLM systems.

AI Red Teaming
AI Red Teaming

Stress-test LLM apps against adversarial attacks.

AI Governance
AI Governance

Enforce AI standards and controls across teams.

Book a DemoSign Up
Book a DemoSign Up

August 17, 2026

  • Enterprise
  • Self-Hosting

v2.4.0

v2.4.0 centralizes model setup into consolidated /models routes, adds stricter validation and policy enforcement for credential and model updates, and expands Bedrock/Mantle support in both backend and frontend. It also includes Vertex AI routing and pricing fixes, along with audit-log and model cache updates.

Highlights

  • Consolidated project and organization model routes under /models.
  • Added validation for credential and model updates, including rejection of redacted placeholders and empty modelConfig objects.
  • Added Bedrock Mantle support with API selection, API key auth, and optional base override.
  • Improved Vertex AI routing, publisher handling, and judge pricing from the model catalog.

New Features

  • Consolidated Models Routes — Added consolidated project and organization model routes under /models for reads and typed writes.
  • Public Credential Updates — Added public routes to set organization and project model credentials, including project inheritance handling.
  • Organization Model Configuration — Added public routes to set organization platform and model credentials.
  • Project Model Configuration — Added public routes to set project evaluation models, platform model overrides, and project model credentials.
  • Bedrock Mantle Support — Added Bedrock Mantle support with API selection, API key authentication, and optional API base override in backend and frontend flows.

Improvements

  • Model Update Validation — Added request validators and helpers for model credential, evaluation model, and platform model updates.
  • Provider Policy Enforcement — Enforced model provider policy on public model routes and public credential updates.
  • Credential Cache Invalidation — Invalidated credential caches on public organization and project updates.
  • Model Catalog Integration — Normalized Bedrock configs, applied live catalog metadata, and priced Vertex judges from the model catalog.
  • Audit Log Scope — Kept model type information in consolidated model actions and let routes declare their own action scope.

Fixes

  • Vertex Routing — Fixed Vertex model publisher and endpoint resolution, including Anthropic routing and non-Google judge handling.
  • Bedrock Mantle Ping — Adjusted Mantle ping behavior to retry the alternate base instead of failing immediately.
  • Simulation Write Persistence — Persisted the input token cap on simulation model writes.
  • Redteam Error Propagation — Fixed redteam error propagation.
  • Frontend Model Dispatch — Updated frontend model calls to use the consolidated /models route and honor forceRefresh when dispatching fetched models.

Upgrade Notes

Review any automation that calls model routes, because per-type routes were removed, the model type parameter was renamed to type, and public routes were renamed to /models. If you use Bedrock Mantle, configure the new API selection, API key, and optional API base settings before upgrade, and verify that your credentials do not rely on redacted placeholders, empty modelConfig objects, or unsupported assume-role Bedrock configs.

Built byConfident AI