Launch Week 02 wrapped — explore all five launches

August 14, 2026

  • Evals
  • Red Teaming
  • Security
  • Integrations
  • Quality of Life

Heat of the Moment

TGIF! Thank god it's features, here's what we shipped this week:

Red teaming got a war room this week: the new Attack Heatmap plots every vulnerability against every attack method, and the Refusal Decay graph shows how long your model keeps saying no as multi-turn attacks grind on. Meanwhile test runs landed in custom dashboards with segment-by-metric support, the test run page picked up saved views, Bedrock learned IAM role access, governance policies can now be inherited, and ⌘K summons a search bar from anywhere. Turns out the only thing decaying faster than refusals is your excuse for not knowing what shipped.

Changelog August 14, 2026

Added

Attack Heatmap

Risk assessments now include a heatmap that plots every vulnerability against every attack method, colored by fail rate, with row headers that stay pinned while you scroll. Click any cell to drill straight into the test cases behind it, so "which attack breaks which defense" stops being a spreadsheet exercise. Your weakest cell is now the brightest one. Heat seeking, fully guided.

Refusal Decay Graph

A new tab on risk assessments plots turns against attacks as a step-down survival curve, showing exactly how long your model keeps refusing before a multi-turn attack wears it down. Test cases also surface why an attack stopped early, so you know whether the model held the line or the attacker ran out of turns. Everyone breaks eventually—now you know on which turn.

Test Runs in Custom Dashboards

Custom dashboards now speak the test run data model, and widgets can segment by metric—pass rates, median scores, and per-metric breakdowns land in tables right next to your traces and spans. One dashboard for offline evals and production, no more tab juggling. Run the numbers, literally.

Saved Views on Test Runs

The test run page now supports saved views, so the filter combination you rebuild every morning can be saved once and reopened forever. Share the setup, skip the setup. A room with a view, permanently booked.

Governance Policy Inheritance

Governance policies can now inherit from base policies, with controls from the base applying live to every child. Define the org-wide rulebook once, extend it per team, and stop copy-pasting controls between policies. Inherit the win.

Control Resource Filters

Control filters now show which resources actually exist across your organization and how many projects carry each one, so scoping a control stops being a guessing game. Populated dropdowns, real counts, zero archaeology. Everything under control.

IAM Role Access for Bedrock

The Bedrock integration now supports IAM role-based access: spin up the role from our CloudFormation template, and we assume it with a per-organization external ID—no long-lived AWS keys pasted anywhere. Your security team can finally stop side-eyeing the credentials page. Role model behavior.

Simulation Model Settings

You can now choose the model that powers conversation simulation and red teaming attack simulation, at the organization or project level. Run your simulations on the provider you trust (or the one your provider policy allows). Sim-ple as that.

Command-K Search

Press ⌘K anywhere on the platform to pull up a search bar and jump straight to what you need—no sidebar spelunking required. The fastest route between two pages is now two keystrokes. Special K, zero sugar.

Guided Tutorials

Every platform page now ships with a guided tutorial, so new teammates learn features where the features live instead of in a docs tab they'll never reopen. Onboarding that walks, so you can run. Take the guided tour.

Metric DAG Builder

Metrics can now be composed as DAGs: chain steps together in a visual builder, with validation, versioning, and full API support for pushing and pulling definitions. Complex, multi-step evaluation logic without duct-taping metrics together in code. DAG-nabbit, it's good.

MCP Server for On-Prem

Self-hosted deployments now ship with the MCP server, so on-prem customers get the same coding-agent superpowers as the cloud. Your agents, your VPC, no exceptions. On-prem, on point.

OAuth for MCP

Connecting your coding agents over MCP now runs through a proper OAuth consent flow with project discovery built in—authorize once, pick your project, no API keys pasted into config files. Consent screens: boring, correct, finally here. Auth-orized personnel only.

SSE Payload Types for AI Connections

AI Connection streaming events can now be matched by payload type, so SSE streams with mixed event shapes parse cleanly instead of hoping every frame looks the same. Point at the type path, get the right field every time. Strong type energy.

Changed

Vertex AI Global & Anthropic Support

Vertex AI now supports global and multi-region endpoint locations, and Anthropic models on Vertex route through the right publisher with catalog-accurate pricing. Claude on Vertex, from anywhere on the map. Think global, act model.

Graph Tooltips Behave

Test run graph card tooltips now render above everything instead of getting clipped by the card next door. Hover, read, move on—no more tooltip peekaboo. Stay on top of it.

That's the drop for this week—see you next Friday.

Built byConfident AI