Launch Week 02 wrapped — explore all five launches
Confident AI
Docs
Pricing
Products
LLM Evaluation
LLM Evaluation

Benchmark LLM systems with research-backed metrics.

LLM Observability
LLM Observability

Trace, monitor, and alert on production LLM systems.

AI Red Teaming
AI Red Teaming

Stress-test LLM apps against adversarial attacks.

AI Governance
AI Governance

Enforce AI standards and controls across teams.

Book a DemoSign Up
Book a DemoSign Up

August 7, 2026

  • Observability
  • Security
  • Red Teaming
  • Integrations
  • Quality of Life

Don't Cry Wolf

TGIF! Thank god it's features, here's what we shipped this week:

Not every ping deserves a page. Alerts now ship with priorities—critical, warning, error, and info—and integrations can filter by them, so Slack hears about the five-alarm fire while the polite FYI stays out of the channel. While we were sorting the inbox: MCP grew a fresh set of tools, report templates graduate from beta, red teaming picks up code vulnerability scanning, orgs can lock model providers to Bedrock-and-friends only, traces export as JSONL, and LLM spans finally log the endpoint they hit. Real wolves only. The boy who cried Slack is in timeout.

Changelog August 7, 2026

Added

  • Alert Priorities & Priority Filtering - Alerts now come in four flavors: critical, warning, error, and info. Set the severity when you create them, then filter integrations so Slack only hears about the five-alarm stuff while the rest of your stack still gets the full picture. Your pager stops treating every ping like the building is on fire. Cry wolf once, shame on you. Cry wolf every deploy—filter that.
  • More MCP Tools - Your coding agents can do more of the platform without leaving the chat. Spin up custom dashboards, annotate over MCP, kick off a risk assessment, or manage metric collections—plus governance assess and golden CRUD if you're feeling ambitious. Fewer tabs, more tools of the trade.
  • Code Vulnerability Scanning (Beta) - Red teaming can now scan for code vulnerabilities straight from the platform—invoke it, get findings, no DIY pipeline required. It's in beta and ready for you to poke holes in… well, your holes. Ship the attack, read the report. Code red, on demand.
  • Model Providers Policy - Organization admins can now disable model providers across every project—for example, Bedrock only, everywhere, no exceptions. One policy, zero "wait, who spun up that OpenAI key?" moments. Governance for the model menu. Provider locked.
  • LLM Span Endpoints - LLM spans can now log the endpoint they called, so traces show not just which model answered but which URL took the hit. Useful when you're routing through gateways, proxies, or three Bedrock regions and need to know which one actually ran. Follow the call to the end.
  • Trace Export as JSONL - Trace exports picked up JSONL as an additional format, so you can stream one JSON object per line into the tools that prefer that shape over a single blob. Same traces, line-by-line. JSON in a line.

Changed

  • Report Templates Out of Beta - Report templates graduated. What shipped as defaults last week is now a first-class, out-of-beta feature—build them, share them, and stop treating the template gallery like a science experiment. Officially not a drill. Report card: A+.

That's the drop for this week—see you next Friday.

Built byConfident AI