July 31, 2026

Cost and Effect

TGIF! Thank god it's features, here's what we shipped this week:

The headliner: Project Cost Analysis, a Cost Insights tab in Data Usage that splits project spend across evals, signals, and platform features—then names the traces, spans, threads, and test runs quietly running up the bill. Everything else this week is about receipts too—audit logs now stream to Datadog and log admin actions, API keys got rotation and expiry APIs, GitLab joined the PR gate, and goldens went full CRUD. Cause, meet effect.

Added

• Project Cost Analysis - Cost Insights came to Data Usage, and it brought receipts. Every project now splits its spend across online evals, offline evals, signals, and platform features, plots it over time by feature or by model, and shows what share of the org total you're personally responsible for. Then evaluation cost breaks down by where the evals actually ran—trace, span, thread, or test run—so the repeat offenders quietly re-incurring cost stop hiding in the aggregate. Turns out it's always the same three spans. Every token has a price on its head.
• GitLab for PR Gate - The PR gate speaks GitLab now. Wire up merge requests the same way GitHub users have been gating theirs—quality checks run before the merge button does anything, and regressions get stopped at the door instead of in production. Same gate, new repo-tation.
• Default Report Templates - Reports now come with templates out of the box, so you can generate something presentable without designing a document from a blank page first. Pick one, run it, send it. Off the shelf, on the money.
• Golden CRUD Endpoints - Goldens went fully programmatic. New endpoints cover every CRUD operation, so you can create, read, update, and delete goldens straight from your pipelines instead of clicking through the dataset UI one row at a time. Automate the source of truth. Golden opportunity.
• API Key Rotation, Grace Periods & Expiry - Key management grew up and got public APIs. Rotate keys programmatically, set a grace period so the old key keeps working while your services catch up, and give keys an expiry date so forgotten credentials stop living forever. Zero-downtime rotation, fully scripted. Everything in good key-ping.
• Audit Logs to Datadog - Audit logs can now be exported straight to Datadog, so your compliance trail lands in the same place as the rest of your telemetry instead of sitting in a tab nobody opens. Ship the evidence where your eyes already are. Log and behold.
• Admin Actions in Audit Logs - Admin actions are now part of the audit log too, which means the people with the most power to change things finally leave the clearest paper trail. Who did what, including the who that could do anything. Trail blazers.
• Governance on Metric Data & Annotations - Governance runtime controls now understand the Metric Data and Annotations data models, extending your policies to two more places sensitive data actually lives. Fewer blind spots, same rulebook. Control freak, respectfully.

Changed

• Classification Charts Move to Traces - The charts that used to hide in the classifications tab now render directly on the traces page, right next to the traces they describe. One page, one story, one less tab to remember. Chart where you are.
• Fetch Trace Returns Everything - Fetching a trace now pulls the full trace, including data that had been offloaded to S3. No more partial payloads with the interesting parts missing because they were too big to stick around. The whole trace, every time. S3 what we did there.

That's the drop for this week—see you next Friday.