100 Ways to Evaluate

TGIF! Thank god it’s features, here’s what we shipped this week:

Why limit yourself to one LLM provider? With Portkey integration, you can now evaluate using 100+ providers. OpenAI, Anthropic, Cohere, local models—if Portkey supports it, so do we.

Changelog December 5, 2025

Added

  • Self-Served SSO - Set up SAML SSO for your organization without waiting on us. Enterprise security, self-service style.
  • Portkey Gateway - One integration, 100+ providers. Evaluate with whatever model you want, wherever it lives.
  • Custom Graphs - Build visualizations that actually match your KPIs. Your metrics, your way.

Changed

  • Optional Tags - Tags are now optional for evaluations. Less friction, faster setup. Just run the thing.