Introducing Confident Monitor

Introduction to the Admin SDK

Programmatically manage your organization, projects, teams, and access control.

Overview

The Admin SDK is the Confident AI API in Python and TypeScript, covering 275 operations across 35 resources. It reaches two kinds of resource:

  • Account resources are organization-wide: the organization itself, projects, members and invitations, roles, policies, permissions, governance policies, and API keys.
  • Project resources live inside a single project: prompts, datasets, traces, spans, threads, metrics, test runs, evaluations, dashboards, annotation queues, and red teaming.

Use the Admin SDK when work needs to run programmatically instead of through the platform UI. Common use cases include project provisioning, member onboarding, role synchronization, API key rotation, pulling a prompt at runtime, and pushing goldens to a dataset from a pipeline.

Organization vs Project Scope

Every operation is scoped to either the organization or a single project, and the resource decides which API key it needs. One client can hold both keys and picks the right one for each call.

ScopeEnvironment variableReaches
OrganizationCONFIDENT_ORG_API_KEYclient.organization, client.projects, client.project(id)
ProjectCONFIDENT_PROJ_API_KEYevery other resource

Learn how to retrieve each key in Authentication.

client = ConfidentAI()          # reads both environment variables

client.organization.get()       # organization key
client.datasets.list()          # project key

Key Capabilities

Setting this up for your organization?Set up the controls your team needs before a wider rolloutTalk to us

Last updated on

Built byConfident AI