Users | Confident AI Docs

Overview

You can track user interactions with your LLM app by setting the user ID in a trace. This allows you to track things such as how much tokens each user is costing you, who interacted with your LLM app the most, etc.

Set Users At Runtime

Python

TypeScript

You can use update_current_trace to set the user_id within traces:

main.py

1 from deepeval.tracing import observe, update_current_trace
2 from openai import OpenAI
3 
4 client = OpenAI()
5 
6 @observe()
7 def llm_app(query: str):
8     res = client.chat.completions.create(
9         model="gpt-4o",
10         messages=[{"role": "user", "content": query}]
11     ).choices[0].message.content
12 
13     update_current_trace(user_id="your-user-id")
14     return res
15 
16 llm_app("Write me a poem.")

The user_id can be any string, including the actual IDs of customers in your own database, or even their email addresses. Everything will be viewable and searched in the UI.

1	from deepeval.tracing import observe, update_current_trace
2	from openai import OpenAI
3
4	client = OpenAI()
5
6	@observe()
7	def llm_app(query: str):
8	res = client.chat.completions.create(
9	model="gpt-4o",
10	messages=[{"role": "user", "content": query}]
11	).choices[0].message.content
12
13	update_current_trace(user_id="your-user-id")
14	return res
15
16	llm_app("Write me a poem.")