Annotations
Every annotation left in your project, over time and as a searchable table.
Overview
The Annotations tab (Annotate → Annotations) is the history of every annotation left in your project: by your reviewers, in queues or on single items, and by end users through the Confident API. Use it to see how much review is happening, who's doing it, how the answers trend, and to find or export any annotation.
Pick Traces, Spans or Threads, a date range and an environment. Date chooses what the range applies to: when the annotation was created, when it was last updated, or the date of the trace, span or thread it's on.
Volume and Annotators
Annotation Volume counts annotations over time. Segment splits the bars by User type (your annotators vs. end users), by Fields, or by Annotators; click a bar to list the annotations behind it. Top Annotators ranks your most active reviewers in the range.
Annotation Scores
Below, Annotation Scores charts each form field over time: thumbs fields stack ups and downs with the thumbs-up rate, star fields stack 1 to 5 stars with the average, and choice fields stack their options. Pick a field's version, change the Slice and Sort, or turn on Compare previous period. Switch to Failure modes to chart the failure modes reviewers tagged instead.
The Annotations Table
The table lists every annotation in range, newest first: when it was left, who left it, the field, the answer, the explanation, and the trace, span or thread it's on. Narrow it with filters (annotator, field, rating, failure mode, and the item's own properties) or search across questions, responses, explanations and annotators. Click a row to open the item, with its Annotate panel to review or edit the answers.
Export as CSV downloads the rows you've selected or every row matching your filters.
Annotation Queues
Route items to reviewers and annotate them one by one.
Eval Alignment
Compare your metrics' verdicts against these annotations.
Last updated on