Insights

Understand how your assistants perform with built‑in analytics and graded signals.

Session Insights

What we compute

  • Goal completion likelihood
  • Sentiment and tone
  • Turn complexity and time-to-answer
  • Confidence and issues noted by the verifier

How it’s produced

  • EventBridge schedules a runner that analyzes recent sessions
  • Results are written as JSON to S3 and synchronized to OpenSearch

Explore in the Admin Site

Filter by app, grade, sentiment, or timeframe. Drill down to the exact turn, traces, and feedback that drove a score.

Iterate with evidence

Use insights to decide whether to adjust prompts, add a tool, or change routing—then measure the impact.

Configuration Required

The Insights feature must be enabled in your site-wide pika-config.ts file (sessionInsights.enabled: true) before insights will be generated and made available in the Admin Site.

Last update at: 2025/09/17 14:37:11