Insights
Understand how your assistants perform with built‑in analytics and graded signals.
What we compute
- Goal completion likelihood
- Sentiment and tone
- Turn complexity and time-to-answer
- Confidence and issues noted by the verifier
How it’s produced
- EventBridge schedules a runner that analyzes recent sessions
- Results are written as JSON to S3 and synchronized to OpenSearch
Explore in the Admin Site
Filter by app, grade, sentiment, or timeframe. Drill down to the exact turn, traces, and feedback that drove a score.
Iterate with evidence
Use insights to decide whether to adjust prompts, add a tool, or change routing—then measure the impact.
Configuration Required
The Insights feature must be enabled in your site-wide pika-config.ts
file (sessionInsights.enabled: true
) before insights will be generated and made available in the Admin Site.