provider AI observabilityllm_analytics POST /api/projects/{project_id}/llm_analytics/evaluation_summary/
@utdk/posthog /api/projects/{project_id}/llm_analytics/evaluation_summary/
llm_analytics_evaluation_summary_create
Generate an AI-powered summary of evaluation results. This endpoint analyzes evaluation runs and identifies patterns in passing and failing evaluations, providing actionable recommendations. Data is fetched server-side by evaluation ID to ensure data integrity. **Use Cases:** - Understand why evaluations are passing or failing - Identify systematic issues in LLM responses - Get recommendations for improving response quality - Review patterns across many evaluation runs at once
project_id path required
Project ID of the project you're trying to access. To find the ID of the project, make a call to /api/projects/.
string

Try it

Authentication
Configure credentials for PostHog API
llmAnalyticsEvaluationSummaryCreate
POST/api/projects/{project_id}/llm_analytics/evaluation_summary/
Generate an AI-powered summary of evaluation results. This endpoint analyzes evaluation runs and identifies patterns in passing and failing evaluations, providing actionable recommendations. Data is fetched server-side by evaluation ID to ensure data integrity. **Use Cases:** - Understand why evaluations are passing or failing - Identify systematic issues in LLM responses - Get recommendations for improving response quality - Review patterns across many evaluation runs at once

Parameters

required

Project ID of the project you're trying to access. To find the ID of the project, make a call to /api/projects/.

Input

required

UUID of the evaluation config to summarize

Filter type to apply ('all', 'pass', 'fail', or 'na') * `all` - all * `pass` - pass * `fail` - fail * `na` - na

Optional: specific generation IDs to include in summary (max 250)

If true, bypass cache and generate a fresh summary

Configure credentials above to enable sending.

Code snippet
Updates live as you fill in the form above.

TypeScript

import posthog from '@utdk/posthog';

await posthog.llmAnalyticsEvaluationSummaryCreate({
  "filter": "all",
  "force_refresh": false
})