provider vision POST /api/environments/{environment_id}/vision/scanners/{scanner_id}/prompt_suggestions/{id}/evaluate/
@utdk/posthog /api/environments/{environment_id}/vision/scanners/{scanner_id}/prompt_suggestions/{id}/evaluate/
environments_vision_scanners_prompt_suggestions_evaluate_create
Test this suggestion before applying it: re-run the scanner with the suggested prompt against already-rated sessions in the background and compare each fresh output with the stored one. Results land on the suggestion's `evaluation` field. Poll `current` while status is running. `session_limit` controls how many rated sessions are re-run (thumbs-down prioritized, up to `evaluation_session_cap`). Each successful re-run charges credits like a normal observation of the same model. The request is refused with 402 when the planned credits exceed what is left of the monthly limit. Only monitor and classifier scanners are supported. Requires session recording edit access.
environment_id path required
Deprecated. Use /api/projects/{project_id}/ instead.
string
id path required
A UUID string identifying this replay scanner prompt suggestion.
string
scanner_id path required
string

Try it

Authentication
Configure credentials for PostHog API
environmentsVisionScannersPromptSuggestionsEvaluateCreate
POST/api/environments/{environment_id}/vision/scanners/{scanner_id}/prompt_suggestions/{id}/evaluate/
Test this suggestion before applying it: re-run the scanner with the suggested prompt against already-rated sessions in the background and compare each fresh output with the stored one. Results land on the suggestion's `evaluation` field. Poll `current` while status is running. `session_limit` controls how many rated sessions are re-run (thumbs-down prioritized, up to `evaluation_session_cap`). Each successful re-run charges credits like a normal observation of the same model. The request is refused with 402 when the planned credits exceed what is left of the monthly limit. Only monitor and classifier scanners are supported. Requires session recording edit access.

Parameters

required

Deprecated. Use /api/projects/{project_id}/ instead.

required

A UUID string identifying this replay scanner prompt suggestion.

required

Input

How many rated sessions to re-run, thumbs-down prioritized. Each successful re-run charges credits like a normal observation of the same model. Defaults to 10. The maximum is `evaluation_session_cap`.

Configure credentials above to enable sending.

Code snippet
Updates live as you fill in the form above.

TypeScript

import posthog from '@utdk/posthog';

await posthog.environmentsVisionScannersPromptSuggestionsEvaluateCreate({
  "session_limit": 10
})