Skip to main content
Verdikt pulls metrics by commit SHA when a cert window opens.

​
Setup

  1. Settings → Signal Sources → Available to connect
  2. Save API credentials for your vendor
  3. Tag eval runs / builds with the PR head commit SHA
  4. Label the PR verdikt:rc — Verdikt pulls connected sources automatically

​
Supported connectors

SourceSignals (examples)
Braintrustaccuracy, safety, tone, hallucination, relevance
LangSmithaccuracy, safety, tone, hallucination, relevance
BrowserStacksmoke, e2e_regression
Sentrycrashrate, anrrate, errorrate, oomrate
Datadogstartup, p95latency, fps, jserrors, …
Configure which signals gate certification in Settings → Signals & thresholds.