HelpTroubleshootingRun Failures & Action Required

Run Failures & Action Required

What causes runs to fail or enter "Action Required" state.

Runs can end in different states depending on what went wrong. Here's how to handle each one.

Run Statuses

StatusMeaning
CompletedAll phases finished successfully
FailedA critical error stopped the run
CancelledYou manually cancelled the run
Action RequiredSome models failed with non-retryable errors

Action Required

This state means some generator models failed with errors that won't resolve by retrying (e.g., authentication errors, model discontinued). You have two options:

  • Remove failed models and resume — the run continues with the remaining models
  • Retry all — re-attempts all failed responses (credits are re-deducted)

Retrying Runs

You can retry runs in several ways:

  • Retry run — re-runs from scratch (failed, cancelled, action_required, or completed runs)
  • Resume — continues from where it stopped (action_required runs only)
  • Retry failed responses — retries only the responses that failed (completed runs with partial failures)
  • Retry evaluator — re-runs a single evaluator model and re-aggregates (useful when one evaluator timed out)
Credits: Retrying re-deducts credits for the retried portions. The system checks your credit balance before starting.