Run Your Own LLM Evaluation
Test any models with your prompts. Start free, no credit card required.
Coding Performance with 10 Evaluators — Run
Comprehensive evaluation of 2 language models across 1 system prompt with rigorous benchmarking and scoring criteria.
5.53
claude-sonnet-4.5
5.00
Spread: 1.06 pts
—
Response time
80
8 total responses
Executive Insights
Key takeaways from this evaluation
Top Performer
claude-sonnet-4.5
5.53
1.06 pts ahead of #2
Best Value
gpt-5.2
4.47
Best score-to-cost ratio
Model Rankings
Ranked by overall performance score
claude-sonnet-4.5
anthropic/claude-sonnet-4.5
Average
Responses
4
Avg Latency
—
Cost
$0.0140
gpt-5.2
openai/gpt-5.2
Below Average
Responses
4
Avg Latency
—
Cost
$0.0105
Evaluator Consensus
How 10 evaluator models ranked the candidates via blind comparison
split Agreement
Evaluators disagree on which model is best
claude-sonnet-4.5
Avg Rank
1.5
Range
#1–2
#1 Votes
5/10
Latency
—
gpt-5.2
Avg Rank
1.5
Range
#1–2
#1 Votes
5/10
Latency
—
gpt-5.4-mini
claude-sonnet-4.6
deepseek-v3.2
grok-4.1-fast
qwen3.5-27b
gemini-3.1-flash-lite-preview
minimax-m2.7
mistral-small-2603
kimi-k2.5
nova-2-lite-v1
Score Comparison
Visual comparison of all model scores
Performance by System Prompt
How each model performs across different evaluation contexts
Top Performer
claude-sonnet-4.5
5.53
Performance by Test Prompt
Model results broken down by individual test prompts
| Test Prompt | Avg Score |
|---|---|
Javascript Function 2 responses | 5.00 |
Write an Interval Merge Function 2 responses | 5.00 |
Debug Python 2 responses | 5.00 |
Refactor Javascript 2 responses | 5.00 |
About This Evaluation
Methodology, criteria weights, and evaluation confidence
8
Total Responses
80
Total Evaluations
