Run Your Own LLM Evaluation

Test any models with your prompts. Start free, no credit card required.

Start Free

LLM Evaluation

comparative Evaluation

Coding Performance with 10 Evaluators — Run

Comprehensive evaluation of 3 language models across 1 system prompt with rigorous benchmarking and scoring criteria.

Top Score

7.88

deepseek-v3.2

Average Score

5.00

Spread: 6.25 pts

Avg Latency

—

Response time

Evaluations

120

12 total responses

Executive Insights

Key takeaways from this evaluation

Top Performer

deepseek-v3.2

7.88

2.38 pts ahead of #2

Model Rankings

Ranked by overall performance score

deepseek-v3.2

Winner

deepseek/deepseek-v3.2

Performance Score

7.88/ 10

Good

Responses

Avg Latency

—

Cost

$0.0004

mistral-large-2512

mistralai/mistral-large-2512

Performance Score

5.50/ 10

Average

Responses

Avg Latency

—

Cost

$0.0014

llama-4-maverick

meta-llama/llama-4-maverick

Performance Score

1.63/ 10

Needs Improvement

Responses

Avg Latency

—

Cost

$0.0004

Evaluator Consensus

How 10 evaluator models ranked the candidates via blind comparison

majority Agreement

9 of 10 evaluators agree on the top model

deepseek-v3.2

Avg Rank

1.1

Range

#1–2

#1 Votes

9/10

Latency

—

mistral-large-2512

Avg Rank

1.9

Range

#1–2

#1 Votes

1/10

Latency

—

llama-4-maverick

Avg Rank

3.0

Range

#1 Votes

0/10

Latency

—

Per-Evaluator Rankings

How each evaluator model individually ranked the candidates

gpt-5.4-mini

12 evals

deepseek-v3.28.75

mistral-large-25125.00

llama-4-maverick1.25

gemini-3.1-flash-lite-preview

12 evals

deepseek-v3.27.50

mistral-large-25126.25

llama-4-maverick1.25

claude-sonnet-4.6

12 evals

deepseek-v3.28.75

mistral-large-25125.00

llama-4-maverick1.25

minimax-m2.7

12 evals

deepseek-v3.27.50

mistral-large-25125.00

llama-4-maverick2.50

kimi-k2.5

12 evals

deepseek-v3.28.75

mistral-large-25125.00

llama-4-maverick1.25

deepseek-v3.2

12 evals

deepseek-v3.27.50

mistral-large-25126.25

llama-4-maverick1.25

grok-4.1-fast

12 evals

deepseek-v3.27.50

mistral-large-25125.00

llama-4-maverick2.50

mistral-small-2603

12 evals

mistral-large-25127.50

deepseek-v3.26.25

llama-4-maverick1.25

qwen3.5-27b

12 evals

deepseek-v3.28.75

mistral-large-25123.75

llama-4-maverick2.50

nova-2-lite-v1

12 evals

deepseek-v3.27.50

mistral-large-25126.25

llama-4-maverick1.25

Score Comparison

Visual comparison of all model scores

Run Your Own Model Comparison

Compare any LLM across custom criteria and prompts
Automated scoring with AI evaluators
Share results and track model performance over time

Performance by System Prompt

How each model performs across different evaluation contexts

Coding Agent

12 responses • avg score 5.00

Top Performer

deepseek-v3.2

7.88

deepseek-v3.2

7.88

mistral-large-2512

5.50

llama-4-maverick

1.63

Performance by Test Prompt

Model results broken down by individual test prompts

Test Prompt	Avg Score	Best	Worst
Javascript Function 3 responses	5.00	8.5 deepseek-v3.2	1.0 llama-4-maverick
Write an Interval Merge Function 3 responses	5.00	8.5 mistral-large-2512	0.0 llama-4-maverick
Debug Python 3 responses	5.00	10.0 deepseek-v3.2	0.0 mistral-large-2512
Refactor Javascript 3 responses	5.00	8.0 mistral-large-2512	0.5 llama-4-maverick

About This Evaluation

Methodology, criteria weights, and evaluation confidence

Evaluation Criteria

Method:

comparative

Accuracy50%

Instruction Following50%

Total Responses

120

Total Evaluations