SKYNET
ollama-cl/mistral-large-3:675b
Mistral Large 3 675B (ollama-cluster, untested)
★VALS INDEX
23.3%
Accuracy
⏱VALS INDEX
4.6s
Latency (median)
$VALS INDEX
—
Cost / Test (1P-est)
SCORE STATUSscored
TEST SETS10
RECORDED TRIALS82
CUSTOM PASS33%
Industry benchmarks
Accuracyattempts · responded
GPQA_DIAMOND
GPQA Diamond
23.3%
30 attempts · 30 responded
Custom 9-task suite
Mean /5n=trials
CUSTOM
agentic_prompt
★
4.00
3 trials
CUSTOM
refactor_existing_code
-
3.67
3 trials
CUSTOM
agentic_tool_use
-
3.33
3 trials
CUSTOM
code_gen_long
★
1.88
8 trials
CUSTOM
json_strict
★
1.88
8 trials
CUSTOM
reasoning_multistep
★
1.88
8 trials
CUSTOM
summarize
★
1.62
8 trials
CUSTOM
code_debug
-
1.12
8 trials
CUSTOM
creative_write
-
0.00
3 trials
Per-task distribution
Score
All trials on this page were run through the harness. Industry suites use deterministic family-specific reference graders (no LLM judge). The custom suite is graded by consensus of minimax-m3 + claude-fable-5. See /industry/ for the full benchmark suite.