skynet · fast
SKYNET

ollama-cl/nemotron-3-nano:30b

NVIDIA Nemotron 3 nano 30B (fast tier, untested)

⚖ COMPARE MODELS
VALS INDEX
33.3%
Accuracy
VALS INDEX
9.4s
Latency (median)
$VALS INDEX
Cost / Test (1P-est)
SCORE STATUSscored
TEST SETS10
RECORDED TRIALS64
CUSTOM PASS71%

Industry benchmarks

Accuracyattempts · responded
GPQA_DIAMOND GPQA Diamond
33.3%
30 attempts · 30 responded
Industry benchmark Bars = accuracy %, black cap = that score

Custom 9-task suite

Mean /5n=trials
CUSTOM agentic_prompt
5.00
1 trials
CUSTOM json_strict
5.00
6 trials
CUSTOM reasoning_multistep
5.00
6 trials
CUSTOM code_gen_long
4.33
6 trials
CUSTOM summarize
4.17
6 trials
CUSTOM refactor_existing_code -
4.00
1 trials
CUSTOM code_debug -
2.17
6 trials
CUSTOM agentic_tool_use -
0.00
1 trials
CUSTOM creative_write -
0.00
1 trials
Custom suite · scored 0–5 by consensus (m3 + Fable-5) ★ = task scored a 5 at least once · sorted by mean score

Per-task distribution

Score

All trials on this page were run through the harness. Industry suites use deterministic family-specific reference graders (no LLM judge). The custom suite is graded by consensus of minimax-m3 + claude-fable-5. See /industry/ for the full benchmark suite.