VibeThinker 3B: A Tiny Model That Beats Claude Opus & OpenAI at Verifiable Reasoning

🚨 The Big Caveat First: No Tool Calling

Before diving into the impressive benchmarks, here's the critical limitation that every user needs to know: VibeThinker-3B was never trained on tool-calling or agent-based programming data. The authors explicitly state on the model card that it is not recommended for function calling, API orchestration, or autonomous coding agents.

That said, for its intended use case — verifiable reasoning tasks with clear feedback signals — VibeThinker-3B is nothing short of remarkable.

📊 Benchmark Performance That Shouldn't Be Possible

At just 3 billion parameters (a dense Qwen2 architecture, not MoE), VibeThinker-3B achieves scores that put it in the performance band of first-tier reasoning systems — models that are hundreds of times larger.

Let's break down what these numbers actually mean in context.

AIME26: Near-Perfect Math Reasoning

VibeThinker-3B scores 94.3 on AIME26 — a competition-level mathematics benchmark. With Claim-Level Reliability Assessment (CLR), a novel test-time scaling strategy, it reaches 97.1. These are frontier-level scores that put it in the same performance band as models like DeepSeek V3.2, GLM-5, and Gemini 3 Pro.

LiveCodeBench v6: Competitive Coding at Scale

On LiveCodeBench v6 — a coding benchmark testing real-world algorithmic problem solving — VibeThinker-3B achieves 80.2 Pass@1. For out-of-distribution generalization on recent unseen LeetCode contests (April–May 2026), it passes 123 out of 128 first-attempt submissions — a 96.1% acceptance rate.

IMO AnswerBench: Olympiad-Level Math

The International Mathematical Olympiad benchmark (400 problems) is one of the hardest math reasoning tests available. VibeThinker-3B scores 76.4, improving to 80.6 with CLR — rivaling models 200-300x its size.

📈 How It Compares to Flagship Models

The most striking aspect of VibeThinker-3B is how its performance scales relative to model size. Here's how it compares to much larger systems on IMO AnswerBench:

The key insight: VibeThinker-3B achieves nearly the same reasoning score as models that are 250-300x larger. With CLR boosting it to 80.6, it's within striking distance of GLM-5's 82.5 — on a model that fits in roughly 6 GB of VRAM (BF16) or even less when quantized to GGUF.

🧠 The Training Methodology: Spectrum-to-Signal Principle

VibeThinker-3B builds on the Spectrum-to-Signal Principle (SSP), a post-training paradigm introduced in its smaller sibling VibeThinker-1.5B. The approach is systematic and methodical:

🔬 Key Research Insight: The Parametric Compression-Coverage Hypothesis

Beyond the benchmarks, VibeThinker-3B introduces an interesting theoretical framework. The authors propose the Parametric Compression-Coverage Hypothesis:

In simpler terms: reasoning is compressible. You don't need massive parameter counts to be great at math, code, and STEM problems — you need the right training methodology. Open-domain knowledge and general-purpose dialogue, on the other hand, do benefit from scale.

This means compact models shouldn't be viewed merely as "cheap compromises" — they can be a complementary path toward frontier-level performance in specific capability domains.

📋 Technical Specifications

⚙️ Quick Start

For best inference performance, use vLLM 0.10.1+ or SGLang 0.4.9+:

# Install vLLM
pip install vllm

# Start the server
vllm serve "WeiboAI/VibeThinker-3B"

# Call via OpenAI-compatible API
curl -X POST "http://localhost:8000/v1/chat/completions" \
    -H "Content-Type: application/json" \
    --data '{
        "model": "WeiboAI/VibeThinker-3B",
        "messages": [{"role": "user", "content": "Solve: 25 * 37 + 13"}],
        "temperature": 1.0,
        "top_p": 0.95
    }'

Recommended inference settings: temperature=1.0, top_p=0.95, top_k=-1, max_tokens up to 60K–100K for IMO-level problems.

🎯 When to Use (and When Not To)

🏁 Conclusion

VibeThinker-3B is a bold experiment in parameter efficiency that delivers real results. At 3 billion parameters with an MIT license, it matches the reasoning performance of models 200–300x its size on verifiable tasks like math, coding, and STEM — and its Claim-Level Reliability Assessment technique pushes it even closer to true frontier performance.

The model makes a compelling case that for capability domains with clear feedback and verification mechanisms, small language models are not just a deployment compromise — they're a genuinely viable research trajectory toward frontier-level reasoning.

Just remember: no tool calling. For that, you still need the big guns. But for pure reasoning on structured tasks? VibeThinker-3B might just be the most efficient model on the planet right now.

🤗 HuggingFace 📄 arXiv Paper 🐙 GitHub