VibeThinker: A 3B-Parameter Model Just Beat Opus 4.5 on Reasoning — Here is How

VibeThinker: A 3B-Parameter Model Just Beat Opus 4.5 on Reasoning — Here's How A team of researchers has quietly dropped one of the most surprising AI papers of the month. VibeThinker , a model with only 3 billion parameters, reportedly outperforms Anthropic's Opus 4.5 on key reasoning benchmarks — and the secret sauce is a novel training recipe combining Supervised Fine-Tuning (SFT) with Group Relative Policy Optimization (GRPO). For years, the dominant narrative has been that bigger is better. VibeThinker challenges that assumption head-on. Let's break down what happened, why it matters, and what it means for developers building AI applications in 2026. The Big News According to the paper (arXiv:2606.16140), VibeThinker achieves state-of-the-art performance on several mathematical reasoning and logic benchmarks while using roughly 1/30th the parameters of frontier reasoning models. The headline claim: it beats Opus 4.5 on a curated suite of competition-level reasoning tasks. This isn't just incremental progress. It suggests we're entering an era where training methodology trumps raw parameter count . What's Actually New: SFT + GRPO The two-stage recipe isn't entirely novel on its own — SFT then RLHF has been standard since InstructGPT. But VibeThinker's specific combination appears carefully engineered: Stage 1 — Targeted SFT : Fine-tune on a high-quality, diversity-maximized dataset of reasoning traces. The key insight here is curation over volume . Rather than scraping millions of examples, the team focused on a smaller corpus of well-structured chain-of-thought solutions spanning multiple difficulty tiers. Stage 2 — GRPO refinement : Group Relative Policy Optimization is a reinforcement learning technique popularized by DeepSeek. Instead of training a separate value model (as in PPO), GRPO compares multiple outputs within a group and rewards the best relative to its peers. This is far more compute-efficient than traditional RLHF. The synergy matters: SFT gives