🗓️ 2025 in Review — Vision-Language Models

Compact conclusion of 400 digested 2025 papers.

The year in one paragraph

Vision-language models in 2025 have matured from contrastive dual-encoders (CLIP) and instruction-tuned captioners (LLaVA) into a sprawling ecosystem spanning reasoning, embodied control, generation, and safety. The defining shift this year is the migration of the LLM reasoning playbook — R1-style reinforcement learning with verifiable rewards, chain-of-thought, test-time scaling — into the multimodal setting, alongside the rise of Vision-Language-Action (VLA) models as the dominant interface between perception and robotics. Simultaneously, a maturing critical literature is diagnosing why VLMs fail: binding errors, late-emerging visual entities, modality bottlenecks, and compositional gaps that scaling alone does not close. The result is a field that is bifurcating between making VLMs bigger/longer-context and making them mechanistically understood, efficient, and safe. The NeurIPS 2025 corpus here captures this consolidation: fewer architectural revolutions, more targeted interventions on reasoning, grounding, efficiency, and reliability.

🕒 Timeline

• 2021: CLIP establishes contrastive image-text pretraining; global-embedding alignment becomes the substrate for zero-shot transfer, retrieval, and OOD detection.
• 2022: BLIP-2/Q-Former and Flamingo show frozen-encoder + LLM bridging; prompt tuning (CoOp) emerges as the lightweight adaptation paradigm.
• 2023: LLaVA-style visual instruction tuning + GPT-4V make conversational VLMs mainstream; "bag-of-words" compositionality weaknesses of CLIP become widely documented.
• 2024-early: Open VLM scaling (Qwen-VL, InternVL, SigLIP backbones) and any-resolution tiling; long-context and high-resolution become active frontiers.
• 2024-mid: π0 and flow/diffusion action experts launch the modern VLA era, grafting continuous-action heads onto pretrained VLM backbones.
• 2024-late: DeepSeek-R1 / o1 reasoning RL lands; the open question becomes whether verifiable-reward RL transfers to multimodal reasoning.
• 2025-early: GRPO-based multimodal reasoning (OpenVLThinker, GRIT, ViCrit) and "thinking with images" (ViLaSR, VISER) demonstrate RL-driven visual reasoning at 3B-7B scale.
• 2025-mid: Mechanistic critique matures (two-hop problem, narrow gate, binding problem); VLA engineering (knowledge insulation, real-time chunking, force/safety) and agentic VLMs (OpenCUA, VAGEN) consolidate.

📌 Key papers

• OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles (2025, NeurIPS) — Establishes the iterative SFT↔RL recipe that surfaces latent reasoning, the template for open multimodal R1-style models.
• ViCrit: A Verifiable Reinforcement Learning Proxy Task for Visual Perception in VLMs (2025, NeurIPS) — Brings the math/code "verifiable reward" structure to perception via a single-injected-hallucination task; likely a standard post-training stage.
• GRIT: Teaching MLLMs to Think with Images (2025, NeurIPS) — Interleaves bounding-box coordinates into reasoning chains with annotation-free RL, exemplifying grounded visual reasoning.
• Visual Structures Help Visual Reasoning: Addressing the Binding Problem in LVLMs (2025, NeurIPS) — Shows visual scaffolding (not textual CoT) fixes feature-binding errors, a key corrective to the CoT-everywhere trend.
• Too Late to Recall: Explaining the Two-Hop Problem in Multimodal Knowledge Retrieval (2025, NeurIPS) — Mechanistically diagnoses why VLMs underperform their LLM backbones; defines an architectural research agenda.
• The Narrow Gate: Localized Image-Text Communication in Native Multimodal Models (2025, NeurIPS) — Reveals the single-[EOI]-token cross-modal bottleneck in native multimodal models, a foundational interpretability finding.
• Knowledge Insulating Vision-Language-Action Models (2025, NeurIPS) — Solves gradient interference between action experts and VLM backbones; ~7.5× faster training while preserving VLM knowledge — a VLA-stack staple.
• Real-Time Execution of Action Chunking Flow Policies (2025, NeurIPS) — Inference-time inpainting that makes flow/diffusion VLAs robust to >300ms latency, unlocking real-world deployment.
• ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulation (2025, NeurIPS) — Promotes force-torque to a first-class modality, addressing VLAs' blindness under occlusion/contact.
• SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learning (2025, NeurIPS) — Brings constrained-MDP safe RL to physical action, cutting violations 83% — a likely deployment prerequisite.
• Unveiling the Compositional Ability Gap in Vision-Language Reasoning Model (2025, NeurIPS) — Quantifies that RL > SFT but neither closes the cross-modal/cross-task composition gap; the field's reality check.
• un²CLIP: Improving CLIP's Visual Detail Capturing Ability via Inverting unCLIP (2025, NeurIPS) — Restores fine-grained detail to CLIP via diffusion inversion without harming language alignment.
• Towards Visualization-of-Thought Jailbreak Attack against Large Visual Language Models (2025, NeurIPS) — Demonstrates that stronger multimodal reasoning is itself the attack surface, reframing VLM safety.
• CoMEM: Towards General Continuous Memory for Vision-Language Models (2025, NeurIPS) — Compresses retrieved multimodal knowledge into 8 embeddings, pointing past token-concatenation RAG.
• Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Models (2025, NeurIPS) — An 8B model that actually scales with visual input length, matching GPT-4o on long video — a long-context recipe.
• OpenCUA: Open Foundations for Computer-Use Agents (2025, NeurIPS) — Fully open CUA stack showing reflective long-CoT augmentation is what makes computer-use performance scale with data.
• MP-SAE: From Flat to Hierarchical: Extracting Sparse Representations with Matching Pursuit (2025, NeurIPS) — Recovers genuinely multimodal/hierarchical features that standard SAEs miss, advancing VLM interpretability.

➡️ Read the full trend analysis