Speculative Sampling in Interactive Video Generation
Interactive video generation commonly relies on small bidirectional chunks to reduce response latency. Yet our preliminary experiments show that larger chunks improve video quality...
Papers
Amortizing Sequential Experimental Design in Reasoning LLMs
Despite their extensive pretraining knowledge and strong reasoning capabilities, large language models (LLMs) struggle to adaptively gather information in experimental design tasks...
StreamErase: Towards Ultra-Fast Streaming Video Erasing
Current video object removal methods suffer from prohibitive latency (minutes per video) and non-causal processing that prevents real-time interaction. We present StreamErase, enab...
Glance Forcing: Making Bidirectional Diffusion Autoregressive at a Glance
Autoregressive generation underlies real-time, causal video synthesis and is the backbone of video world models. Today's dominant approach distills a bidirectional diffusion model ...
LEV: Thinking Fast and Deep with Looped Decision Models
Decision models answer typed questions about an input with one probability per option, computed in a single forward pass without generating text. Like the fast System 1 of dual-pro...
Interlock: From Local Correctness to Task Completion in Long-Horizon Agents
Large language model agents increasingly undertake long-horizon tasks in complex environments characterized by fragmented evidence, partially completed states, and dependencies acr...
A Diagnostic Study of World-Space Human Recovery Under High Camera Dynamics
Monocular world-space human recovery methods excel on current benchmarks, but these rarely include fast camera motion. We introduce the K-Pop stress test, broadcast dance videos th...
DAGFormer: Global Topology Prediction for Transformer Cross-Layer Connections
We propose DAGFormer, a Transformer language model whose cross-layer connections are planned by a jointly trained topology predictor. Beyond the residual connections in a standard ...
Function-Space Temporal Self-Distillation for Policy Optimization
Reinforcement Learning with Verifiable Rewards (RLVR) improves reasoning in language models, but scalar outcomes provide coarse supervision over response trajectories. Self-distill...
Generative World Simulation with DAO and JING
We present a Generative World Simulation framework that couples persistent shared world state with continuous first-person audiovisual generation. The framework integrates DAO, a c...
KANLab: TensorFlow Playground for Kolmogorov-Arnold Networks
KANLab is a browser-based visualization tool designed to interactively teach the core concepts of Kolmogorov-Arnold Networks (KAN), forked from the widely successful TensorFlow Pla...
Your Transformer Is Secretly Elastic
Scaling up transformers has produced models with broad capabilities, deployed across heterogeneous hardware and fluctuating workloads. Yet, model families offer only a few fixed si...
VASPO: Self-Distillation with Privileged Value Estimation
On-policy self-distillation provides dense supervision for reasoning models via a privileged self-teacher. However, this supervision reflects local token preferences rather than th...
Robust Explanatory Analysis for Structured Optimization Networks (REASON) in Learning
We seek a hierarchical resolution of residual error under a composite learning objective as a principled mechanism for identifying and exploiting additional information, particular...
Diminishing Returns of Data in Sparse Autoencoders: Functional Behavior does not Guarantee Feature Reproducibility
Sparse autoencoders (SAEs) are typically trained on hundreds of millions to billions of activation tokens, yet little work has tested whether this scale is necessary. We study how ...
WorldCast: Exploring Intelligent Visual Generation in World State Prediction
Humans interpret multimodal observations of the world and forecast how it will evolve. Recent multimodal generative systems have demonstrated similar capabilities: they can integra...
One Bias Score, Two Factors: How Mitigations Affect Option Bias in Multiple-Choice Evaluation
Reordering multiple-choice options can change a model's answer, an effect studied as selection bias (a preference for certain option letters) and as order sensitivity (changes in a...
BizBench: Unveiling Hidden Challenges in Deploying Long-Horizon Agents for Real-World Business
Existing long-horizon agent benchmarks often emphasize final task success while providing limited assessment of intermediate execution validity. Yet real-world business operations ...
Orbia: Do Generated Videos Form a Consistent 3D World?
Video generators serve as interactive worlds for exploration and simulation, yet realistic and visually appealing frames do not necessarily depict a consistent 3D world. Existing b...
What Generation Knows: Unlocking Fine-Grained Understanding in Unified Multimodal Models
Fine-grained visual understanding requires distinguishing subtle differences in local attributes and spatial relations, yet remains challenging for existing vision-language models....
Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation
Unified multimodal generation covers discrete, continuous, and hybrid paradigms. Discrete approaches with single-codebook visual tokenizers align naturally with text modeling but h...
MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments
Online reinforcement learning (RL) with verifiable rewards has driven rapid progress in mathematics, coding, and tool use, but scaling this success to GUI agents remains challengin...
SERO: Learning from Executable Oracle Continuations for Long-Horizon Agentic Reinforcement Learning
Long-horizon agentic RL is constrained by the futures visited by the current policy. When rollouts fail to reach useful behaviors, improved credit assignment cannot provide supervi...
VITAL: From Visual Motion to Precise Action
World-action models aim to turn visual anticipation into driving decisions, yet typically train action experts on trajectory representations defined independently of visual dynamic...