Back to blog

New Trick Makes AI Video Models Lightning Fast

Based on research by Donghyun Lee, Jitesh Chavan, Duy Nguyen, Sam Huang, Liming Jiang

Imagine generating high-quality images and videos with a fraction of the computational power. Diffusion transformers are currently the gold standard for AI creativity, but their multi-step sampling and growing parameter count make inference expensive. This bottleneck has long kept advanced generative AI out of reach for many devices, but a new breakthrough promises to change that by making these powerful models significantly more efficient without sacrificing quality.

The core problem lies in how these models handle data during inference. Activations within diffusion transformers shift unpredictably across different timesteps, prompts, and guidance branches. Previous solutions required recalibrating data for every new scenario, a tedious and resource-heavy process. Researchers have now introduced OrbitQuant, a data-agnostic quantization method that bypasses this issue entirely. Instead of estimating ranges for every specific input, OrbitQuant quantizes data in a normalized, rotated basis. This technique uses a randomized permuted block-Hadamard rotation to concentrate coordinates around a fixed, known marginal. The result is a single codebook that works for all timesteps, prompts, and layers, regardless of the input.

This innovation creates a striking contrast with existing methods. By absorbing the rotation into the weights offline, the system cancels out the rotation inside each linear layer, leaving only a forward rotation on the activations at runtime. This elegant solution means the same recipe transfers seamlessly from image to video generation with no per-modality tuning required. It effectively removes the need for constant recalibration, allowing the quantizer to adapt to new checkpoints or modalities instantly.

The results are impressive. OrbitQuant sets a new state of the art for post-training quantization across major models like FLUX.1, Z-Image-Turbo, Wan 2.1, and CogVideoX. Most notably, it pushes image diffusion transformers to W2A4 quantization levels while maintaining usable generation quality. This marks a significant leap forward, proving that high-fidelity AI generation can be both powerful and accessible. For developers and users alike, this means faster, cheaper, and more scalable AI creativity tools are finally within reach.

Source: arXiv:2607.02461

This post was generated by staik AI based on the academic publication above.