Alibaba's Tongyi lab releases Wan-Streamer v0.2 for real-time AI interaction
Alibaba's Tongyi lab released the Wan-Streamer v0.2 model, an end-to-end multimodal AI that can understand and generate text, audio, and video in real time. It combines listening, seeing, speaking, and acting into a single Transformer. The model has an end-to-end response latency of just 550 milliseconds (200ms model delay plus 350ms network delay). The output resolution has been upgraded from 192×336 in v0.1 to 640×368, making micro-expressions and scene details clearly visible.
Wan-Streamer v0.2 uses a dual-path architecture: a single-GPU 'Thinker' handles fast perception and language processing, while a multi-GPU 'Performer' generates high-definition video in parallel. Through time-overlap design, the model improves image quality without increasing user-perceived latency, keeping total remote interaction delay around 550ms.
The model allows users to describe characters in natural language, and the AI can generate a video avatar for face-to-face conversations. It's suitable for language practice, interview simulations, immersive game NPCs, and accessibility tools. The team says this is a long-term research path toward making AI communication more human-like through native streaming architecture, and they will continue to iterate.
Comments
Loading comments…