Alibaba Cloud launches Qwen3.8-Flash-Next with new architecture and better cost efficiency

Alibaba Cloud has released the open weights of Qwen3.8-Flash-Next, a multimodal mixture-of-experts model that also serves as an early preview of the architecture behind its upcoming Qwen4 series. The company says the model represents a systematic upgrade across four core areas of its design, attention, residual connections, embedding, and optimization, aimed at boosting capability while pushing down computational cost, model capacity requirements, and training instability. The technical changes are layered. On the attention side, the model pairs Gated DeltaNet (GDN), which compresses the history of prior context, with Qwen Sparse Attention (QSA), a compressed lightweight indexer that picks out the most important context at micro-block granularity, substantially cutting the cost of attention on long sequences. The residual stream is widened into four branches under a Gated Residual (GR) scheme, with a dynamic gate controlling reads and writes to strengthen cross-layer information flow a...