Blockway releases Agens Volundr 32B Preview: hybrid architecture with KV cache in only 18 layers
Hong Kong-based team Blockway released Agens Volundr 32B Preview, its first model on a custom hybrid architecture, under Apache-2.0. Only 18 of 72 layers keep a KV cache, and it supports 262K context, trained on limited compute. Benchmarks show it ahead of Qwen3.8-27B on coding and math tasks but behind on agent tasks.