AIMarkTechPostabout 2 hours ago
Zyphra Releases Hierarchical Attention Method
1 min read
Zyphra AI introduces Zyphra Hierarchical Attention, a sparse attention method adding 81,920 trainable parameters to Qwen3.6-35B-A3B. The system targets a gap in sparse attention by using a tree-structured indexer and tests up to 256K context length.
Level
Hype check
Tap to vote and see what everyone thinks.