What comes after attention? This startup says it already knows.

Subquadratic launched a sparse-attention model handling 12-million token contexts faster than current large language models earlier this year without publishing benchmarks or wide access then. In June the company released its first model card for SubQ 1.1 with third-party verification from Appen and opened design partner access to verify performance claims.