Subquadratic published benchmarks for its sparse-attention model handling 12-million token contexts, while hinting at future “zero attention” architectures.
Need help?
Contact usSubquadratic published benchmarks for its sparse-attention model handling 12-million token contexts, while hinting at future “zero attention” architectures.