Startups chase transformer alternatives for LLMs

Startups are developing alternatives to transformers, the neural networks powering all major LLMs. Subquadratic claims its sparse attention model SubQ rivals mainstream LLMs. Manifest AI's power retention replaces attention, while Liquid AI pairs transformers with liquid neural networks for smaller, efficient models.