MIT CSAIL unveils Recursive Language Models for infinite context

Researchers at MIT CSAIL developed Recursive Language Models (RLMs), a framework enabling LLMs to process arbitrarily long prompts without memory costs or special training. RLMs treat text as an external environment, selectively retrieving pieces via a Python-powered REPL loop. Experiments show RLMs handle inputs two orders of magnitude beyond model context windows.