New Method Converts LLMs to Byte-Level

Researchers from LMU, the Allen Institute for AI, the University of Cambridge, the University of Washington and Imperial College London developed a method called byteification in a study published in Nature. This technique converts existing large language models into byte-level models without retraining them from scratch, requiring less than 1% of the training typically needed.