AITom's Hardwareabout 2 hours ago
Colibrì runs 1.5-TB AI model on 25GB RAM
4 min read
Italian engineer Vincenzo created Colibrì, a proof-of-concept that runs the 744-billion-parameter 1.5-TB GLM-5.2 model on a modest CPU, 25 GB of RAM, and a 1 GB/s virtual NVMe drive. The novel approach targets local AI setups amid rising subscription costs and data privacy concerns.
Level
Hype check
Tap to vote and see what everyone thinks.
Summary by ByteBrief
