AIMozilla Hacksover 1 year ago
Llamafile v0.8.14: a new UI, performance gains, and more
4 min read
Llamafile v0.8.14 introduces a colorful new command line chat interface that opens automatically in the terminal. The release also includes Llamafiler, a new OpenAI-compatible API server with an embeddings endpoint running three times faster than llama.cpp. Pre-fill speed has improved dramatically across architectures.
Level
Hype check
Tap to vote and see what everyone thinks.