BaseRT replaces Ollama for faster local LLMs

BaseRT, a runtime built for Apple Silicon, loads models in a fraction of the time and processes prompts up to 6.4x faster than llama.cpp on M5 Pro. It uses Metal 4 and custom kernels, but model compatibility lags Ollama.