
After running local LLMs on a phone for a month, the author found desktop self-hosting felt like overkill. The phone ran Gemma 4 E2B at 5B parameters, while the desktop ran Gemma 4 E4B at 8B parameters. The smaller model performed well enough to replace most desktop use.
Tap to vote and see what everyone thinks.