284B parameter model runs locally, matches cloud AI

DeepSeek V4 Flash, a 284-billion-parameter mixture-of-experts model, runs locally on a Lenovo ThinkStation PGX using ds4, a custom inference engine by Redis creator Salvatore Sanfilippo. The engine achieves 10-14 tokens per second by aggressively quantizing only expert layers and caching KV cache to disk.