TechTowards Data Scienceabout 2 hours ago
Setting Up Your Own Large Language Model
1 min read
Alibaba's open-source Qwen 3 8B model runs fully offline on an Apple Silicon Mac via Ollama. The 9-billion-parameter model takes 5 GB on disk and 6 GB in RAM. A MacBook Air M4 with 24 GB unified memory handles it comfortably. No data leaves the machine.
Level
Hype check
Tap to vote and see what everyone thinks.
