Q4 or Q8: which version of a model should you download?
What the letters mean, how much quality you give up, and how to pick the right one for your computer.
Guides
3 posts, newest first.
What the letters mean, how much quality you give up, and how to pick the right one for your computer.
The one number that decides which local models you can run, and where to find it on Windows, Mac and Linux.
Install one app, type one command, and you're chatting with an AI model on your own computer. No account needed.