Before you download a local model, you need one number: how much memory your graphics card has, or how much memory your Mac has. That number decides which models will fit.
On Windows
- Press Ctrl + Shift + Esc to open Task Manager.
- Click the Performance tab.
- Click GPU in the list on the left.
- Look for “Dedicated GPU memory”. That’s your graphics card’s memory.
If you see more than one GPU, use the one with the most dedicated memory. “Shared GPU memory” is normal computer memory and is much slower for running models.
On a Mac
- Click the Apple menu in the top-left corner.
- Choose About This Mac.
- The number next to Memory is what you need.
Apple Silicon Macs (M1 and later) share this memory between the processor and the graphics, which is why a Mac with lots of memory can run big models. By default macOS lets the graphics side use about two thirds of it on smaller Macs and about three quarters on bigger ones, and our rankings take that into account.
On Linux with an NVIDIA card
Open a terminal and run:
nvidia-smi
The memory column shows your card’s total memory in MiB. A number around 16000 means a 16 GB card, around 8000 means 8 GB.
What to do next
Once you know your number, open our rankings and find your memory size. We list the best model that fits and which version to download.
Comments
Sign in with GitHub to comment. Spam and abuse are hidden automatically.