Chat
Llama 3 8B
Strong general-purpose chat model for local use.
RAM 8+ GB · VRAM 6+ GB
Chat models
Chat AI models
Browse static compatibility pages for chat models.
Chat
Mistral 7B
Efficient model with strong performance for its size.
RAM 6+ GB · VRAM 4+ GB
Chat
Phi-3 Mini
Compact model suited to smaller devices and quick tasks.
RAM 4+ GB · VRAM 3+ GB
Chat
Gemma 2B
Small and approachable model that can work on lower-end hardware.
RAM 2+ GB · VRAM 1+ GB