Gemma 4 31B
great at writing text
WritingChatArchiveTranslate
Runs in:
20 GB · Free · Apache 2.0
KoboldCpp
A local story and chat runner for GGUF files, with its own web page.
Models that run in KoboldCpp
Qwen3.8 27B
excellent at writing, code, and translation
WritingChatArchiveCodeTranslateRuns in:Fits on:18 GB · Free · Apache 2.0
Gemma 4 26B A4B
great at writing text, and quicker than it looks
WritingChatArchiveTranslateRuns in:Fits on:16 GB · Free · Apache 2.0
Qwen3 235B-A22B
a giant chatbot for the biggest computers
WritingChatCodeRuns in:120 GB · Free · Apache 2.0
Qwen3.5 27B
strong at writing, code, and other languages
WritingChatArchiveCodeTranslateRuns in:Fits on:18 GB · Free · Apache 2.0
Qwen3.5 35B-A3B
fast chat and code, because only a slice wakes up
WritingChatCodeRuns in:20.4 GB · Free · Apache 2.0
Gemma 3 27B
a strong writer, a step behind Gemma 4
WritingChatArchiveRuns in:Fits on:17 GB · Free · Gemma Terms of Use
Qwen3-Coder 30B-A3B
fast help with code
CodeRuns in:Fits on:19 GB · Free · Apache 2.0
gpt-oss 120B
OpenAI's big open model, for huge memory pools
WritingChatCodeRuns in:65 GB · Free · Apache 2.0
Gemma 3 12B
great at writing text on a 16 GB machine
WritingChatArchiveTranslateRuns in:Fits on:8.2 GB · Free · Gemma Terms of Use
DeepSeek R1 Distill 32B
talks through the steps before it answers
WritingChatCodeRuns in:20 GB · Free · MIT
Qwen3 8B
a quick chatbot that fits smaller computers
WritingChatArchiveCodeTranslateRuns in:Fits on:5.2 GB · Free · Apache 2.0
Gemma 3n E4B
pleasant everyday notes on a laptop
WritingChatRuns in:Fits on:5 GB · Free · Gemma Terms of Use
Llama 3.3 70B
a famous big chatbot that needs lots of memory
WritingChatArchiveRuns in:40 GB · Free · Llama 3.3 Community License
gpt-oss 20B
a solid helper for chat and code
WritingChatCodeRuns in:Fits on:14 GB · Free · Apache 2.0
Gemma 3 4B
great at writing text, and it can look at a photo
WritingChatTranslateRuns in:Fits on:3.4 GB · Free · Gemma Terms of Use
Qwen2.5-Coder 32B
a well-known local coding helper
CodeRuns in:20 GB · Free · Apache 2.0
Aya Expanse 32B
a multilingual writer
WritingChatTranslateRuns in:20 GB · Free · CC-BY-NC 4.0
Phi-4 14B
careful answers, strong for its size
WritingChatCodeRuns in:Fits on:9.1 GB · Free · MIT
Qwen2.5-Coder 7B
helps with short bits of code
CodeRuns in:Fits on:4.7 GB · Free · Apache 2.0
Aya Expanse 8B
writes and translates across languages
WritingChatTranslateRuns in:Fits on:5 GB · Free · CC-BY-NC 4.0
Llama 3.2 3B
great at short rewrites on a tiny computer
WritingChatRuns in:Fits on:2 GB · Free · Llama 3.2 Community License
Qwen2.5-VL 7B
reads text from scans (OCR) and answers about the picture
ScanRuns in:Fits on:6 GB · Free · Apache 2.0