Gemma 4 31B
great at writing text
WritingChatArchiveTranslate
Runs in:
20 GB · Free · Apache 2.0
LocalAI
A local server that speaks the same kind of API as hosted chat, and loads GGUF files.
Models that run in LocalAI
Qwen3.8 27B
excellent at writing, code, and translation
WritingChatArchiveCodeTranslateRuns in:Fits on:18 GB · Free · Apache 2.0
Gemma 4 26B A4B
great at writing text, and quicker than it looks
WritingChatArchiveTranslateRuns in:Fits on:16 GB · Free · Apache 2.0
Qwen3 235B-A22B
a giant chatbot for the biggest computers
WritingChatCodeRuns in:120 GB · Free · Apache 2.0
Qwen3.5 27B
strong at writing, code, and other languages
WritingChatArchiveCodeTranslateRuns in:Fits on:18 GB · Free · Apache 2.0
Qwen3.5 35B-A3B
fast chat and code, because only a slice wakes up
WritingChatCodeRuns in:20.4 GB · Free · Apache 2.0
Gemma 3 27B
a strong writer, a step behind Gemma 4
WritingChatArchiveRuns in:Fits on:17 GB · Free · Gemma Terms of Use
Qwen3-Coder 30B-A3B
fast help with code
CodeRuns in:Fits on:19 GB · Free · Apache 2.0
gpt-oss 120B
OpenAI's big open model, for huge memory pools
WritingChatCodeRuns in:65 GB · Free · Apache 2.0
Gemma 3 12B
great at writing text on a 16 GB machine
WritingChatArchiveTranslateRuns in:Fits on:8.2 GB · Free · Gemma Terms of Use
DeepSeek R1 Distill 32B
talks through the steps before it answers
WritingChatCodeRuns in:20 GB · Free · MIT
Qwen3 8B
a quick chatbot that fits smaller computers
WritingChatArchiveCodeTranslateRuns in:Fits on:5.2 GB · Free · Apache 2.0
Gemma 3n E4B
pleasant everyday notes on a laptop
WritingChatRuns in:Fits on:5 GB · Free · Gemma Terms of Use
Llama 3.3 70B
a famous big chatbot that needs lots of memory
WritingChatArchiveRuns in:40 GB · Free · Llama 3.3 Community License
gpt-oss 20B
a solid helper for chat and code
WritingChatCodeRuns in:Fits on:14 GB · Free · Apache 2.0
Gemma 3 4B
great at writing text, and it can look at a photo
WritingChatTranslateRuns in:Fits on:3.4 GB · Free · Gemma Terms of Use
Qwen2.5-Coder 32B
a well-known local coding helper
CodeRuns in:20 GB · Free · Apache 2.0
Aya Expanse 32B
a multilingual writer
WritingChatTranslateRuns in:20 GB · Free · CC-BY-NC 4.0
Phi-4 14B
careful answers, strong for its size
WritingChatCodeRuns in:Fits on:9.1 GB · Free · MIT
Qwen2.5-Coder 7B
helps with short bits of code
CodeRuns in:Fits on:4.7 GB · Free · Apache 2.0
Aya Expanse 8B
writes and translates across languages
WritingChatTranslateRuns in:Fits on:5 GB · Free · CC-BY-NC 4.0
Llama 3.2 3B
great at short rewrites on a tiny computer
WritingChatRuns in:Fits on:2 GB · Free · Llama 3.2 Community License
Qwen2.5-VL 7B
reads text from scans (OCR) and answers about the picture
ScanRuns in:Fits on:6 GB · Free · Apache 2.0