Workstation 24GB GPU

Models that fit on a Workstation 24GB GPU

• Gemma 3 12B

  great at writing text on a 16 GB machine

  WritingChatArchiveTranslate

  Runs in:

  • AnythingLLM
  • GPT4All
  • Jan

  +9

  Fits on:

  • 📦Mini PC
  • 💻Laptop 16GB

  +3

  8.2 GB · Free · Gemma Terms of Use

• Qwen3 8B

  a quick chatbot that fits smaller computers

  WritingChatArchiveCodeTranslate

  Runs in:

  • AnythingLLM
  • GPT4All
  • Jan

  +9

  Fits on:

  • 📦Mini PC
  • 💻Laptop 16GB

  +3

  5.2 GB · Free · Apache 2.0

• Gemma 3n E4B

  pleasant everyday notes on a laptop

  WritingChat

  Runs in:

  • AnythingLLM
  • GPT4All
  • Jan

  +9

  Fits on:

  • 📦Mini PC
  • 💻Laptop 16GB

  +3

  5 GB · Free · Gemma Terms of Use

• gpt-oss 20B

  a solid helper for chat and code

  WritingChatCode

  Runs in:

  • AnythingLLM
  • GPT4All
  • Jan

  +9

  Fits on:

  • 🍎Mac 32GB+
  • 🖥️Workstation 24GB GPU

  14 GB · Free · Apache 2.0

• Gemma 3 4B

  great at writing text, and it can look at a photo

  WritingChatTranslate

  Runs in:

  • AnythingLLM
  • GPT4All
  • Jan

  +9

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  3.4 GB · Free · Gemma Terms of Use

• Phi-4 14B

  careful answers, strong for its size

  WritingChatCode

  Runs in:

  • AnythingLLM
  • GPT4All
  • Jan

  +9

  Fits on:

  • 📦Mini PC
  • 💻Laptop 16GB

  +3

  9.1 GB · Free · MIT

• Qwen2.5-Coder 7B

  helps with short bits of code

  Code

  Runs in:

  • AnythingLLM
  • GPT4All
  • Jan

  +9

  Fits on:

  • 🍓Raspberry Pi 5
  • 📦Mini PC

  +5

  4.7 GB · Free · Apache 2.0

• Aya Expanse 8B

  writes and translates across languages

  WritingChatTranslate

  Runs in:

  • AnythingLLM
  • GPT4All
  • Jan

  +9

  Fits on:

  • 📦Mini PC
  • 💻Laptop 16GB

  +3

  5 GB · Free · CC-BY-NC 4.0

• NLLB-200 1.3B

  translates many languages

  Translate

  Runs in:

  • LibreTranslate

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  2.5 GB · Free · CC-BY-NC 4.0

• Llama 3.2 3B

  great at short rewrites on a tiny computer

  WritingChat

  Runs in:

  • AnythingLLM
  • GPT4All
  • Jan

  +9

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  2 GB · Free · Llama 3.2 Community License

• Whisper large-v3

  turns speech into text, the accuracy pick

  Transcript

  Runs in:

  • MacWhisper
  • whisper.cpp

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  3.1 GB · Free · MIT

• Whisper large-v3 turbo

  turns recordings into text, with less waiting

  Transcript

  Runs in:

  • MacWhisper
  • whisper.cpp

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  1.6 GB · Free · MIT

• Chatterbox

  reads text aloud with more expression

  Voice

  Runs in:

  • Chatterbox

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  2 GB · Free · MIT

• FLUX.1 Dev

  makes pictures that follow the prompt

  Images

  Runs in:

  • ComfyUI
  • Draw Things

  Fits on:

  • 🍎Mac 32GB+
  • 🖥️Workstation 24GB GPU

  12 GB · Free · Non-commercial FLUX.1 Dev license

• olmOCR 2 7B

  reads text from scans (OCR), including tables

  Scan

  Runs in:

  • LM Studio
  • olmOCR

  Fits on:

  • 📦Mini PC
  • 💻Laptop 16GB

  +3

  5.5 GB · Free · Apache 2.0

• Kokoro 82M

  reads text aloud in a warm voice

  Voice

  Runs in:

  • ComfyUI
  • Kokoro

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  0.3 GB · Free · Apache 2.0

• Distil-Whisper large-v3

  turns speech into text, in a smaller file

  Transcript

  Runs in:

  • MacWhisper
  • whisper.cpp

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  1.5 GB · Free · MIT

• Qwen2.5-VL 7B

  reads text from scans (OCR) and answers about the picture

  Scan

  Runs in:

  • AnythingLLM
  • GPT4All
  • Jan

  +9

  Fits on:

  • 📦Mini PC
  • 💻Laptop 16GB

  +3

  6 GB · Free · Apache 2.0

• FLUX.2 Klein 4B

  makes sharper pictures in a smaller file

  Images

  Runs in:

  • ComfyUI
  • Draw Things

  Fits on:

  • 📦Mini PC
  • 💻Laptop 16GB

  +3

  8 GB · Free · Apache 2.0

• FLUX.1 Schnell

  makes pictures quickly

  Images

  Runs in:

  • ComfyUI
  • Draw Things

  Fits on:

  • 📦Mini PC
  • 💻Laptop 16GB

  +3

  8 GB · Free · Apache 2.0

• Wan 2.1 1.3B

  makes a short, rough video clip

  Video

  Runs in:

  • ComfyUI

  Fits on:

  • 📦Mini PC
  • 💻Laptop 16GB

  +3

  8 GB · Free · Apache 2.0

• Whisper small

  turns speech into text, almost anywhere

  Transcript

  Runs in:

  • MacWhisper
  • whisper.cpp

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  0.5 GB · Free · MIT

• Stable Diffusion XL

  makes pictures on small computers

  Images

  Runs in:

  • ComfyUI
  • Draw Things

  Fits on:

  • 📦Mini PC
  • 💻Laptop 16GB

  +3

  7 GB · Free · OpenRAIL++

• PaddleOCR

  reads text from scans (OCR), including tilted photos

  Scan

  Runs in:

  • PaddleOCR

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  0.2 GB · Free · Apache 2.0

• Piper (English)

  reads text aloud in a plain voice

  Voice

  Runs in:

  • Piper

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  0.1 GB · Free · GPL-3.0

• Tesseract

  reads text from scans (OCR)

  Scan

  Runs in:

  • Tesseract

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  0 GB · Free · Apache 2.0

• Real-ESRGAN

  enlarges a picture you already have

  Images

  Runs in:

  • ComfyUI

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  0.3 GB · Free · BSD 3-Clause

• bge-m3

  archives and searches your documents

  Archive

  Runs in:

  • AnythingLLM
  • Open WebUI

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  1.2 GB · Free · MIT

• nomic-embed-text

  searches English documents

  Archive

  Runs in:

  • AnythingLLM
  • Ollama

  Fits on:

  • 🍓Raspberry Pi 5
  • 📱Phone

  +6

  0.3 GB · Free · Apache 2.0