Skip to content

Hardware Requirements

Jump to bottom
Tony edited this page Mar 20, 2022 · 1 revision

Hardware Requirements

GPT models are quite hefty in terms of the amount of computational resources they require to run. Below is a table on what is necessary to run each model.

Model VRAM (GPU) RAM (CPU) VRAM (Quantized)
GPT-Neo 2.7B 8GB 14GB 4GB
GPT-J 6B 16GB 38GB 12GB
Fairseq 13B 32GB 78GB 22GB
GPT-Neo 20B ~64GB ~110GB ~32GB
Clone this wiki locally