VRAM Calculator

An app which helps to estimate GPU VRAM needed for training/inference transformer runs. Check it out here: vram.asmirnov.xyz.

Details

You can find main logic of calculating the result in ./app/_lib/index.ts.

Development

npm install
npm run dev

Deployment

npm install
npm run build

It will result with ./out folder which can be served with any webserver (e.g. nginx).

ToDo

• Quantized models inference
• LoRA/QLoRA fine-tuning

Credits

This project is forked from furiousteabag/vram-calculator.