New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

【Question】What is the minimum number of GPUs required to train deepseek 671B with GRPO? How about using LoRA? #6219

Open

LiuShixing opened this issue Feb 25, 2025 · 0 comments

LiuShixing commented Feb 25, 2025

https://company.hpc-ai.com/blog/shocking-release-deepseek-671b-fine-tuning-guide-revealed-unlock-the-upgraded-deepseek-suite-with-one-click-ai-players-ecstatic

The above article only provides the GPU requirements for SFT LoRA. What about GRPO?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment