-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
GPU run out of Storage #5
Comments
startcoder is so huge that the normal machine couldn't afford it. Try some light-weight model. |
First thanks a lot! However now I'm in a much bigger trouble. When I tried to delete sth for more spaces, I saw some unknown folders through FIleZilla. At that time I thought I downloaded sth mistakenly but now I release they are other students' folder on cs2 gpu. I tried to delete everything unknown but turns out that it deleted sth about my settings and anaconda3. Now I cannot use conda or even reinstall it. I don't know what to do. So despairing. How I hope I can restart everything! There are the error message. |
trust me. I remember that bigcoder reqiures almost 30 GB for RAM(HBM) when you use float 16 version. Even if you download it and config it successfully, you couldn't run it in the HKU GPU FARM. What's more, when you delete someone's files, you will face permission denied error. Don't worry about it. Try to exit and config the nevironment again. Maybe it works. |
Thanks. However, I failed to delete others while I seems to successfully delete mine! T^T So I cannot use conda now. And I cannot reinstall it because of "unhandled exception". |
I got this error. It's from run out of memory space. Maybe you didn't delete your files successfully. |
So, can I fix it by deleting sth? Can I delete the previous Ananconda folder, which seems so big? Actually it has already been my third time to install it so already two Anaconda files. And it is so big that it has been deleting a long time but still there. And I'm so afraid that I might distroyed something. T.T |
I tried to use conda but failed. Message as below. Could you please help to have a look? Thanks! Do you accept the license terms? [yes|no] Anaconda3 will now be installed into this location:
[/userhome/cs2/mchenal/anaconda3] >>> |
try to remove your files under /userhome/cs2/your_name folder, by using Search how to install and config conda in linux. |
mchenal@gpu2-comp-111: Not only conda, even pip is missing.... crying face |
try you don't have the permission to use apt in the HKU GPU server. |
Trying. Conda is back now! Still installing packages. Hope everything goes well. Millions of thanks!!!! |
miniconda is mini version of conda, whereas ananconda installs more packages than miniconda has. No difference. |
Solved. THANK YOU! 大神太感谢了 |
When downloading the model "bigcode/starcoder" and embedder "bert-nli-mean-tokens", although I have deleted the HuggingFace folder and all things of assignment 1 from the device, the disk still run out of storage. Is there any download else I didn't find which takes a lot space?
The text was updated successfully, but these errors were encountered: