Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

trauma stuck indefinatly for some files when downloading large number of files. #43

Open
kprasadvnsi opened this issue Nov 3, 2022 · 8 comments
Labels
feedback/question Further information is requested status/help wanted Could use an extra brain

Comments

@kprasadvnsi
Copy link

Help request

Need help debugging this issue.

Problem

It stuck at downloading some files. there is nothing special about those files or the download link. it does this randomly for few files when tries to download large number of files.
SGCAM_20221103_202144307 NIGHT
SGCAM_20221103_193828240 NIGHT

@kprasadvnsi kprasadvnsi added the feedback/question Further information is requested label Nov 3, 2022
@kprasadvnsi
Copy link
Author

I don't know why download never timeout. it doesn't show anything useful. I have only these pictures to go by.

@rgreinho
Copy link
Owner

rgreinho commented Nov 5, 2022

Thank you for the report. I tried reproducing the issue on my machine, downloading a couple Debian ISO images at the same time, but it never got stuck. Would you happen to have the links causing the issue by any chance?

@kprasadvnsi
Copy link
Author

I made a demo project to reproduce this bug. https://github.com/kprasadvnsi/trauma_bug_hunt

@kprasadvnsi
Copy link
Author

it took me around 10 minutes to see the bug at 100mbps network speed.

@rgreinho
Copy link
Owner

rgreinho commented Nov 7, 2022

Thank you very much for the demo to try to reproduce the problem.

On my side, I was able to run it without any issue:

image

And the out dir:

image

If I cannot reproduce the issue that will make it more difficult to fix it.

I will try to review the code to see where I could have forgotten a timeout or something which would block infinitely.

I will leave this issue open as well, in case other people are facing the same problem ,they could comment here.

@rgreinho rgreinho added the status/help wanted Could use an extra brain label Nov 7, 2022
@kprasadvnsi
Copy link
Author

Some files are failed to download even though it does show all files are get downloaded.

xdg-utils-1.1.3+21+g1a58bc2-2-any.pkg.tar.xz
vino-3.22.0+74+g7a95e10-1-aarch64.pkg.tar.xz
vinagre-3.22.0+35+gadcb63c-2-aarch64.pkg.tar.xz
tracker-miners-debug-1:2.3.5+r3+gd9d61d87f-4-aarch64.pkg.tar.xz
tracker-miners-1:2.3.5+r3+gd9d61d87f-4-aarch64.pkg.tar.xz
tracker-debug-1:2.3.6+r7+gb27396252-2-aarch64.pkg.tar.xz
tracker-1:2.3.6+r7+gb27396252-2-aarch64.pkg.tar.xz
sound-juicer-3.38.0+r27+g9f97ca1f-1-aarch64.pkg.tar.xz
signon-ui-debug-0.17+20171022-3-aarch64.pkg.tar.xz
signon-ui-0.17+20171022-3-aarch64.pkg.tar.xz
shared-mime-info-2.0+155+gf4e7cbc-1-aarch64.pkg.tar.xz
seahorse-nautilus-debug-1:3.11.92+r96+g0fd324c-1-aarch64.pkg.tar.xz
seahorse-nautilus-1:3.11.92+r96+g0fd324c-1-aarch64.pkg.tar.xz
rest-0.8.1+r4+ge5ee6ef-1-aarch64.pkg.tar.xz
qt5-xcb-private-headers-5.15.7+kde+r167-1-aarch64.pkg.tar.xz
qt5-websockets-debug-5.15.7+kde+r2-1-aarch64.pkg.tar.xz
qt5-websockets-5.15.7+kde+r2-1-aarch64.pkg.tar.xz
qt5-webchannel-debug-5.15.7+kde+r3-1-aarch64.pkg.tar.xz
qt5-webchannel-5.15.7+kde+r3-1-aarch64.pkg.tar.xz
qt5-wayland-debug-5.15.7+kde+r49-1-aarch64.pkg.tar.xz
qt5-wayland-5.15.7+kde+r49-1-aarch64.pkg.tar.xz
qt5-tools-debug-5.15.7+kde+r1-1-aarch64.pkg.tar.xz
qt5-tools-5.15.7+kde+r1-1-aarch64.pkg.tar.xz
qt5-svg-debug-5.15.7+kde+r9-1-aarch64.pkg.tar.xz
qt5-svg-5.15.7+kde+r9-1-aarch64.pkg.tar.xz
qt5-speech-debug-5.15.7+kde+r1-1-aarch64.pkg.tar.xz
qt5-speech-5.15.7+kde+r1-1-aarch64.pkg.tar.xz
qt5-quickcontrols2-debug-5.15.7+kde+r6-1-aarch64.pkg.tar.xz
qt5-quickcontrols2-5.15.7+kde+r6-1-aarch64.pkg.tar.xz
qt5-quick3d-debug-5.15.7+kde+r1-1-aarch64.pkg.tar.xz
qt5-quick3d-5.15.7+kde+r1-1-aarch64.pkg.tar.xz
qt5-multimedia-debug-5.15.7+kde+r1-1-aarch64.pkg.tar.xz
qt5-multimedia-5.15.7+kde+r1-1-aarch64.pkg.tar.xz
qt5-location-debug-5.15.7+kde+r3-1-aarch64.pkg.tar.xz
qt5-location-5.15.7+kde+r3-1-aarch64.pkg.tar.xz
qt5-imageformats-debug-5.15.7+kde+r5-1-aarch64.pkg.tar.xz
qt5-imageformats-5.15.7+kde+r5-1-aarch64.pkg.tar.xz
qt5-declarative-debug-5.15.7+kde+r18-1-aarch64.pkg.tar.xz
qt5-declarative-5.15.7+kde+r18-1-aarch64.pkg.tar.xz
qt5-connectivity-debug-5.15.7+kde+r5-1-aarch64.pkg.tar.xz
qt5-connectivity-5.15.7+kde+r5-1-aarch64.pkg.tar.xz
qt5-base-debug-5.15.7+kde+r167-1-aarch64.pkg.tar.xz
qt5-base-5.15.7+kde+r167-1-aarch64.pkg.tar.xz
qt5-3d-debug-5.15.7+kde+r6-1-aarch64.pkg.tar.xz
qt5-3d-5.15.7+kde+r6-1-aarch64.pkg.tar.xz
pavucontrol-debug-1:5.0+r61+gee77d86-2-aarch64.pkg.tar.xz
pavucontrol-1:5.0+r61+gee77d86-2-aarch64.pkg.tar.xz
pangox-compat-0.0.2+2+gedb9e09-3-aarch64.pkg.tar.xz
ossp-1.3.2+11+g9e94d67-3-aarch64.pkg.tar.xz
nautilus-sendto-3.8.6+28+gc87aac4-1-aarch64.pkg.tar.xz
musepack-tools-1:0.1+r475-3-aarch64.pkg.tar.xz
libzapojit-0.0.3+14+g2dace3f-2-aarch64.pkg.tar.xz
libxml++-docs-3.2.4-1-aarch64.pkg.tar.xz
libxml++-5.0-docs-5.0.2-1-aarch64.pkg.tar.xz
libxml++-5.0-5.0.2-1-aarch64.pkg.tar.xz
libxml++-3.2.4-1-aarch64.pkg.tar.xz
libsigc++-docs-2.10.8-1-aarch64.pkg.tar.xz
libsigc++-3.0-docs-3.2.0-1-aarch64.pkg.tar.xz
libsigc++-3.0-3.2.0-1-aarch64.pkg.tar.xz
libsigc++-2.10.8-1-aarch64.pkg.tar.xz
liboauth-1:1.0.3+r16+gc26f038-1-aarch64.pkg.tar.xz
libmpcdec-1:0.1+r475-3-aarch64.pkg.tar.xz
libhandy0-0.0.13+12+gaa6b6f4-3-aarch64.pkg.tar.xz
libgweather-debug-40.0+r87+g80e5a652-2-aarch64.pkg.tar.xz
libgweather-40.0+r87+g80e5a652-2-aarch64.pkg.tar.xz
libgtop-2.40.0+2+g31db82ef-2-aarch64.pkg.tar.xz
libgrss-0.7.0+16+g971c421-3-aarch64.pkg.tar.xz
libgnome-keyring-3.12.0+13+g4f8ab73-3-aarch64.pkg.tar.xz
libdbusmenu-qt6-0.9.3+16.04.20160218-6-aarch64.pkg.tar.xz
libdbusmenu-qt5-0.9.3+16.04.20160218-6-aarch64.pkg.tar.xz
libcryptui-debug-1:3.12.2+r71+ged4f890e-1-aarch64.pkg.tar.xz
libcryptui-1:3.12.2+r71+ged4f890e-1-aarch64.pkg.tar.xz
libcloudproviders-debug-0.3.1+r8+g3a229ee-1-aarch64.pkg.tar.xz
libcloudproviders-0.3.1+r8+g3a229ee-1-aarch64.pkg.tar.xz
libcheese-43alpha+r8+g1de47dbc-1-aarch64.pkg.tar.xz
libcdio-paranoia-10.2+2.0.1-2-aarch64.pkg.tar.xz
libcanberra-debug-1:0.30+r2+gc0620e4-1-aarch64.pkg.tar.xz
libcanberra-1:0.30+r2+gc0620e4-1-aarch64.pkg.tar.xz
libasyncns-debug-1:0.8+r3+g68cd5af-1-aarch64.pkg.tar.xz
libasyncns-1:0.8+r3+g68cd5af-1-aarch64.pkg.tar.xz
gtk3-docs-1:3.24.34+r156+g812b3930d0-1-aarch64.pkg.tar.xz
gtk3-demos-1:3.24.34+r156+g812b3930d0-1-aarch64.pkg.tar.xz
gtk3-debug-1:3.24.34+r156+g812b3930d0-1-aarch64.pkg.tar.xz
gtk3-1:3.24.34+r156+g812b3930d0-1-aarch64.pkg.tar.xz
gpaste-debug-43.0+r9+gdecb566d-1-aarch64.pkg.tar.xz
gpaste-43.0+r9+gdecb566d-1-aarch64.pkg.tar.xz
gnome-video-effects-0.5.0+4+g9554041-2-any.pkg.tar.xz
gnome-tweaks-42beta+r14+g2d9d76c-2-any.pkg.tar.xz
gnome-todo-debug-41.0+r106+gebc68374-1-aarch64.pkg.tar.xz
gnome-todo-41.0+r106+gebc68374-1-aarch64.pkg.tar.xz
gnome-themes-standard-3.22.3+16+gc092fc89-1-aarch64.pkg.tar.xz
gnome-themes-extra-3.28+r6+g45b1d457-1-aarch64.pkg.tar.xz
gnome-system-log-3.9.90+160+g4b07190-2-aarch64.pkg.tar.xz
gnome-screenshot-debug-41.0+r25+g45f08f0-1-aarch64.pkg.tar.xz
gnome-screenshot-41.0+r25+g45f08f0-1-aarch64.pkg.tar.xz
gnome-documents-3.34.0+34+g678141fa-1-aarch64.pkg.tar.xz
gnome-color-manager-debug-3.36.0+r25+g4aab8b59-1-aarch64.pkg.tar.xz
gnome-color-manager-3.36.0+r25+g4aab8b59-1-aarch64.pkg.tar.xz
gmime-2.6.23+4+g91dcee38-3-aarch64.pkg.tar.xz
fluxbox-1.3.7+211+g9d8202f3-1-aarch64.pkg.tar.xz
empathy-3.25.90+34+g78f4d4fda-3-aarch64.pkg.tar.xz
dvd+rw-tools-7.1-9-aarch64.pkg.tar.xz
cheese-debug-43alpha+r8+g1de47dbc-1-aarch64.pkg.tar.xz
cheese-43alpha+r8+g1de47dbc-1-aarch64.pkg.tar.xz
brasero-debug-3.12.3+r24+gd01ba738-1-aarch64.pkg.tar.xz
brasero-3.12.3+r24+gd01ba738-1-aarch64.pkg.tar.xz
avahi-0.8+22+gfd482a7-3-aarch64.pkg.tar.xz
adobe-source-code-pro-fonts-2.038ro+1.058it+1.018var-1-any.pkg.tar.xz

I found these ones not get downloaded.

@Aurillium
Copy link
Contributor

@kprasadvnsi I've just tested this and had no issues, but as I was doing so I started to run out of storage space on my laptop because the total of the downloads is ~40GB. Something which can cause undefined behaviour such as long hangs like this, or files not writing to the disk, is running out of storage space (or having very little left).
Are you sure this isn't what happened?

@kprasadvnsi
Copy link
Author

@kprasadvnsi I've just tested this and had no issues, but as I was doing so I started to run out of storage space on my laptop because the total of the downloads is ~40GB. Something which can cause undefined behaviour such as long hangs like this, or files not writing to the disk, is running out of storage space (or having very little left). Are you sure this isn't what happened?

Yes, Storage is not a problem in my case. I have tried it on few different machines and they all have this problem. What bugs me the most is the nature if this problem. the longer the download run it gets higher probability of hitting this bug. I am using the term "Probability" loosely here. I don't have a mathematical way to prove this. its just my observation.

I can make a video if it helps?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feedback/question Further information is requested status/help wanted Could use an extra brain
Projects
None yet
Development

No branches or pull requests

3 participants