Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unexpected EOF when synching bucket to local fs #55

Open
temelt opened this issue Apr 29, 2021 · 4 comments
Open

Unexpected EOF when synching bucket to local fs #55

temelt opened this issue Apr 29, 2021 · 4 comments

Comments

@temelt
Copy link

temelt commented Apr 29, 2021

I am using the version 2.25, when i run the sync with these parameters

./s3sync -d --sync-log --sk **** --ss *** --se hostaddr -w 20 s3://test fs://./data/

it is working some time but after some downloads getting this error.

DEBU[0050] Recv pipeline err: object: )gFE5OB2/11.xo1dBK1OamWlMJsb.rnd sync error: unexpected EOF ERRO[0050] Sync error: pipeline step: 1 (LoadObjData) failed with error: object: )gFE5OB2/11.xo1dBK1OamWlMJsb.rnd sync error: unexpected EOF, terminating

Same for version 2.30
INFO[0901] Sync file Content-Type=application/octet-stream key=9zabR6AR/17.yXJzkzaeeS9gDKpn.rnd size=10485760 DEBU[0903] Recv pipeline err: object: 9Agq8lXt/82.Lit0v8qT2Ptof0H).rnd sync error: unexpected EOF ERRO[0903] Sync error: pipeline step: 1 (LoadObjData) failed with error: object: 9Agq8lXt/82.Lit0v8qT2Ptof0H).rnd sync error: unexpected EOF, terminating

and also that's not good to not have any details about the error, (debug log enabled, retry enabled, sync-log enabled )

Thanks in advance

@cl-bvl
Copy link
Collaborator

cl-bvl commented May 7, 2021

Hello. It's look like network/server issue. The network connection was dropped before read was completed.
You can:

  1. Check S3 servers logs. Maybe server crashing and restarting or another server issue.
  2. Check network (packet loss or incorrect MTU).
  3. Try do download this files via curl or another http client.

@temelt
Copy link
Author

temelt commented May 8, 2021

I've tried with RClone and all the files downloaded successfully (25GB/2500Files)

@schickling
Copy link

Same issue here.

@andrewchambers
Copy link

Getting the same issue syncing out of backblaze.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants