Skip to content
This repository has been archived by the owner on Jul 22, 2021. It is now read-only.

COPY runs before all files are copied to S3 #3

Open
mklaber opened this issue Feb 9, 2016 · 0 comments
Open

COPY runs before all files are copied to S3 #3

mklaber opened this issue Feb 9, 2016 · 0 comments
Labels

Comments

@mklaber
Copy link
Contributor

mklaber commented Feb 9, 2016

Appears to be a race condition under which the COPY command is looking for files in an S3 bucket that don't yet exist. Re-running the query works.

Status: Failed 

 Error in SQL: The specified S3 prefix 'parsed-names/20160209-201927/output' does not exist 
DETAIL: 
 ----------------------------------------------- 
error: The specified S3 prefix 'parsed-names/20160209-201927/output' does not exist code: 8001 context:  
query: 3525417 
location: s3_utility.cpp:541 
process: padbmaster [pid=14844] -----------------------------------------------

Possible solution? Put an arbitrary "WAIT" command?

@mklaber mklaber added the bug label Feb 9, 2016
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

1 participant