parallel partial scp upload ?

[grosser]

is there an option to make scp upload parallel parts ?

for example for a 100mb file upload 3 33mb parts in parallel ... lftp seems to support that, but using it is not trivial ... (seeing 16min -> 6min upload improvement)

[leehambley]

I don't think it's plausible given the current APIs, perhaps you'd be better served shelling out to rsync? Which is pretty trivial in the confines of Capistrano/SSHKit as you have access to Rake's sh helper?

[grosser]

yeah, we'll look into doing that, was hoping someone already ran into this and it's just not documented :)

…

On Mon, Mar 20, 2017 at 11:37 AM, Lee Hambley ***@***.***> wrote: I don't think it's plausible given the current APIs, perhaps you'd be better served shelling out to rsync? Which is pretty trivial in the confines of Capistrano/SSHKit as you have access to Rake's sh helper? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#394 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAAsZ_V0CodYBnSxGb1VzkEy4tdMEL_xks5rnsdZgaJpZM4Mi0jZ> .

[mattbrictson]

SSHKit mostly just delegates to net-scp for our scp functionality. A quick glance at that repo indicates that a parallel partial upload is not supported.

https://github.com/net-ssh/net-scp

This is probably too much of an edge case for us to build this as part of SSHKit, IMHO.

[grosser]

yeah, move the issue to net-ssh/net-scp#32 thx for the quick reply!