Code

Switch S3 writes to use streaming I/O#51

Code

Merged

jhiemstrawisc merged 11 commits intoPelicanPlatform:mainPelicanPlatform/xrootd-s3-http:mainfrom bbockelm:streaming_io_v2bbockelm/xrootd-s3-http:streaming_io_v2Copy head branch name to clipboardDec 5, 2024

+1,254-295

Commits

Commits on Dec 3, 2024

• Add unit test coverage for S3 upload

  Show description for b92f134
  bbockelm

  committed
  b92f134

  Copy full SHA for b92f134

• Minor logging fixups

  Show description for 538d478
  bbockelm

  committed
  538d478

  Copy full SHA for 538d478

• Fixups: Linux compile fixes for s3 tests

  bbockelm

  committed
  e3f0a24

  Copy full SHA for e3f0a24

• Allow writes to stream to S3, not buffer

  Show description for 46b5b43
  bbockelm

  committed
  46b5b43

  Copy full SHA for 46b5b43

• clang-format of the curl headers

  bbockelm

  committed
  4183ba0

  Copy full SHA for 4183ba0

• Avoid unpausing from a separate thread

  Show description for 7ea062f
  bbockelm

  committed
  7ea062f

  Copy full SHA for 7ea062f

• Time out in-progress transfers

  Show description for f195be4
  bbockelm

  committed
  f195be4

  Copy full SHA for f195be4

• Notify from the main curl worker loop

  Show description for 4973bf4
  bbockelm

  committed
  4973bf4

  Copy full SHA for 4973bf4

• Restore buffering mode for objects of unknown size

  Show description for a8e588b
  bbockelm

  committed
  a8e588b

  Copy full SHA for a8e588b

• Small file upload optimization

  Show description for 10dea9b
  bbockelm

  committed
  10dea9b

  Copy full SHA for 10dea9b

• Correctly refactor unit tests

  Show description for 4ca3895
  bbockelm

  committed
  4ca3895

  Copy full SHA for 4ca3895