Skip to content

Comments

Batch by total request message size.#410

Merged
petermyers merged 4 commits intomasterfrom
issue-sqs-batching-by-size
Aug 5, 2025
Merged

Batch by total request message size.#410
petermyers merged 4 commits intomasterfrom
issue-sqs-batching-by-size

Conversation

@petermyers
Copy link
Collaborator

@petermyers petermyers commented Jun 4, 2025

Per the aws docs for SendMessageBatch:
The maximum allowed individual message size and the maximum total payload size (the sum of the individual lengths of all of the batched messages) are both 256 KiB (262,144 bytes).

  • Adds a batchWithPayloadSizeOrCount that is JUST batching and doesn't deal with any of the claimcheck logic.
  • Adds batching per request size in addition to the message count to the SQS sink.

@petermyers petermyers changed the title Batch to total request message. Batch to total request message size. Jun 4, 2025
@petermyers petermyers requested a review from jgilbert01 June 4, 2025 14:42
@petermyers petermyers changed the title Batch to total request message size. Batch by total request message size. Jun 4, 2025
@petermyers petermyers force-pushed the issue-sqs-batching-by-size branch from d291694 to 2bc6d95 Compare July 29, 2025 21:14
@petermyers petermyers requested a review from jgilbert01 July 29, 2025 21:23
@petermyers petermyers merged commit a8b1b81 into master Aug 5, 2025
2 checks passed
@petermyers petermyers deleted the issue-sqs-batching-by-size branch August 5, 2025 19:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants