Skip to content

Conversation

copybara-service[bot]
Copy link

@copybara-service copybara-service bot commented Sep 4, 2025

Propagate batch_padding_policy through BatchOptions in JSV

  • Propagate batch_padding_policy from BatchOptions -> BatchRunnerOpOptions -> QueueOptions.
  • Temporarily convert batch_padding_policy to string for propagation. Add TODOs to use BatchPaddingPolicy enum when BATCH_DOWN and MINIMIZE_TPU_COST_PER_REQUEST are supported.

Copy link

google-cla bot commented Sep 4, 2025

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

@copybara-service copybara-service bot force-pushed the test_803096545 branch 5 times, most recently from 45d2093 to e3dcdf2 Compare September 5, 2025 00:04
- Propagate batch_padding_policy from BatchOptions -> BatchRunnerOpOptions -> QueueOptions.
- Temporarily convert batch_padding_policy to string for propagation. Add TODOs to use BatchPaddingPolicy enum when BATCH_DOWN and MINIMIZE_TPU_COST_PER_REQUEST are supported.

PiperOrigin-RevId: 803096545
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants