[feature] Reintroduce add_resource_limit to kfp v2 SDK or another resource requests/limits mechanism

[dariuszg-gc]

Feature Area

/area sdk

What feature would you like to see?

Reintroduction of add_resource_limit and add_resource_request from v1 to v2 SDK.

pipelines/sdk/python/kfp/deprecated/dsl/_container_op.py

Line 268 in 38ef986

def add_resource_limit(self, resource_name, value) -> 'Container':

pipelines/sdk/python/kfp/deprecated/dsl/_container_op.py

Line 281 in 38ef986

def add_resource_request(self, resource_name, value) -> 'Container':

OR another mechanism to allow flexible specification of multiple resource requests/limits

What is the use case or pain point?

Currently the only mechanism to achieve setting resource limit is available via the set_accelerator_type and set_accelerator_limit methods (with intention to use it for GPU/TPU devices), however it allows to specify them only for a singular resource.

There are several use cases that require usage of multiple DevicePlugin/DRA managed devices (e.g GPU + RDMA RNIC), thus the need for a mechanism that allows adding multiple resource limits/requests to the pod spec.

Is there a workaround currently?

None (v2) or use of deprecated version.

---

Love this idea? Give it a 👍.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[dariuszg-gc]

/remove-lifecycle stale

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[dariuszg-gc]

/remove-lifecycle stale

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[github-actions]

This issue has been automatically closed because it has not had recent activity. Please comment "/reopen" to reopen it.

[dariuszg-gc]

/reopen

[google-oss-prow]

@dariuszg-gc: Reopened this issue.

In response to this:

/reopen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[dariuszg-gc]

/remove-lifecycle stale