Skip to content

in-place ops to alias tensor args of function#877

Merged
t-vi merged 18 commits intomainfrom
crpa/alias-inplace-poc
Aug 7, 2024
Merged

in-place ops to alias tensor args of function#877
t-vi merged 18 commits intomainfrom
crpa/alias-inplace-poc

Conversation

@crcrpar
Copy link
Copy Markdown
Collaborator

@crcrpar crcrpar commented Jul 29, 2024

What does this PR do?

This is based on #798 and #869 and is trying to manage to support #738.

cc @Borda @apaz-cli

@github-actions github-actions bot added the documentation Improvements or additions to documentation label Jul 30, 2024
@crcrpar crcrpar force-pushed the crpa/alias-inplace-poc branch from 250ccc3 to 8d9939f Compare July 31, 2024 14:00
@crcrpar crcrpar changed the base branch from main to crpa/inplace-view-track August 2, 2024 13:21
@crcrpar crcrpar force-pushed the crpa/alias-inplace-poc branch from 8d9939f to 5524f1f Compare August 2, 2024 13:33
Base automatically changed from crpa/inplace-view-track to main August 3, 2024 06:12
@crcrpar crcrpar force-pushed the crpa/alias-inplace-poc branch from 5524f1f to 768ce1d Compare August 5, 2024 00:58
@crcrpar crcrpar changed the title [DO NOT MERGE] in-place ops to alias tensor args of function in-place ops to alias tensor args of function Aug 5, 2024
@crcrpar crcrpar marked this pull request as ready for review August 5, 2024 05:08
crcrpar added 18 commits August 6, 2024 16:54
elements

Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
commit 394d418
Author: Masaki Kozuki <mkozuki@nvidia.com>
Date:   Fri Jul 26 12:16:26 2024 +0900

    header to inform which base/views are replaced by which

    Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>

commit 0b9405d
Author: Masaki Kozuki <mkozuki@nvidia.com>
Date:   Fri Jul 26 11:50:03 2024 +0900

    track base and views for better in-place modification propagation

    Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>

Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
…_canonicalized_trace`

Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
…sting in-place logic

Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>
@crcrpar crcrpar force-pushed the crpa/alias-inplace-poc branch from af6176a to 100fef3 Compare August 6, 2024 07:54
Copy link
Copy Markdown
Collaborator

@t-vi t-vi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems OK, thank you @crcrpar

@t-vi t-vi merged commit 8ded3f9 into main Aug 7, 2024
@t-vi t-vi deleted the crpa/alias-inplace-poc branch August 7, 2024 19:05
t = bsym.flat_proxy_args[1]
index = arg_to_idx[t]
numel = t.numel
tensor_args_consumed_by_inplace_grouped_by_numel[numel].append(index)
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

question here: what's the reason that we are grouping them by numel?

numel = t.numel
tensor_args_consumed_by_inplace_grouped_by_numel[numel].append(index)
tensor_indices.append(index)
if len(tensor_args_consumed_by_inplace_grouped_by_numel) > 1:
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

follow up question, what's the implication of the bucket size > 1?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation in-place

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants