Skip to content

Conversation

@abhinavclemson
Copy link
Collaborator

Description

Fix vllm weight mapping import issue.

FIXES: b/458679845

Before submitting this PR, please make sure (put X in square brackets):

  • I have performed a self-review of my code. For an optional AI review, add the gemini-review label.
  • I have necessary comments in my code, particularly in hard-to-understand areas.
  • I have run end-to-end tests tests and provided workload links above if applicable.
  • I have made or will make corresponding changes to the doc if needed, including adding new documentation pages to the relevant Table of Contents (toctree directive) as explained in our documentation.

import re

import maxtext.src.maxtext.integration.tunix.weight_mapping as weight_mapping # pylint: disable=consider-using-from-import
from MaxText.integration.tunix.weight_mapping import StandaloneVllmWeightMapping
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you know why this happened with copybara?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@abhinavclemson you would need to update the copybara script otherwise this PR will not be useful

Also there are other places where this is broken, so other files need to be added to the copybara
https://github.com/AI-Hypercomputer/maxtext/compare/anisha-fix-trainrl?expand=1

Copy link
Collaborator

@hengtaoguo hengtaoguo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting, this is not caught by copybara?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants