Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix transformers v4.42.0 compatibility #793

Merged
merged 18 commits into from
Jul 5, 2024
Merged

Fix transformers v4.42.0 compatibility #793

merged 18 commits into from
Jul 5, 2024

Conversation

echarlaix
Copy link
Collaborator

@echarlaix echarlaix commented Jul 1, 2024

Fixes #792

Can be merged after transformers next patch release huggingface/transformers#31755

@echarlaix echarlaix marked this pull request as draft July 1, 2024 14:08
@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@echarlaix echarlaix added the openvino-test Trigger OpenVINO slow tests label Jul 2, 2024
@@ -681,6 +681,7 @@ def _inner_training_loop(
def save_model(
self,
output_dir: Optional[str] = None,
_internal_call: bool = False,
Copy link
Collaborator Author

@echarlaix echarlaix Jul 2, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@echarlaix echarlaix changed the title fix transformers v4.42.0 compatibility Fix transformers v4.42.0 compatibility Jul 2, 2024
@echarlaix echarlaix marked this pull request as ready for review July 2, 2024 10:05
Copy link
Member

@IlyasMoutawwakil IlyasMoutawwakil left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM Thanks

"optimum~=1.20",
"transformers>=4.36.0,<4.43.0",
"optimum @ git+https://github.com/huggingface/optimum.git",
# "optimum>=1.21.2,<1.22.0",
Copy link
Collaborator Author

@echarlaix echarlaix Jul 3, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

optimum>=1.21.2,<1.22.0 needed to include huggingface/optimum#1938

@echarlaix echarlaix merged commit a3ab3a4 into main Jul 5, 2024
16 of 26 checks passed
@echarlaix echarlaix deleted the trfs-2 branch July 5, 2024 11:28
echarlaix added a commit that referenced this pull request Jul 8, 2024
* fix transformers v4.42.0 compatibility

* fix inc modeling

* update setup

* add missing argument

* fix patching

* format

* fix num quant op

* remove incompatible transformers generation

* udpate setup
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
openvino-test Trigger OpenVINO slow tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

transformers version requirements conflicting with vLLM
4 participants