Bump transformers from 4.31.0 to 4.33.1

[dependabot]

Bumps transformers from 4.31.0 to 4.33.1.

Release notes

Sourced from transformers's releases.

Falcon, Code Llama, ViTDet, DINO v2, VITS

Falcon

Falcon is a class of causal decoder-only models built by TII. The largest Falcon checkpoints have been trained on >=1T tokens of text, with a particular emphasis on the RefinedWeb corpus. They are made available under the Apache 2.0 license.

Falcon’s architecture is modern and optimized for inference, with multi-query attention and support for efficient attention variants like FlashAttention. Both ‘base’ models trained only as causal language models as well as ‘instruct’ models that have received further fine-tuning are available.

• Falcon port #24523 by @​Rocketknight1
• Falcon: Add RoPE scaling by @​gante in #25878
• Add proper Falcon docs and conversion script by @​Rocketknight1 in #25954
• Put Falcon back by @​LysandreJik in #25960
• [Falcon] Remove SDPA for falcon to support earlier versions of PyTorch (< 2.0) by @​younesbelkada in #25947

Code Llama

Code Llama, is a family of large language models for code based on Llama 2, providing state-of-the-art performance among open models, infilling capabilities, support for large input contexts, and zero-shot instruction following ability for programming tasks.

• [CodeLlama] Add support for CodeLlama by @​ArthurZucker in #25740
• [CodeLlama] Fix CI by @​ArthurZucker in #25890

ViTDet

ViTDet reuses the ViT model architecture, adapted to object detection.

• Add ViTDet by @​NielsRogge in #25524

DINO v2

DINO v2 is the next iteration of the DINO model. It is added as a backbone class, allowing it to be re-used in downstream models.

• [DINOv2] Add backbone class by @​NielsRogge in #25520

VITS

VITS (Variational Inference with adversarial learning for end-to-end Text-to-Speech) is an end-to-end speech synthesis model that predicts a speech waveform conditional on an input text sequence. It is a conditional variational autoencoder (VAE) comprised of a posterior encoder, decoder, and conditional prior.

• add VITS model by @​hollance in #24085

Breaking changes:

• 🚨🚨🚨 [Refactor] Move third-party related utility files into integrations/ folder 🚨🚨🚨 by @​younesbelkada in #25599

Moves all third party libs (outside HF ecosystem) related utility files inside integrations/ instead of having them in transformers directly.

In order to get the previous usage you should be changing your call to the following:

- from transformers.deepspeed import HfDeepSpeedConfig
+ from transformers.integrations import HfDeepSpeedConfig

Bugfixes and improvements

... (truncated)

Commits

• fa6107c modify context length for GPTQ + version bump (#25899)
• 300d6a4 Remove Falcon from undocumented list (#26008)
• fa522d8 🌐[i18n-KO] Translated llm_tutorial.md to Korean (#25791)
• 3e203f9 Fix small typo README.md (#25934)
• 842e99f TF-OPT attention mask fixes (#25238)
• f6301b9 Falcon: fix revision propagation (#26006)
• f6295c6 Update README.md (#26003)
• 172f42c save space when converting hf model to megatron model. (#25950)
• b8def68 Fix Mega chunking error when using decoder-only model (#25765)
• 4fa0aff [VITS] tokenizer integration test: fix revision did not exist (#25996)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #304.