Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

lora initialisation missing from builder.py #106

Open
adrielkuek opened this issue May 2, 2024 · 1 comment
Open

lora initialisation missing from builder.py #106

adrielkuek opened this issue May 2, 2024 · 1 comment

Comments

@adrielkuek
Copy link

Hi, currently peft is supported in train.py with lora_enable flag, however during inference when loading model.builder, there seems to be a mismatch if the model was trained with lora or qlora. Wondering whether the team would be updating builder code base from LlaVA to include peft support?

@yanwei-li
Copy link
Member

Hi, all our models are fully finetunded. Actually, I did not try LoRA. This could be checked and supported soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants