Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Confused about download model files when trying deploy demo locally #8

Open
GodfatherPacino opened this issue May 22, 2023 · 2 comments

Comments

@GodfatherPacino
Copy link

Hi developers, thanks for your wonderful job and I have got good performance when I input my own test images on your web demo. So I tried to run your model demo locally. But I got confused when I followed your readme step by step.
First, there is only 2 files in http://lmflow.org:5000/detgpt/
image
But more files in the upper level directory. Are there some of them should be put in /detgpt or useful for DetGPT?
image

Second, In readme, Step 2 suggests 'use Robin from LMFlow team', merge Robin with origin Llama model. But in 'Deploy Demo Locally' part, it seems that the demo is using 'linear weights based on Vicuna-13B-v1.1'. So Vicuna-13B is used as the LLM part in demo?
And I can not find the pretrained linear weights following the link. It seems only complete vicuna models on your hugging face account.
image
All above is my questions. I am confused. Looking forward to your responses! Thanks

@shizhediao
Copy link
Contributor

shizhediao commented May 22, 2023

Hi,
Both Robin and Vicuna perform comparably in our demo.
In Deploy Demo Locally, we currently open-source the linear weights for vicuna. If you want to use it, you can merge its delta weights and llama original weight.

Thank you!

@Liiiiiiiiiq
Copy link

Hi, Both Robin and Vicuna perform comparably in our demo. In Deploy Demo Locally, we currently open-source the linear weights for vicuna. If you want to use it, you can merge its delta weights and llama original weight.

Thank you!

Hi,I have merged its delta weights and llama original weight to get vicuna-13b, but the effect achieved when deploying locally is different from the effect shown on github. Why?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants