Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Comparison with Transfusion #12

Open
NickGao96 opened this issue Aug 27, 2024 · 1 comment
Open

Comparison with Transfusion #12

NickGao96 opened this issue Aug 27, 2024 · 1 comment

Comments

@NickGao96
Copy link

Transfusion seems to be also about AR + Diffusion Multi Modality Model (https://huggingface.co/papers/2408.11039). Are you using similar techniques? Is there any major difference?

@Sierkinhane
Copy link
Collaborator

Sierkinhane commented Aug 28, 2024

Hi, sorry for the late reply. You can find two distinct differences i) representations for multimodal understanding, clip-vit and magvitv2 (ours) vs vae (transfusion); ii) representations for generation, magvitv2 (ours) vs vae (transfusion). More details can be found in our paper. Btw, welcome to star our repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants