The issue of video memory usage

[Yisikaliou]

Thank you for your excellent work. We would like to know approximately how much video memory is needed for inference. Our single A100 20G card seems unable to handle it

[LiuhanChen-github]

thanks, on A100 we need 49G. However, you can use the enable_varm to reduce the memory to <10G.