Compatability Issue

[aobuys]

In one of the issues, you mentioned that this software was created using NVIDIA H100 and RTX A6000 graphics cards. I assume this is why it is not compatible with consumer GPUs such as the RTX 40 and RTX 50 series.

Is there anything you can do about this, or is there something I can do on my end? After installing it, the software simply refused to work—the animated image for online inference was static. I attempted to use xFormers since python torch2trt.py failed to convert properly due to limited VRAM.

[huai-chang]

Hi, we have actually tested it on an RTX 4090D, and TensorRT works normally.

For the RTX 50 series, acceleration is currently unavailable because some underlying libraries have not yet been adapted for the new architecture.

Additionally, please note that we have not tested this on Windows. If you are running on Windows, I unfortunately cannot provide specific advice.