A question about CMU-MOSI

[Bumblebee-666]

Hello!In your paper, you mentioned the CMU-MOSI dataset. However, there seems to be no code for loading and processing CMU-MOSI in main.py. Instead, the AVE dataset is used in Line 28 of main.py, which does not appear to be mentioned in your paper. Could you please clarify this confusion for me? Thank you very much!

[celestial1122]

Hi, sorry for the confusion.

Since this codebase is modified from OGM (https://github.com/GeWu-Lab/OGM-GE_CVPR2022), we followed their setup. We didn't specifically test AVE in InfoReg.

Regarding the CMU-MOSI dataset, we processed and stored the data in our previous work, so I directly utilized those pre-extracted features here. I will organize the data processing code and upload it shortly.

[Bumblebee-666]

Hi, sorry for the confusion.你好，抱歉造成了混淆。

Since this codebase is modified from OGM (https://github.com/GeWu-Lab/OGM-GE_CVPR2022), we followed their setup. We didn't specifically test AVE in InfoReg.由于该代码库是从 OGM（https://github.com/GeWu-Lab/OGM-GE_CVPR2022）修改而来的，我们遵循了他们的设置。我们并没有专门在 InfoReg 中测试 AVE。

Regarding the CMU-MOSI dataset, we processed and stored the data in our previous work, so I directly utilized those pre-extracted features here. I will organize the data processing code and upload it shortly.关于 CMU-MOSI 数据集，我们在之前的工作中处理并存储了这些数据，所以我在这里直接利用了这些预先提取的特征。我会整理数据处理代码并很快上传。

Thank you very much for your reply!Best wishes!

[touwenzil157-maker]

Hi, sorry for the confusion.

Since this codebase is modified from OGM (https://github.com/GeWu-Lab/OGM-GE_CVPR2022), we followed their setup. We didn't specifically test AVE in InfoReg.

Regarding the CMU-MOSI dataset, we processed and stored the data in our previous work, so I directly utilized those pre-extracted features here. I will organize the data processing code and upload it shortly.

I was also wondering if you have an estimated time for releasing the code. I’m really looking forward to trying it out

[celestial1122]

Hi, sorry for the confusion.
Since this codebase is modified from OGM (https://github.com/GeWu-Lab/OGM-GE_CVPR2022), we followed their setup. We didn't specifically test AVE in InfoReg.
Regarding the CMU-MOSI dataset, we processed and stored the data in our previous work, so I directly utilized those pre-extracted features here. I will organize the data processing code and upload it shortly.

I was also wondering if you have an estimated time for releasing the code. I’m really looking forward to trying it out

Hi, I will make sure the code of CMU-MOSI to be updated within this week. Once updating, I will remind you. Before this, you can try out CREMA-D and KS.
I also uploaded the KS dataset we have processed in our experiments here: https://modelscope.cn/models/hcx1122/KS_AudioVisual_Dataset/summary
If you have any further questions, please feel free to contact me.