Any plan to open-source additional evaluation metrics mentioned in your paper?

[lishuyuan0825]

Hi, thanks for the great work.

I’m wondering whether there is any plan to open-source the implementations of other evaluation metrics mentioned in your paper, including:

Generation: Subject Fidelity, Cross-View Consistency

Action-Following

Downstream Tasks: Map Segmentation, 3D Object Tracking

Thanks!

[ldkong1205]

Hi @lishuyuan0825, thanks for your interest in this project!

Regarding your questions: All evaluation metrics will be open-sourced. Some of them rely on third-party packages/libraries that are not compatible with the current version of this codebase. We have been working on that and will update the entire codebase in our next release. Please stay tuned!

[AlanLiangC]

Many thanks to @ldkong1205. And the Map Segmentation metric will be calculated with Object Detection at the same running.