The loss of the tracking decoder

[xuqingyu26]

Hello, thanks for your excellent work, and i would like to know the reason why the loss of tracking decoder is hard to decrease when applied on my custom small object dataset ?

[yihongXU]

Hi,

You need first check that your gt displacements are correct and might need to add data augmentation to them. Knowing that pedestrian's motion is almost constant, we designed the tracking branch to be as simple as several fc layers. For complicated motion prediction, you might need to redesign the tracking branch to have a better performance/add motion compensation.

Best,

[xuqingyu26]

Thank you for your constructive feedback.