How to calculate the spice scores in other languages

[ltp1995]

The code seems only support spice evaluation in English, how can i obtain the spice scores in languages such as Chinese, Japanese, and Spanish.

[jontooy]

Hi,

I'm having the same question. I want to do SPICE evaluation on Arabic Captions specifically. In the 'spice-1.0.jar' file there is a README file that says:

Dependencies

• Stanford CoreNLP 3.6.0
• Stanford Scene Graph Parser
• Meteor 1.5 (for synset matching)

Since the the version of Stanford CoreNLP is not compatible with Arabic, I wonder if I can:

1. Replace Stanford Scene Graph Parser with the latest version, updated to work with CoreNLP 4.2.0
2. Replace CoreNLP 3.6.0 with 4.2.0 with Arabic models

I actually tried to download and replace these files in the COCO-caption API, but with no improved SPICE scores...

Do you think this task is possible or no?

[mary-0830]

Is there any other library for evaluating captions in other languages? @jontooy @ltp1995