Jingwei is an open-source testbed for evaluating methods for image tag assignment, tag refinement and tag-based image retrieval. It is developed as part of our survey effort, aiming to provide a timely reflection of the state-of-the-art in the field.
- NLTK and nltk_data for SemanticField and RobustPCA.
- h5py and Numpy / Scipy for MATLAB<->Python data exchange of TagProp and RobustPCA.
- We recommend Anaconda (Python 2.7), a free Python distribution which include NLTK, h5py, numpy, scipy, etc.
- web.py for web demo
- A mini-version for hands-on experience
- Data dashboard, Florence data server
- Modify Paths in
start.sh(for linux/mac) andstart.batfor windows.
This file includes several environment variables that the methods depend on, to select proper input and output folders. From a shell, you can prepare the environment for using the framework with:
$ source start.sh
- Configuration and Dependencies.
Depending on the method to be run, several different dependencies must be met and some external packages must be downloaded.
The script setup.sh will report ready to run methods, depending on the available system packages.
For some methods, it will also try to download and compile the provided libraries.
$ bash setup.sh
- Scripts in doit provide step-by-step usages of each method.
- Tutorials in samples show how to leverage the framework for solving varied tasks.
| Method | Media | Learning | Code | Platform |
|---|---|---|---|---|
| SemanticField | tag | instance-based | python | linux, windows |
| TagCooccur | tag | instance based | Python | linux, windows |
| TagRanking | tag + image | instance based | Python | linux, windows |
| KNN | tag + image | instance based | C + Python | linux, windows |
| TagVote | tag + image | instance based | C + Python | linux, windows |
| TagCooccur+ | tag + image | instance based | C + Python | linux, windows |
| TagProp | tag + image | model based | C + Matlab + Python | linux |
| TagFeature | tag + image | model based | C + Python | linux, windows |
| RelExample | tag + image | model based | C + Python | linux, windows |
| RobustPCA | tag + image | transduction based | C + Matlab + Python | linux |
If you publish work that uses Jingwei, please consider cite our survey paper: Xirong Li, Tiberio Uricchio, Lamberto Ballan, Marco Bertini, Cees G. M. Snoek, Alberto Del Bimbo: Socializing the Semantic Gap: A Comparative Survey on Image Tag Assignment, Refinement and Retrieval, ACM Computing Surveys (CSUR), Volume 49, Issue 1, 14:1-14:39, June 2016
- Xirong Li, Renmin University of China (xirong@ruc.edu.cn)
- Tiberio Uricchio, University of Florence (tiberio.uricchio@unifi.it)