Code of our paper "On the Complementarity between Pre-Training and Random-Initialization for Resource-Rich Machine Translation"
To install requirements, run conda env create -f PTvsRI.yaml
.
As we reuse hyper-parameters saved in fairseq_mode.pt, running in the same environment of model training is recommended.
see exps/README.md
-
Effects of Model Generalization
See analysis/OD/eval_ende_cross_domain.sh
-
Performance Drop under Attack
See analysis/DuA/robust_add_noisy.sh
-
Effects of Translation Diversity
See analysis/multi-refs/eval_ende_multi_reference.sh
-
Effects of TTR
See analysis/TTR/TTR.sh
If our method and code help you, please considering cite our work:
@inproceedings{zan2022PTvsRI,
title = {On the Complementarity between Pre-Training and Random-Initialization for Resource-Rich Machine Translation},
author = {Zan, Changtong and Ding, Liang and Shen, Li and Cao, Yu and Liu, Weifeng and Tao, Dacheng},
booktitle = {COLING},
year = {2022}
}