Codes and scripts for ACL2024 Findings paper "Integrating Multi-scale Contextualized Information for Byte-based Neural Machine Translation".
- add the file
multiscale_transformer.pyto fairseq/models - add the file
multiscale_attention.pyto fairseq/modules - add the file
transformer_multiscale_layer.pyto fairseq/modules - change fairseq/modules/init.py to import the added packages
Add pathes to the scripts in the scripts folder, and run them.