Mega: moving average equipped gated attention. Ma, X., Zhou, C., Kong, X., He, J., Gui, L., Neubig, G., May, J., & Zettlemoyer, L. In Proceedings of the 11th International Conference on Learning Representations (ICLR-2023), 2023.
bibtex   
@inproceedings{ma2023mega,
  title={Mega: moving average equipped gated attention},
  author={Ma, Xuezhe and Zhou, Chunting and Kong, Xiang and He, Junxian and Gui, Liangke and Neubig, Graham and May, Jonathan and Zettlemoyer, Luke},
  booktitle={Proceedings of the 11th International Conference on Learning Representations (ICLR-2023)},
  year={2023}
}

Downloads: 0