A surprisingly simple technique to control the pretraining bias for better transfer: Expand or Narrow your representation. Bordes, F., Lavoie, S., Balestriero, R., Ballas, N., & Vincent, P. arXiv preprint arXiv:2304.05369, 2023.
bibtex   
@article{bordes2023surprisingly,
  title={A surprisingly simple technique to control the pretraining bias for better transfer: Expand or Narrow your representation},
  author={Bordes, Florian and Lavoie, Samuel and Balestriero, Randall and Ballas, Nicolas and Vincent, Pascal},
  journal={arXiv preprint arXiv:2304.05369},
  year={2023}
}

Downloads: 0