SLoPe: Double-Pruned Sparse Plus Lazy Low-Rank Adapter Pretraining of LLMs. Mozaffari, M., Yazdanbakhsh, A., Zhang, Z., & Dehnavi, M. M. In The Thirteenth International Conference on Learning Representations, ICLR 2025, Singapore, April 24-28, 2025, 2025. OpenReview.net.
SLoPe: Double-Pruned Sparse Plus Lazy Low-Rank Adapter Pretraining of LLMs [link]Paper  bibtex   1 download  
@inproceedings{DBLP:conf/iclr/MozaffariYZD25,
  author       = {Mohammad Mozaffari and
                  Amir Yazdanbakhsh and
                  Zhao Zhang and
                  Maryam Mehri Dehnavi},
  title        = {SLoPe: Double-Pruned Sparse Plus Lazy Low-Rank Adapter Pretraining
                  of LLMs},
  booktitle    = {The Thirteenth International Conference on Learning Representations,
                  {ICLR} 2025, Singapore, April 24-28, 2025},
  publisher    = {OpenReview.net},
  year         = {2025},
  url          = {https://openreview.net/forum?id=lqHv6dxBkj},
  timestamp    = {Thu, 15 May 2025 01:00:00 +0200},
  biburl       = {https://dblp.org/rec/conf/iclr/MozaffariYZD25.bib},
  bibsource    = {dblp computer science bibliography, https://dblp.org}
}

Downloads: 1