What Makes A Good Reference Manager? A Quantitative Analysis of Bibliography Management Applications. Cai, T., Chen, C., Huang, T., & Ritter, F. E In Asian CHI Symposium 2021, pages 64–69, New York, 2021. Association for Computing Machinery. ![What Makes A Good Reference Manager? A Quantitative Analysis of Bibliography Management Applications [link]](https://bibbase.org/img/filetypes/link.svg "link")
Paper doi abstract bibtex Many researchers and students use reference managers to collect, manage, and format references and citations. While prior work has assessed these tools qualitatively, it is still unclear how to quantitatively evaluate reference managers. This paper starts to quantify the user effort required to use reference managers. We first collected surveys from 69 graduate students to understand their experience with reference managers, and then conducted user studies with 12 participants. In our study, each participant was asked to perform a standardized task using four popular reference managers: Mendeley, Zotero, EndNote, and RefWorks. We used RUI, a keystroke and mouse-move logger, to record the participants’ activities and approximate their physical and mental effort. We also used pre- and post-study surveys to collect users’ feedback and self-reported task load (as expressed by the NASA TLX Index.) The results showed that different reference managers require different levels of effort, and users generally prefer the tools that involve less effort. We also found that although reference managers share similar features, differences in presentation and organization matter. We conclude this work by providing a set of guidelines for both users and developers of reference managers.
@inproceedings{cai_what_2021,
address = {New York},
title = {What {Makes} {A} {Good} {Reference} {Manager}? {A} {Quantitative} {Analysis} of {Bibliography} {Management} {Applications}},
isbn = {978-1-4503-8203-8},
shorttitle = {What {Makes} {A} {Good} {Reference} {Manager}?},
url = {https://doi.org/10.1145/3429360.3468183},
doi = {10.1145/3429360.3468183},
abstract = {Many researchers and students use reference managers to collect, manage, and format references and citations. While prior work has assessed these tools qualitatively, it is still unclear how to quantitatively evaluate reference managers. This paper starts to quantify the user effort required to use reference managers. We first collected surveys from 69 graduate students to understand their experience with reference managers, and then conducted user studies with 12 participants. In our study, each participant was asked to perform a standardized task using four popular reference managers: Mendeley, Zotero, EndNote, and RefWorks. We used RUI, a keystroke and mouse-move logger, to record the participants’ activities and approximate their physical and mental effort. We also used pre- and post-study surveys to collect users’ feedback and self-reported task load (as expressed by the NASA TLX Index.) The results showed that different reference managers require different levels of effort, and users generally prefer the tools that involve less effort. We also found that although reference managers share similar features, differences in presentation and organization matter. We conclude this work by providing a set of guidelines for both users and developers of reference managers.},
urldate = {2021-11-22},
booktitle = {Asian {CHI} {Symposium} 2021},
publisher = {Association for Computing Machinery},
author = {Cai, Tongan and Chen, Chacha and Huang, Ting-Hao and Ritter, Frank E},
year = {2021},
keywords = {zfrancophone\_bulletin\_veille},
pages = {64--69},
}
Downloads: 0
{"_id":"sAh8ToTEsKPxvHayt","bibbaseid":"cai-chen-huang-ritter-whatmakesagoodreferencemanageraquantitativeanalysisofbibliographymanagementapplications-2021","author_short":["Cai, T.","Chen, C.","Huang, T.","Ritter, F. E"],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","address":"New York","title":"What Makes A Good Reference Manager? A Quantitative Analysis of Bibliography Management Applications","isbn":"978-1-4503-8203-8","shorttitle":"What Makes A Good Reference Manager?","url":"https://doi.org/10.1145/3429360.3468183","doi":"10.1145/3429360.3468183","abstract":"Many researchers and students use reference managers to collect, manage, and format references and citations. While prior work has assessed these tools qualitatively, it is still unclear how to quantitatively evaluate reference managers. This paper starts to quantify the user effort required to use reference managers. We first collected surveys from 69 graduate students to understand their experience with reference managers, and then conducted user studies with 12 participants. In our study, each participant was asked to perform a standardized task using four popular reference managers: Mendeley, Zotero, EndNote, and RefWorks. We used RUI, a keystroke and mouse-move logger, to record the participants’ activities and approximate their physical and mental effort. We also used pre- and post-study surveys to collect users’ feedback and self-reported task load (as expressed by the NASA TLX Index.) The results showed that different reference managers require different levels of effort, and users generally prefer the tools that involve less effort. We also found that although reference managers share similar features, differences in presentation and organization matter. We conclude this work by providing a set of guidelines for both users and developers of reference managers.","urldate":"2021-11-22","booktitle":"Asian CHI Symposium 2021","publisher":"Association for Computing Machinery","author":[{"propositions":[],"lastnames":["Cai"],"firstnames":["Tongan"],"suffixes":[]},{"propositions":[],"lastnames":["Chen"],"firstnames":["Chacha"],"suffixes":[]},{"propositions":[],"lastnames":["Huang"],"firstnames":["Ting-Hao"],"suffixes":[]},{"propositions":[],"lastnames":["Ritter"],"firstnames":["Frank","E"],"suffixes":[]}],"year":"2021","keywords":"zfrancophone_bulletin_veille","pages":"64–69","bibtex":"@inproceedings{cai_what_2021,\n\taddress = {New York},\n\ttitle = {What {Makes} {A} {Good} {Reference} {Manager}? {A} {Quantitative} {Analysis} of {Bibliography} {Management} {Applications}},\n\tisbn = {978-1-4503-8203-8},\n\tshorttitle = {What {Makes} {A} {Good} {Reference} {Manager}?},\n\turl = {https://doi.org/10.1145/3429360.3468183},\n\tdoi = {10.1145/3429360.3468183},\n\tabstract = {Many researchers and students use reference managers to collect, manage, and format references and citations. While prior work has assessed these tools qualitatively, it is still unclear how to quantitatively evaluate reference managers. This paper starts to quantify the user effort required to use reference managers. We first collected surveys from 69 graduate students to understand their experience with reference managers, and then conducted user studies with 12 participants. In our study, each participant was asked to perform a standardized task using four popular reference managers: Mendeley, Zotero, EndNote, and RefWorks. We used RUI, a keystroke and mouse-move logger, to record the participants’ activities and approximate their physical and mental effort. We also used pre- and post-study surveys to collect users’ feedback and self-reported task load (as expressed by the NASA TLX Index.) The results showed that different reference managers require different levels of effort, and users generally prefer the tools that involve less effort. We also found that although reference managers share similar features, differences in presentation and organization matter. We conclude this work by providing a set of guidelines for both users and developers of reference managers.},\n\turldate = {2021-11-22},\n\tbooktitle = {Asian {CHI} {Symposium} 2021},\n\tpublisher = {Association for Computing Machinery},\n\tauthor = {Cai, Tongan and Chen, Chacha and Huang, Ting-Hao and Ritter, Frank E},\n\tyear = {2021},\n\tkeywords = {zfrancophone\\_bulletin\\_veille},\n\tpages = {64--69},\n}\n\n","author_short":["Cai, T.","Chen, C.","Huang, T.","Ritter, F. E"],"key":"cai_what_2021","id":"cai_what_2021","bibbaseid":"cai-chen-huang-ritter-whatmakesagoodreferencemanageraquantitativeanalysisofbibliographymanagementapplications-2021","role":"author","urls":{"Paper":"https://doi.org/10.1145/3429360.3468183"},"keyword":["zfrancophone_bulletin_veille"],"metadata":{"authorlinks":{}}},"bibtype":"inproceedings","biburl":"https://api.zotero.org/groups/2233096/items?key=rCy7E0GkmFhOXB78i3c8F8Sm&format=bibtex&limit=100","dataSources":["zXnPFaELWSWS53n4g","8c7NYrs3Y8yYFR3Qe","Ncv7RbP24oZovD5Kd","dShEdNT7Rd3kFsqCx","TqKJ5heFHX8pgcwNw","jSXGeuDYGqdcJXw2s","hDfoTWMe7fEMeRgR9","gzvkFF8Fdk8WgRqTN","YEi53BkYnb4vkdLAs","42jnKAx3sqBfGfNmR","vYDaNJEy6S3RgHpEY","u6z4DZizKLAjy46G3","7YGNF4MLRQi3TLvha","rwtYpNamjqPujaPj2"],"keywords":["zfrancophone_bulletin_veille"],"search_terms":["makes","good","reference","manager","quantitative","analysis","bibliography","management","applications","cai","chen","huang","ritter"],"title":"What Makes A Good Reference Manager? A Quantitative Analysis of Bibliography Management Applications","year":2021}