A Comparison of Crowd Types: Idea Selection Performance of Students and Amazon Mechanical Turks. Banken, V. In Ahlemann, F., Schütte, R., & Stieglitz, S., editors, Innovation Through Information Systems, of Lecture Notes in Information Systems and Organisation, pages 437–453, Cham, 2021. Springer International Publishing. doi abstract bibtex Crowdsourcing is an effective means to generate a multitude of ideas in a very short amount of time. Therefore, companies and researchers increasingly tap into the power of the crowd for the evaluation of these ideas. However, not all types of crowds are the equally capable for complex decision-making tasks, which might result in poor selection performance. This research aims to evaluate differences in anonymous crowds and student crowds regarding their information processing, attention and selection performance. A web-experiment with 339 participants was conducted to reveal that 1) undergraduate Information Systems students perform better in idea selection than crowd workers recruited from Amazon Mechanical Turk, 2) attention checks increase selection performance and 3) while crowd workers indicate to process information more systematically, students acquire more information for evaluation than crowd workers.
@inproceedings{banken_comparison_2021,
address = {Cham},
series = {Lecture {Notes} in {Information} {Systems} and {Organisation}},
title = {A {Comparison} of {Crowd} {Types}: {Idea} {Selection} {Performance} of {Students} and {Amazon} {Mechanical} {Turks}},
isbn = {978-3-030-86800-0},
shorttitle = {A {Comparison} of {Crowd} {Types}},
doi = {10.1007/978-3-030-86800-0_30},
abstract = {Crowdsourcing is an effective means to generate a multitude of ideas in a very short amount of time. Therefore, companies and researchers increasingly tap into the power of the crowd for the evaluation of these ideas. However, not all types of crowds are the equally capable for complex decision-making tasks, which might result in poor selection performance. This research aims to evaluate differences in anonymous crowds and student crowds regarding their information processing, attention and selection performance. A web-experiment with 339 participants was conducted to reveal that 1) undergraduate Information Systems students perform better in idea selection than crowd workers recruited from Amazon Mechanical Turk, 2) attention checks increase selection performance and 3) while crowd workers indicate to process information more systematically, students acquire more information for evaluation than crowd workers.},
language = {en},
booktitle = {Innovation {Through} {Information} {Systems}},
publisher = {Springer International Publishing},
author = {Banken, Victoria},
editor = {Ahlemann, Frederik and Schütte, Reinhard and Stieglitz, Stefan},
year = {2021},
keywords = {Amazon Mechanical Turk, Attention, Crowd types, Crowdsourcing, Open Innovation, Student sample},
pages = {437--453},
}
Downloads: 0
{"_id":"55dPWT9NKY6drxZce","bibbaseid":"banken-acomparisonofcrowdtypesideaselectionperformanceofstudentsandamazonmechanicalturks-2021","author_short":["Banken, V."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","address":"Cham","series":"Lecture Notes in Information Systems and Organisation","title":"A Comparison of Crowd Types: Idea Selection Performance of Students and Amazon Mechanical Turks","isbn":"978-3-030-86800-0","shorttitle":"A Comparison of Crowd Types","doi":"10.1007/978-3-030-86800-0_30","abstract":"Crowdsourcing is an effective means to generate a multitude of ideas in a very short amount of time. Therefore, companies and researchers increasingly tap into the power of the crowd for the evaluation of these ideas. However, not all types of crowds are the equally capable for complex decision-making tasks, which might result in poor selection performance. This research aims to evaluate differences in anonymous crowds and student crowds regarding their information processing, attention and selection performance. A web-experiment with 339 participants was conducted to reveal that 1) undergraduate Information Systems students perform better in idea selection than crowd workers recruited from Amazon Mechanical Turk, 2) attention checks increase selection performance and 3) while crowd workers indicate to process information more systematically, students acquire more information for evaluation than crowd workers.","language":"en","booktitle":"Innovation Through Information Systems","publisher":"Springer International Publishing","author":[{"propositions":[],"lastnames":["Banken"],"firstnames":["Victoria"],"suffixes":[]}],"editor":[{"propositions":[],"lastnames":["Ahlemann"],"firstnames":["Frederik"],"suffixes":[]},{"propositions":[],"lastnames":["Schütte"],"firstnames":["Reinhard"],"suffixes":[]},{"propositions":[],"lastnames":["Stieglitz"],"firstnames":["Stefan"],"suffixes":[]}],"year":"2021","keywords":"Amazon Mechanical Turk, Attention, Crowd types, Crowdsourcing, Open Innovation, Student sample","pages":"437–453","bibtex":"@inproceedings{banken_comparison_2021,\n\taddress = {Cham},\n\tseries = {Lecture {Notes} in {Information} {Systems} and {Organisation}},\n\ttitle = {A {Comparison} of {Crowd} {Types}: {Idea} {Selection} {Performance} of {Students} and {Amazon} {Mechanical} {Turks}},\n\tisbn = {978-3-030-86800-0},\n\tshorttitle = {A {Comparison} of {Crowd} {Types}},\n\tdoi = {10.1007/978-3-030-86800-0_30},\n\tabstract = {Crowdsourcing is an effective means to generate a multitude of ideas in a very short amount of time. Therefore, companies and researchers increasingly tap into the power of the crowd for the evaluation of these ideas. However, not all types of crowds are the equally capable for complex decision-making tasks, which might result in poor selection performance. This research aims to evaluate differences in anonymous crowds and student crowds regarding their information processing, attention and selection performance. A web-experiment with 339 participants was conducted to reveal that 1) undergraduate Information Systems students perform better in idea selection than crowd workers recruited from Amazon Mechanical Turk, 2) attention checks increase selection performance and 3) while crowd workers indicate to process information more systematically, students acquire more information for evaluation than crowd workers.},\n\tlanguage = {en},\n\tbooktitle = {Innovation {Through} {Information} {Systems}},\n\tpublisher = {Springer International Publishing},\n\tauthor = {Banken, Victoria},\n\teditor = {Ahlemann, Frederik and Schütte, Reinhard and Stieglitz, Stefan},\n\tyear = {2021},\n\tkeywords = {Amazon Mechanical Turk, Attention, Crowd types, Crowdsourcing, Open Innovation, Student sample},\n\tpages = {437--453},\n}\n\n","author_short":["Banken, V."],"editor_short":["Ahlemann, F.","Schütte, R.","Stieglitz, S."],"key":"banken_comparison_2021","id":"banken_comparison_2021","bibbaseid":"banken-acomparisonofcrowdtypesideaselectionperformanceofstudentsandamazonmechanicalturks-2021","role":"author","urls":{},"keyword":["Amazon Mechanical Turk","Attention","Crowd types","Crowdsourcing","Open Innovation","Student sample"],"metadata":{"authorlinks":{}}},"bibtype":"inproceedings","biburl":"https://api.zotero.org/groups/4504479/items?key=BfP7bN7FF9dJwtyiLBORewdg&format=bibtex&limit=100","dataSources":["bb9wnMe4gzczbyaCs"],"keywords":["amazon mechanical turk","attention","crowd types","crowdsourcing","open innovation","student sample"],"search_terms":["comparison","crowd","types","idea","selection","performance","students","amazon","mechanical","turks","banken"],"title":"A Comparison of Crowd Types: Idea Selection Performance of Students and Amazon Mechanical Turks","year":2021}