How many bits per rating?. Kluver, D., Nguyen, T. T, Ekstrand, M., Sen, S., & Riedl, J. In RecSys '12, pages 99–106, New York, NY, USA, 2012. ACM. Journal Abbreviation: RecSys '12
How many bits per rating? [link]Paper  doi  abstract   bibtex   
Most recommender systems assume user ratings accurately represent user preferences. However, prior research shows that user ratings are imperfect and noisy. Moreover, this noise limits the measurable predictive power of any recommender system. We propose an information theoretic framework for quantifying the preference information contained in ratings and predictions. We computationally explore the properties of our model and apply our framework to estimate the efficiency of different rating scales for real world datasets. We then estimate how the amount of information predictions give to users is related to the scale ratings are collected on. Our findings suggest a tradeoff in rating scale granularity: while previous research indicates that coarse scales (such as thumbs up / thumbs down) take less time, we find that ratings with these scales provide less predictive value to users. We introduce a new measure, preference bits per second, to quantitatively reconcile this tradeoff.
@inproceedings{kluver_how_2012,
	address = {New York, NY, USA},
	title = {How many bits per rating?},
	url = {http://doi.acm.org/10.1145/2365952.2365974},
	doi = {10.1145/2365952.2365974},
	abstract = {Most recommender systems assume user ratings accurately represent user
preferences. However, prior research shows that user ratings are imperfect
and noisy. Moreover, this noise limits the measurable predictive power of
any recommender system. We propose an information theoretic framework for
quantifying the preference information contained in ratings and
predictions. We computationally explore the properties of our model and
apply our framework to estimate the efficiency of different rating scales
for real world datasets. We then estimate how the amount of information
predictions give to users is related to the scale ratings are collected
on. Our findings suggest a tradeoff in rating scale granularity: while
previous research indicates that coarse scales (such as thumbs up / thumbs
down) take less time, we find that ratings with these scales provide less
predictive value to users. We introduce a new measure, preference bits per
second, to quantitatively reconcile this tradeoff.},
	urldate = {2013-09-12},
	booktitle = {{RecSys} '12},
	publisher = {ACM},
	author = {Kluver, Daniel and Nguyen, Tien T and Ekstrand, Michael and Sen, Shilad and Riedl, John},
	year = {2012},
	note = {Journal Abbreviation: RecSys '12},
	pages = {99--106},
}

Downloads: 0