Fairness and Popularity Bias in Recommender Systems: an Empirical Evaluation. Musto, C., Lops, P., & Semeraro, G. In AIxIA 2021 Discussion Papers, 20th International Conference Italian Association for Artificial Intelligence, 2021.
Paper abstract bibtex In this paper, we present the results of an empirical evaluation investigating how recommendation algorithms are affected by popularity bias. Popularity bias makes more popular items to be recommended more frequently than less popular ones, thus it is one of the most relevant issues that limits the fairness of recommender systems. In particular, we define an experimental protocol based on two state-of-theart datasets containing users’ preferences on movies and books and three different recommendation paradigms, i.e., collaborative filtering, content-based filtering and graph-based algorithms. In order to evaluate the overall fairness of the recommendations we use well-known metrics such as Catalogue Coverage, Gini Index and Group Average Popularity (ΔGAP). The goal of this paper is: (i) to provide a clear picture of how recommendation techniques are affected by popularity bias; (ii) to trigger further research in the area aimed to introduce methods to mitigate or reduce biases in order to provide fairer recommendations.
@inproceedings{musto_fairness_2021,
title = {Fairness and {Popularity} {Bias} in {Recommender} {Systems}: an {Empirical} {Evaluation}},
url = {https://ceur-ws.org/Vol-3078/paper-69.pdf},
abstract = {In this paper, we present the results of an empirical evaluation investigating how recommendation algorithms are affected by popularity bias. Popularity bias makes more popular items to be recommended more frequently than less popular ones, thus it is one of the most relevant issues that limits the fairness of recommender systems. In particular, we define an experimental protocol based on two state-of-theart datasets containing users’ preferences on movies and books and three different recommendation paradigms, i.e., collaborative filtering, content-based filtering and graph-based algorithms. In order to evaluate the overall fairness of the recommendations we use well-known metrics such as Catalogue Coverage, Gini Index and Group Average Popularity (ΔGAP). The goal of this paper is: (i) to provide a clear picture of how recommendation techniques are affected by popularity bias; (ii) to trigger further research in the area aimed to introduce methods to mitigate or reduce biases in order to provide fairer recommendations.},
language = {en},
booktitle = {{AIxIA} 2021 {Discussion} {Papers}, 20th {International} {Conference} {Italian} {Association} for {Artificial} {Intelligence}},
author = {Musto, Cataldo and Lops, Pasquale and Semeraro, Giovanni},
year = {2021},
keywords = {⛔ No DOI found},
}
Downloads: 0
{"_id":"m6hNiCr8xQpuayje6","bibbaseid":"musto-lops-semeraro-fairnessandpopularitybiasinrecommendersystemsanempiricalevaluation-2021","author_short":["Musto, C.","Lops, P.","Semeraro, G."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","title":"Fairness and Popularity Bias in Recommender Systems: an Empirical Evaluation","url":"https://ceur-ws.org/Vol-3078/paper-69.pdf","abstract":"In this paper, we present the results of an empirical evaluation investigating how recommendation algorithms are affected by popularity bias. Popularity bias makes more popular items to be recommended more frequently than less popular ones, thus it is one of the most relevant issues that limits the fairness of recommender systems. In particular, we define an experimental protocol based on two state-of-theart datasets containing users’ preferences on movies and books and three different recommendation paradigms, i.e., collaborative filtering, content-based filtering and graph-based algorithms. In order to evaluate the overall fairness of the recommendations we use well-known metrics such as Catalogue Coverage, Gini Index and Group Average Popularity (ΔGAP). The goal of this paper is: (i) to provide a clear picture of how recommendation techniques are affected by popularity bias; (ii) to trigger further research in the area aimed to introduce methods to mitigate or reduce biases in order to provide fairer recommendations.","language":"en","booktitle":"AIxIA 2021 Discussion Papers, 20th International Conference Italian Association for Artificial Intelligence","author":[{"propositions":[],"lastnames":["Musto"],"firstnames":["Cataldo"],"suffixes":[]},{"propositions":[],"lastnames":["Lops"],"firstnames":["Pasquale"],"suffixes":[]},{"propositions":[],"lastnames":["Semeraro"],"firstnames":["Giovanni"],"suffixes":[]}],"year":"2021","keywords":"⛔ No DOI found","bibtex":"@inproceedings{musto_fairness_2021,\n\ttitle = {Fairness and {Popularity} {Bias} in {Recommender} {Systems}: an {Empirical} {Evaluation}},\n\turl = {https://ceur-ws.org/Vol-3078/paper-69.pdf},\n\tabstract = {In this paper, we present the results of an empirical evaluation investigating how recommendation algorithms are affected by popularity bias. Popularity bias makes more popular items to be recommended more frequently than less popular ones, thus it is one of the most relevant issues that limits the fairness of recommender systems. In particular, we define an experimental protocol based on two state-of-theart datasets containing users’ preferences on movies and books and three different recommendation paradigms, i.e., collaborative filtering, content-based filtering and graph-based algorithms. In order to evaluate the overall fairness of the recommendations we use well-known metrics such as Catalogue Coverage, Gini Index and Group Average Popularity (ΔGAP). The goal of this paper is: (i) to provide a clear picture of how recommendation techniques are affected by popularity bias; (ii) to trigger further research in the area aimed to introduce methods to mitigate or reduce biases in order to provide fairer recommendations.},\n\tlanguage = {en},\n\tbooktitle = {{AIxIA} 2021 {Discussion} {Papers}, 20th {International} {Conference} {Italian} {Association} for {Artificial} {Intelligence}},\n\tauthor = {Musto, Cataldo and Lops, Pasquale and Semeraro, Giovanni},\n\tyear = {2021},\n\tkeywords = {⛔ No DOI found},\n}\n\n","author_short":["Musto, C.","Lops, P.","Semeraro, G."],"key":"musto_fairness_2021","id":"musto_fairness_2021","bibbaseid":"musto-lops-semeraro-fairnessandpopularitybiasinrecommendersystemsanempiricalevaluation-2021","role":"author","urls":{"Paper":"https://ceur-ws.org/Vol-3078/paper-69.pdf"},"keyword":["⛔ No DOI found"],"metadata":{"authorlinks":{}}},"bibtype":"inproceedings","biburl":"https://api.zotero.org/users/6655/collections/3TB3KT36/items?key=VFvZhZXIoHNBbzoLZ1IM2zgf&format=bibtex&limit=100","dataSources":["7KNAjxiv2tsagmbgY"],"keywords":["⛔ no doi found"],"search_terms":["fairness","popularity","bias","recommender","systems","empirical","evaluation","musto","lops","semeraro"],"title":"Fairness and Popularity Bias in Recommender Systems: an Empirical Evaluation","year":2021}