Evaluating prediction-based recommenders for kids
Michael Green, Oghenemaro Anuyah, Devan Karsann, MS Pera. 2019. “Evaluating prediction-based recommenders for kids”. In Proceedings of the 3rd International and Interdisciplinary Perspectives on Children & Recommender and Information Retrieval Systems (KidRec 2019), co-located with ACM IDC 2019.
Abstract
In this position paper, we highlight a number of issues that exist with the use of traditional metrics in evaluating recommender systems when children are the target audience. Our focus is on discrepancies that arise as a result of the differing rating behaviour of adult users when compared to children, and how these differences can warrant a reconsideration of existing assessment metrics and their validity in this context.