Expected ratio of relevant units: \A\ measure of structured information retrieval

Expected ratio of relevant units: \A\ measure of structured information retrieval. Piwowarski, B. & Gallinari, P. In Fuhr, N., Lalmas, M., & Malik, S., editors, Proceedings of INEX 2003, pages 158–166, 2004.
abstract bibtex

Since the 60's, evaluation has been a key problem for Information Retrieval (IR) systems and has been extensively discussed in the IR community. New IR paradigms, like Structured Information Retrieval (SIR), make classical evaluation measures inappropriate. A few tentative extensions to these measures have been proposed but are also inadequate. We propose in this paper a new measure which is a generalisation of recall. This measure takes into account the specicity of SIR, when elements to be retrieved are linked by structural relationships. We show an instantiation of this measure on the INEX database and present experiments to show how well it is adapted to SIR evaluation.

@inproceedings{Piwowarski/Gallinari:04,
	title = {Expected ratio of relevant units: \{{A}\} measure of structured information retrieval},
	abstract = {Since the 60's, evaluation has been a key problem for
Information Retrieval (IR) systems and has been
extensively discussed in the IR community. New IR
paradigms, like Structured Information Retrieval (SIR),
make classical evaluation measures inappropriate. A few
tentative extensions to these measures have been
proposed but are also inadequate. We propose in this
paper a new measure which is a generalisation of
recall. This measure takes into account the specicity
of SIR, when elements to be retrieved are linked by
structural relationships. We show an instantiation of
this measure on the INEX database and present
experiments to show how well it is adapted to SIR
evaluation.},
	booktitle = {Proceedings of {INEX} 2003},
	author = {Piwowarski, Benjamin and Gallinari, Patrick},
	editor = {Fuhr, Norbert and Lalmas, Mounia and Malik, Saadia},
	year = {2004},
	pages = {158--166},
}

Downloads: 0

{"_id":"GfKLWijK6P92sykmp","bibbaseid":"piwowarski-gallinari-expectedratioofrelevantunitsameasureofstructuredinformationretrieval-2004","author_short":["Piwowarski, B.","Gallinari, P."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","title":"Expected ratio of relevant units: \\A\\ measure of structured information retrieval","abstract":"Since the 60's, evaluation has been a key problem for Information Retrieval (IR) systems and has been extensively discussed in the IR community. New IR paradigms, like Structured Information Retrieval (SIR), make classical evaluation measures inappropriate. A few tentative extensions to these measures have been proposed but are also inadequate. We propose in this paper a new measure which is a generalisation of recall. This measure takes into account the specicity of SIR, when elements to be retrieved are linked by structural relationships. We show an instantiation of this measure on the INEX database and present experiments to show how well it is adapted to SIR evaluation.","booktitle":"Proceedings of INEX 2003","author":[{"propositions":[],"lastnames":["Piwowarski"],"firstnames":["Benjamin"],"suffixes":[]},{"propositions":[],"lastnames":["Gallinari"],"firstnames":["Patrick"],"suffixes":[]}],"editor":[{"propositions":[],"lastnames":["Fuhr"],"firstnames":["Norbert"],"suffixes":[]},{"propositions":[],"lastnames":["Lalmas"],"firstnames":["Mounia"],"suffixes":[]},{"propositions":[],"lastnames":["Malik"],"firstnames":["Saadia"],"suffixes":[]}],"year":"2004","pages":"158–166","bibtex":"@inproceedings{Piwowarski/Gallinari:04,\n\ttitle = {Expected ratio of relevant units: \\{{A}\\} measure of structured information retrieval},\n\tabstract = {Since the 60's, evaluation has been a key problem for\nInformation Retrieval (IR) systems and has been\nextensively discussed in the IR community. New IR\nparadigms, like Structured Information Retrieval (SIR),\nmake classical evaluation measures inappropriate. A few\ntentative extensions to these measures have been\nproposed but are also inadequate. We propose in this\npaper a new measure which is a generalisation of\nrecall. This measure takes into account the specicity\nof SIR, when elements to be retrieved are linked by\nstructural relationships. We show an instantiation of\nthis measure on the INEX database and present\nexperiments to show how well it is adapted to SIR\nevaluation.},\n\tbooktitle = {Proceedings of {INEX} 2003},\n\tauthor = {Piwowarski, Benjamin and Gallinari, Patrick},\n\teditor = {Fuhr, Norbert and Lalmas, Mounia and Malik, Saadia},\n\tyear = {2004},\n\tpages = {158--166},\n}\n\n","author_short":["Piwowarski, B.","Gallinari, P."],"editor_short":["Fuhr, N.","Lalmas, M.","Malik, S."],"key":"Piwowarski/Gallinari:04","id":"Piwowarski/Gallinari:04","bibbaseid":"piwowarski-gallinari-expectedratioofrelevantunitsameasureofstructuredinformationretrieval-2004","role":"author","urls":{},"metadata":{"authorlinks":{}},"html":""},"bibtype":"inproceedings","biburl":"https://bibbase.org/zotero/ifromm","dataSources":["N4kJAiLiJ7kxfNsoh"],"keywords":[],"search_terms":["expected","ratio","relevant","units","measure","structured","information","retrieval","piwowarski","gallinari"],"title":"Expected ratio of relevant units: \\A\\ measure of structured information retrieval","year":2004}