A Systematic Literature Review on the Usage of Eye-tracking in Software Engineering. Sharafi, Z., Soh, Z., & Guéhéneuc, Y. Journal of Information and Software Technology (IST), 67:79–107, Elsevier, November, 2015. 28 pages.Paper abstract bibtex Context. Eye-tracking is a mean to collect evidence regarding some participants' cognitive processes. Eye-trackers monitor participants' visual attention by collecting eye-movement data. These data are useful to get insights into participants' cognitive processes during reasoning tasks. Objective. The Evidence-based Software Engineering (EBSE) paradigm has been proposed in 2004 and, since then, has been used to provide detailed insights regarding different topics in software engineering research and practice. Systematic Literature Reviews (SLR) are also useful in the context of EBSE by bringing together all existing evidence of research and results about a particular topic. This SLR evaluates the current state of the art of using eye-trackers in software engineering and provides evidence on the uses and contributions of eye-trackers to empirical studies in software engineering. Method. We perform a SLR covering eye-tracking studies in software engineering published from 1990 up to the end of 2014. To search all recognised resources, instead of applying manual search, we perform an extensive automated search using Engineering Village. We identify 36 relevant publications, including nine journal papers, two workshop papers, and 25 conference papers. Results. The software engineering community started using eye-trackers in the 1990s and they have become increasingly recognised as useful tools to conduct empirical studies from 2006. We observe that researchers use eye-trackers to study model comprehension, code comprehension, debugging, collaborative interaction, and traceability. Moreover, we find that studies use different metrics based on eye-movement data to obtain quantitative measures. We also report the limitations of current eye-tracking technology, which threaten the validity of previous studies, along with suggestions to mitigate these limitations. Conclusion. However, not withstanding these limitations and threats, we conclude that the advent of new eye-trackers makes the use of these tools easier and less obtrusive and that the software engineering community could benefit more from this technology.
@ARTICLE{Sharafi15-IST-SLREyeTracking,
author = {Zohreh Sharafi and Z{\'e}phyrin Soh and Yann-Ga{\"e}l Gu{\'e}h{\'e}neuc},
title = {A Systematic Literature Review on the Usage of Eye-tracking in Software Engineering},
journal = {Journal of Information and Software Technology ({IST})},
year = {2015},
month = {November},
volume = {67},
pages = {79--107},
note = {28 pages.},
abstract = {
\textit{Context.} Eye-tracking is a mean to collect evidence regarding some participants' cognitive
processes. Eye-trackers monitor participants' visual attention by collecting eye-movement data. These
data are useful to get insights into participants' cognitive processes during reasoning tasks.
\textit{Objective.} The Evidence-based Software Engineering (EBSE) paradigm has been proposed in 2004
and, since then, has been used to provide detailed insights regarding different topics in software
engineering research and practice. Systematic Literature Reviews (SLR) are also useful in the context of
EBSE by bringing together all existing evidence of research and results about a particular topic. This
SLR evaluates the current state of the art of using eye-trackers in software engineering and provides
evidence on the uses and contributions of eye-trackers to empirical studies in software engineering.
\textit{Method.} We perform a SLR covering eye-tracking studies in software engineering published from
1990 up to the end of 2014. To search all recognised resources, instead of applying manual search, we
perform an extensive automated search using Engineering Village. We identify 36 relevant publications,
including nine journal papers, two workshop papers, and 25 conference papers.
\textit{Results.} The software engineering community started using eye-trackers in the 1990s and they
have become increasingly recognised as useful tools to conduct empirical studies from 2006. We observe
that researchers use eye-trackers to study model comprehension, code comprehension, debugging,
collaborative interaction, and traceability. Moreover, we find that studies use different metrics based
on eye-movement data to obtain quantitative measures. We also report the limitations of current
eye-tracking technology, which threaten the validity of previous studies, along with suggestions to
mitigate these limitations.
\textit{Conclusion.} However, not withstanding these limitations and threats, we conclude that the advent
of new eye-trackers makes the use of these tools easier and less obtrusive and that the software
engineering community could benefit more from this technology.},
editor = {Guenther Ruhe and Guilherme Horta Travassos and Laurie Williams},
grant = {NSERC DG and CRC on Software Patterns},
keywords = {Understanding program comprehension ; IST},
kind = {RIAS},
language = {english},
publisher = {Elsevier},
url = {http://www.ptidej.net/publications/documents/IST15.doc.pdf}
}
Downloads: 0
{"_id":"LQb6Qa9TLiE98BSRC","bibbaseid":"sharafi-soh-guhneuc-asystematicliteraturereviewontheusageofeyetrackinginsoftwareengineering-2015","downloads":0,"creationDate":"2018-01-17T20:29:42.216Z","title":"A Systematic Literature Review on the Usage of Eye-tracking in Software Engineering","author_short":["Sharafi, Z.","Soh, Z.","Guéhéneuc, Y."],"year":2015,"bibtype":"article","biburl":"http://www.yann-gael.gueheneuc.net/Work/BibBase/guehene (automatically cleaned).bib","bibdata":{"bibtype":"article","type":"article","author":[{"firstnames":["Zohreh"],"propositions":[],"lastnames":["Sharafi"],"suffixes":[]},{"firstnames":["Zéphyrin"],"propositions":[],"lastnames":["Soh"],"suffixes":[]},{"firstnames":["Yann-Gaël"],"propositions":[],"lastnames":["Guéhéneuc"],"suffixes":[]}],"title":"A Systematic Literature Review on the Usage of Eye-tracking in Software Engineering","journal":"Journal of Information and Software Technology (IST)","year":"2015","month":"November","volume":"67","pages":"79–107","note":"28 pages.","abstract":"<i>Context.</i> Eye-tracking is a mean to collect evidence regarding some participants' cognitive processes. Eye-trackers monitor participants' visual attention by collecting eye-movement data. These data are useful to get insights into participants' cognitive processes during reasoning tasks. <i>Objective.</i> The Evidence-based Software Engineering (EBSE) paradigm has been proposed in 2004 and, since then, has been used to provide detailed insights regarding different topics in software engineering research and practice. Systematic Literature Reviews (SLR) are also useful in the context of EBSE by bringing together all existing evidence of research and results about a particular topic. This SLR evaluates the current state of the art of using eye-trackers in software engineering and provides evidence on the uses and contributions of eye-trackers to empirical studies in software engineering. <i>Method.</i> We perform a SLR covering eye-tracking studies in software engineering published from 1990 up to the end of 2014. To search all recognised resources, instead of applying manual search, we perform an extensive automated search using Engineering Village. We identify 36 relevant publications, including nine journal papers, two workshop papers, and 25 conference papers. <i>Results.</i> The software engineering community started using eye-trackers in the 1990s and they have become increasingly recognised as useful tools to conduct empirical studies from 2006. We observe that researchers use eye-trackers to study model comprehension, code comprehension, debugging, collaborative interaction, and traceability. Moreover, we find that studies use different metrics based on eye-movement data to obtain quantitative measures. We also report the limitations of current eye-tracking technology, which threaten the validity of previous studies, along with suggestions to mitigate these limitations. <i>Conclusion.</i> However, not withstanding these limitations and threats, we conclude that the advent of new eye-trackers makes the use of these tools easier and less obtrusive and that the software engineering community could benefit more from this technology.","editor":[{"firstnames":["Guenther"],"propositions":[],"lastnames":["Ruhe"],"suffixes":[]},{"firstnames":["Guilherme","Horta"],"propositions":[],"lastnames":["Travassos"],"suffixes":[]},{"firstnames":["Laurie"],"propositions":[],"lastnames":["Williams"],"suffixes":[]}],"grant":"NSERC DG and CRC on Software Patterns","keywords":"Understanding program comprehension ; IST","kind":"RIAS","language":"english","publisher":"Elsevier","url":"http://www.ptidej.net/publications/documents/IST15.doc.pdf","bibtex":"@ARTICLE{Sharafi15-IST-SLREyeTracking,\n author = {Zohreh Sharafi and Z{\\'e}phyrin Soh and Yann-Ga{\\\"e}l Gu{\\'e}h{\\'e}neuc},\n title = {A Systematic Literature Review on the Usage of Eye-tracking in Software Engineering},\n journal = {Journal of Information and Software Technology ({IST})},\n year = {2015},\n month = {November},\n volume = {67},\n pages = {79--107},\n note = {28 pages.},\n abstract = {\n\\textit{Context.} Eye-tracking is a mean to collect evidence regarding some participants' cognitive\nprocesses. Eye-trackers monitor participants' visual attention by collecting eye-movement data. These\ndata are useful to get insights into participants' cognitive processes during reasoning tasks.\n\n\\textit{Objective.} The Evidence-based Software Engineering (EBSE) paradigm has been proposed in 2004\nand, since then, has been used to provide detailed insights regarding different topics in software\nengineering research and practice. Systematic Literature Reviews (SLR) are also useful in the context of\nEBSE by bringing together all existing evidence of research and results about a particular topic. This\nSLR evaluates the current state of the art of using eye-trackers in software engineering and provides\nevidence on the uses and contributions of eye-trackers to empirical studies in software engineering.\n\n\\textit{Method.} We perform a SLR covering eye-tracking studies in software engineering published from\n1990 up to the end of 2014. To search all recognised resources, instead of applying manual search, we\nperform an extensive automated search using Engineering Village. We identify 36 relevant publications,\nincluding nine journal papers, two workshop papers, and 25 conference papers.\n\n\\textit{Results.} The software engineering community started using eye-trackers in the 1990s and they\nhave become increasingly recognised as useful tools to conduct empirical studies from 2006. We observe\nthat researchers use eye-trackers to study model comprehension, code comprehension, debugging,\ncollaborative interaction, and traceability. Moreover, we find that studies use different metrics based\non eye-movement data to obtain quantitative measures. We also report the limitations of current\neye-tracking technology, which threaten the validity of previous studies, along with suggestions to\nmitigate these limitations.\n\n\\textit{Conclusion.} However, not withstanding these limitations and threats, we conclude that the advent\nof new eye-trackers makes the use of these tools easier and less obtrusive and that the software\nengineering community could benefit more from this technology.},\n editor = {Guenther Ruhe and Guilherme Horta Travassos and Laurie Williams},\n grant = {NSERC DG and CRC on Software Patterns},\n keywords = {Understanding program comprehension ; IST},\n kind = {RIAS},\n language = {english},\n publisher = {Elsevier},\n url = {http://www.ptidej.net/publications/documents/IST15.doc.pdf}\n}\n\n","author_short":["Sharafi, Z.","Soh, Z.","Guéhéneuc, Y."],"editor_short":["Ruhe, G.","Travassos, G. H.","Williams, L."],"key":"Sharafi15-IST-SLREyeTracking","id":"Sharafi15-IST-SLREyeTracking","bibbaseid":"sharafi-soh-guhneuc-asystematicliteraturereviewontheusageofeyetrackinginsoftwareengineering-2015","role":"author","urls":{"Paper":"http://www.ptidej.net/publications/documents/IST15.doc.pdf"},"keyword":["Understanding program comprehension ; IST"],"metadata":{"authorlinks":{"gu�h�neuc, y":"https://bibbase.org/show?bib=http%3A%2F%2Fwww.yann-gael.gueheneuc.net%2FWork%2FPublications%2FBiblio%2Fcomplete-bibliography.bib&msg=embed","guéhéneuc, y":"https://bibbase.org/show?bib=http://www.yann-gael.gueheneuc.net/Work/BibBase/guehene%20(automatically%20cleaned).bib"}},"downloads":0,"html":""},"search_terms":["systematic","literature","review","usage","eye","tracking","software","engineering","sharafi","soh","guéhéneuc"],"keywords":["understanding program comprehension ; ist"],"authorIDs":["AfJhKcg96muyPdu7S","xkviMnkrGBneANvMr"],"dataSources":["Sed98LbBeGaXxenrM","8vn5MSGYWB4fAx9Z4"]}