An insight- and task-based methodology for evaluating spatiotemporal visual analytics. Gomez, S. R., Guo, H., Ziemkiewicz, C., & Laidlaw, D. H. In 2014 IEEE Conference on Visual Analytics Science and Technology (VAST), pages 63–72, October, 2014. ISSN: nulldoi abstract bibtex We present a method for evaluating visualizations using both tasks and exploration, and demonstrate this method in a study of spatiotemporal network designs for a visual analytics system. The method is well suited for studying visual analytics applications in which users perform both targeted data searches and analyses of broader patterns. In such applications, an effective visualization design is one that helps users complete tasks accurately and efficiently, and supports hypothesis generation during open-ended exploration. To evaluate both of these aims in a single study, we developed an approach called layered insight- and task-based evaluation (LITE) that interposes several prompts for observations about the data model between sequences of predefined search tasks. We demonstrate the evaluation method in a user study of four network visualizations for spatiotemporal data in a visual analytics application. Results include findings that might have been difficult to obtain in a single experiment using a different methodology. For example, with one dataset we studied, we found that on average participants were faster on search tasks using a force-directed layout than using our other designs; at the same time, participants found this design least helpful in understanding the data. Our contributions include a novel evaluation method that combines well-defined tasks with exploration and observation, an evaluation of network visualization designs for spatiotemporal visual analytics, and guidelines for using this evaluation method.
@inproceedings{gomez_insight-_2014,
title = {An insight- and task-based methodology for evaluating spatiotemporal visual analytics},
doi = {10.1109/VAST.2014.7042482},
abstract = {We present a method for evaluating visualizations using both tasks and exploration, and demonstrate this method in a study of spatiotemporal network designs for a visual analytics system. The method is well suited for studying visual analytics applications in which users perform both targeted data searches and analyses of broader patterns. In such applications, an effective visualization design is one that helps users complete tasks accurately and efficiently, and supports hypothesis generation during open-ended exploration. To evaluate both of these aims in a single study, we developed an approach called layered insight- and task-based evaluation (LITE) that interposes several prompts for observations about the data model between sequences of predefined search tasks. We demonstrate the evaluation method in a user study of four network visualizations for spatiotemporal data in a visual analytics application. Results include findings that might have been difficult to obtain in a single experiment using a different methodology. For example, with one dataset we studied, we found that on average participants were faster on search tasks using a force-directed layout than using our other designs; at the same time, participants found this design least helpful in understanding the data. Our contributions include a novel evaluation method that combines well-defined tasks with exploration and observation, an evaluation of network visualization designs for spatiotemporal visual analytics, and guidelines for using this evaluation method.},
booktitle = {2014 {IEEE} {Conference} on {Visual} {Analytics} {Science} and {Technology} ({VAST})},
author = {Gomez, Steven R. and Guo, Hua and Ziemkiewicz, Caroline and Laidlaw, David H.},
month = oct,
year = {2014},
note = {ISSN: null},
pages = {63--72},
file = {IEEE Xplore Abstract Record:C\:\\Users\\conny\\Zotero\\storage\\797QC6HF\\7042482.html:text/html}
}
Downloads: 0
{"_id":"RD3RBWaG2CE2w24QQ","bibbaseid":"gomez-guo-ziemkiewicz-laidlaw-aninsightandtaskbasedmethodologyforevaluatingspatiotemporalvisualanalytics-2014","authorIDs":[],"author_short":["Gomez, S. R.","Guo, H.","Ziemkiewicz, C.","Laidlaw, D. H."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","title":"An insight- and task-based methodology for evaluating spatiotemporal visual analytics","doi":"10.1109/VAST.2014.7042482","abstract":"We present a method for evaluating visualizations using both tasks and exploration, and demonstrate this method in a study of spatiotemporal network designs for a visual analytics system. The method is well suited for studying visual analytics applications in which users perform both targeted data searches and analyses of broader patterns. In such applications, an effective visualization design is one that helps users complete tasks accurately and efficiently, and supports hypothesis generation during open-ended exploration. To evaluate both of these aims in a single study, we developed an approach called layered insight- and task-based evaluation (LITE) that interposes several prompts for observations about the data model between sequences of predefined search tasks. We demonstrate the evaluation method in a user study of four network visualizations for spatiotemporal data in a visual analytics application. Results include findings that might have been difficult to obtain in a single experiment using a different methodology. For example, with one dataset we studied, we found that on average participants were faster on search tasks using a force-directed layout than using our other designs; at the same time, participants found this design least helpful in understanding the data. Our contributions include a novel evaluation method that combines well-defined tasks with exploration and observation, an evaluation of network visualization designs for spatiotemporal visual analytics, and guidelines for using this evaluation method.","booktitle":"2014 IEEE Conference on Visual Analytics Science and Technology (VAST)","author":[{"propositions":[],"lastnames":["Gomez"],"firstnames":["Steven","R."],"suffixes":[]},{"propositions":[],"lastnames":["Guo"],"firstnames":["Hua"],"suffixes":[]},{"propositions":[],"lastnames":["Ziemkiewicz"],"firstnames":["Caroline"],"suffixes":[]},{"propositions":[],"lastnames":["Laidlaw"],"firstnames":["David","H."],"suffixes":[]}],"month":"October","year":"2014","note":"ISSN: null","pages":"63–72","file":"IEEE Xplore Abstract Record:C\\:\\\\Users\\o̧nny\\\\Zotero\\\\storage\\\\797QC6HF\\\\7042482.html:text/html","bibtex":"@inproceedings{gomez_insight-_2014,\n\ttitle = {An insight- and task-based methodology for evaluating spatiotemporal visual analytics},\n\tdoi = {10.1109/VAST.2014.7042482},\n\tabstract = {We present a method for evaluating visualizations using both tasks and exploration, and demonstrate this method in a study of spatiotemporal network designs for a visual analytics system. The method is well suited for studying visual analytics applications in which users perform both targeted data searches and analyses of broader patterns. In such applications, an effective visualization design is one that helps users complete tasks accurately and efficiently, and supports hypothesis generation during open-ended exploration. To evaluate both of these aims in a single study, we developed an approach called layered insight- and task-based evaluation (LITE) that interposes several prompts for observations about the data model between sequences of predefined search tasks. We demonstrate the evaluation method in a user study of four network visualizations for spatiotemporal data in a visual analytics application. Results include findings that might have been difficult to obtain in a single experiment using a different methodology. For example, with one dataset we studied, we found that on average participants were faster on search tasks using a force-directed layout than using our other designs; at the same time, participants found this design least helpful in understanding the data. Our contributions include a novel evaluation method that combines well-defined tasks with exploration and observation, an evaluation of network visualization designs for spatiotemporal visual analytics, and guidelines for using this evaluation method.},\n\tbooktitle = {2014 {IEEE} {Conference} on {Visual} {Analytics} {Science} and {Technology} ({VAST})},\n\tauthor = {Gomez, Steven R. and Guo, Hua and Ziemkiewicz, Caroline and Laidlaw, David H.},\n\tmonth = oct,\n\tyear = {2014},\n\tnote = {ISSN: null},\n\tpages = {63--72},\n\tfile = {IEEE Xplore Abstract Record:C\\:\\\\Users\\\\conny\\\\Zotero\\\\storage\\\\797QC6HF\\\\7042482.html:text/html}\n}\n\n","author_short":["Gomez, S. R.","Guo, H.","Ziemkiewicz, C.","Laidlaw, D. H."],"key":"gomez_insight-_2014","id":"gomez_insight-_2014","bibbaseid":"gomez-guo-ziemkiewicz-laidlaw-aninsightandtaskbasedmethodologyforevaluatingspatiotemporalvisualanalytics-2014","role":"author","urls":{},"downloads":0},"bibtype":"inproceedings","biburl":"https://raw.githubusercontent.com/JKU-ICG/provenance-survey/master/assets/data/main.bib?token=AFMAFPFPO73YUVEBH3EL22C6YQDJU","creationDate":"2020-05-12T16:18:24.924Z","downloads":0,"keywords":[],"search_terms":["insight","task","based","methodology","evaluating","spatiotemporal","visual","analytics","gomez","guo","ziemkiewicz","laidlaw"],"title":"An insight- and task-based methodology for evaluating spatiotemporal visual analytics","year":2014,"dataSources":["iLdxLZjd62Nd3rAFg"]}