Pragmatic Challenges in the Evaluation of Interactive Visualization Systems
From BELIV 2010
Presentation
Notes
- use graduate student, to what extend are the results valid, how would results change if we were to use domain experts
- quantitative and qual, wanted to get both, but reviewers wanted a clearer definition
- 16 ppt in total, no stat. sig but hard to do in depth work with more ppts
- smaller set of documents, not eco valid but need to reduce doc size to make the study feasible
- big system, big learning curve for ppts, overlooked functionality of tool, takes too much time for training
- many investigative analysis, use focused scenario, difficult develop strategies for more general tasks
q and a:
- object to cs students, not students. match task subject with school subjects, they are novices but they are still more of a domain experts? use grad student for their abilities to analyze
