Proposed Working Memory Measures for Evaluating Information Visualization Tools
From BELIV 2010
Presentation
Notes
- using working memory to evaluate info vis tools
- evaluation developed for single tool/user/data, used cognitive resources to create standardized metrics: well designed interface should free up cog burden to free up resources to make sense of the data
- interested in working memory, limited capacity and measurable
- dual-task methodology: primary (interaction with interface), secondary (test of working memory)
- secondary task: auditory memory tasks (remember letters)
- also use NASA TLX to develop convergent evidence
q and a:
- possible divergent: dual task to study encoding, but more visual analytics, force people to put more thoughts in vis than remember the letters: try to keep primary task the mechanism to interact with vis just testing usability of interfaces, not deep analysis, later--tease out interaction strategy and outcomes
- interesting to include a base line, what impact is on the primary tasks with the secondary task; student get more vigorous insights into working memory, think hard, eye dilates, can reliably tract somebody is thinking hard, down the road may have interesting measurements
- going fishing--change nature of secondary task and changing fish etc--have to change primary tasks, nature of running a control is really critical, change nature of secondary task to see interfering characteristics; will do pilot
- choice of auditory is slight weird, auditory memory may not interfere with visual memory; try to tap into basic working memory, auditory may be too distracting from the primary; encoding involved, more complicated than just auditory or visual
