We are delighted to announce that Kasper Hornbæk will deliver the keynote at BELIV’10.  Here are his keynote details:

Conceptual and Practical Challenges in InfoViz Evaluations

Abstract: Research in information visualization (InfoViz) has developed considerably during the last 25 years. In particular, the field is now informed by a substantial and growing literature on evaluations of visualizations. To keep advancing InfoViz, I believe we need to address two limitations of our evaluations. On the one hand, few empirical studies are motivated by theory or are comparing equally plausible hypotheses. Mostly, the InfoViz literature proposes radical innovations (in the terms of William Newman) and does little to develop and test concepts. On the other hand, many of the practical, low-level decisions in InfoViz evaluations are problematic. Like most HCI researchers, we evaluate our own interfaces, use mostly simple outcome measures, rarely study the process of interaction, and select tasks somewhat randomly. This talk will outline the conceptual and practical challenges of evaluation and begin a discussion of how to overcome them.

Biography: Kasper Hornbæk received his M.Sc. and Ph.D. in Computer Science from the University of Copenhagen, in 1998 and 2002, respectively. Since 2009 he has been a professor with special duties in Human-centered Computing at University of Copenhagen. His core research interests are human-computer interaction, usability research, search user interfaces, and information visualization; detours include eye tracking, cultural usability, and reality-based interfaces. Kasper serves on the editorial boards of Journal of Usability Studies, Interacting with Computers, and International Journal of Human-Computer Studies (IJHCS). He has published at CHI, UIST, ACM Transactions on Computer-Human Interaction, and Human-Computer Interaction, and won IJHCS’s most cited paper award 2006-2008.

The strong quality of BELIV continues with the 2010 edition.  12 research papers and 10 positions papers were accepted to our workshop.  Below is a preview of the titles and authors.  As BELIV gets closer, we’ll publish more information about each of these papers.  Stay tuned!

Research papers

• Developing Qualitative Metrics for Visual Analytic Environments. (Jean Scholtz)
• Do Mechanical Turks Dream of Square Pie Charts? (Robert Kosara, Caroline Ziemkiewicz)
• Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies. (Eva Mayr, Michael Smuc, Hanna Risku)
• Decomposing Visual Deciphering for Justification and Comparison of Representation. (Stephane Conversy, Christophe Hurter, Stephane Chatty)
• Exploring Information Visualization – Describing Different Interaction Patterns. (Sylvia Wiltner, Margit Pohl, Silvia Miksch, Markus Rester, Klaus Hinum, Christian Popow, Susanne Ohmann)
• Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Across Domains. (Michael Smuc, Eva Mayr, Hanna Risku)
• Comparing Benchmark Task and Insight Evaluation Methods. (Chris North, Purvi Saraiya)
• Evaluating Information Visualization in Large Companies: Challenges, Experiences and Recommendations. (Michael Sedlmair, Petra Isenberg, Dominikus Baur, Andreas Butz)
• Learning-Based Evaluation of Visual Analytic Systems. (Remco Chang)
• Scanning Between Graph Visualizations: An Eye Tracking Evaluation. (Joseph Goldberg, Jonathan Helfman)
• Towards Information-Theoretic Visualization Evaluation Measure: A Practical example for Bertin’s Matrices. (Innar Liiv)
• Generating a synthetic video dataset. (Mark Whiting)

Position papers

• Visualization Evaluation of the Masses, by the Masses, and for the Masses. (Jeffrey Heer)
• Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study. (Peter Kinnaird, Mario Romero)
• Pragmatic Challenges in the Evaluation of Interactive Visualization Systems. (John Stasko, Youn-ah Kang, Carsten Gorg)
• Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization. (Chris Weaver)
• Mutually Linked Studies – Balancing Threats to Internal and Ecological Validity in InfoVis Evaluation. (Niklas Elmqvist)
• Beyond system logging: human logging for evaluating information visualization. (Nathalie Henry)
• How is a graphic like pumpkin pie? A framework for analysis and critique of visualisations. (Hadley Wickham)
• Proposed Working Memory Measures for Evaluating Information Visualization Tools. (Laura Matzen, Laura McNamara, Kerstan Cole, Alisa Bandlow, Courtney Dornburg, Travis Bauer)
• Comparative Evaluation of Two Interface Tools in Performing Visual Analytics Tasks. (Dong Hyun Jeong, William Ribarsky, Tera Green, Remco Chang)
• Implications of Individual Differences on Evaluating Information Visualization Techniques. (Ji Soo Yi)