Main Page
From BELIV 2010
BELIV'10: BEyond time and errors: novel evaLuation methods for Information Visualization.
A Workshop of the ACM CHI 2010 Conference
April 10-11, 2010 - Atlanta, GA, USA
Chairs: Enrico Bertini, Adam Perer, Heidi Lam.
Advisors: Catherine Plaisant and Giuseppe Santucci.
Latest News
- Instructions for Camera-ready versions are posted at: Camera_Ready_Instructions
- Subscribe! Visit the BELIV Blog to be kept up-to-date on everything BELIV!
- Please take our survey to help make BELIV 2010 as productive and lively as possible.
Motivation and Goals
The purpose of information visualization is to provide users with accurate visual representations of data and natural interaction tools to support discovery and sense making. These activities are often exploratory in nature and can take place over days, weeks or months and rarely follow a predefined or linear workflow. While the overall use of information visualizations is accelerating, the growth of techniques for the evaluation of these systems has been slow. To understand these complex behaviors, evaluation efforts should be targeted at the component level, the system level, and the work environment level. The commonly used evaluation metrics such as task time completion and number of errors appear insufficient to quantify the quality of an information visualization system; thus the name of the workshop: “beyond time and errors …”.
BELIV 2010 aims at gathering researchers in the field to continue the exploration of novel evaluation methods, and to structure the knowledge on evaluation in information visualization around a schema, where researchers can easily identify unsolved problems and research gaps.
This is the third edition of the BELIV workshop series. Based on feedback from past workshop participants, BELIV 2010 will be a 2-day workshop to provide a more interactive environment where participants can produce a research agenda to be published online.
- BELIV 2008 was held in Florence, Italy. Proceedings in ACM DL.
- BELIV 2006 was held in Venice, Italy. Proceedings in ACM DL.
How to Participate
To participate to the workshop, it is necessary to have a paper accepted and be registered both to the workshop and the main CHI conference.
Paper Types
We accept 2 types of submissions: position papers or research papers:
- Research papers are longer (4-8 pages) and present new work and unpublished results. Research papers will be peer-reviewed by members of the program committee and selected according to their novelty, quality and relevance. Authors of accepted research papers will have a chance to revise their papers before they are published in the **ACM digital library**. As BELIV is a workshop, we do not expect lots of validation or strong results. Alternatively, ideal paper contain well-reasoned, innovative and, if possible, thought provoking, ideas
- Position papers are short statements (1-2 pages) describing a participant's relevant experience and ideas that can contribute to the discussion during the workshop. They will be made available to the workshop participants only.
Confused about whether to send a Position or Research paper? Take a look at our blog post about the difference.
Submission
To submit a paper create an account and submit the paper to the submission system at: https://cmt.research.microsoft.com/BELIV2010/. Please clarify if you are submitting a position or research paper. (Submissions are open!)
Format
All the submissions should be formatted in the ACM style. Suitable templates, in LaTeX and Word, can be downloaded from: http://www.acm.org/sigs/pubs/proceed/template.html. Submission should be either in PDF (preferred) or Word formats.
Topics of Interest
Topics include, but are not limited to:
- Evaluation in the visualization lifecycle
- Utility characterization
- Evaluation metrics
- Insight characterization
- Synthetic data set generation
- Taxonomies of tasks
- Benchmark development and repositories
- Methodology of longitudinal case studies
- Evaluation of early prototypes
- Evaluation heuristics and guidelines
Important dates and submission instructions
To submit a paper create an account and submit the paper to the submission system at: https://cmt.research.microsoft.com/BELIV2010/. Please clarify if you are submitting a position or research paper.
- Deadline for submissions: November 30, 2009 (5:00pm PDT)
- Notification of acceptance: January 30, 2010
- Camera ready papers due: February 19, 2010
- Instructions for Camera-ready versions are posted at: Camera_Ready_Instructions
- Workshop: April 10-11, 2010
( Note: at least one author of accepted papers needs to register for the workshop and for one day of the CHI conference.)
Preliminary Agenda
- Day 1 is driven by presentations and discussions. We plan to give 10 min to regular papers and 5 min to position papers. A larger portion of time will be allocated for discussions than for presentation. One of the organizers will be explicitly in charge of taking notes, which will be made available to workshop participants during the day. Organizers will also set up a large poster board with post-it notes for participants to add their comments and ideas. At the end of day 1, organizers will compile a list of discussion topics to be used on day 2 to guide the discussions.
- Day 2 will start with a brief summary of the topics collected on day 1. Participants and organizers will select eight of these topics for discussion in the course of the day, with four topics in the morning and four in the afternoon. Participants will be free to form groups based on the topic of their interest. Each group will be led by two participants, who will also give a presentation to summarize their discussion results at the end of day 2. At the end of the day, the organizers will lead a discussion on broader issues like: how to impact the community; how to maintain the discussion alive; how to better organize BELIV'12.
- After the workshop, the workshop website will host all the research papers (published in the ACM DL), the position papers, and the presentations created by the working groups. We plan to create a mailing list with the workshop participants so that the discussion can continue after the workshop. Finally, we plan to build a research agenda, based on the presentations prepared by the working groups on day 2, and to publish it in a leading journal.
Organizers
Enrico Bertini
University of Konstanz
Konstanz, Germany
Heidi Lam
Google Inc.
Mountain View, CA, USA
Adam Perer
IBM Haifa Research Lab
Mount Carmel, Haifa, Israel
Advisors
Catherine Plaisant (Univ. of Maryland, USA)
Giuseppe Santucci (Sapienza Università di Roma, Italy)
Program Committee
Remco Chang (UNC Charlotte, USA)
Alan Dix (Lancaster University, UK)
Carla Dal Sasso Freitas (Instituto de Informatica UFRGS, Brazil)
Jean-Daniel Fekete (INRIA, France)
Georges Grinstein (UMass Lowell, USA)
Jeffrey Heer (Stanford, USA)
Nathalie Henry (Microsoft Research, USA)
Petra Isenberg (Univ. of Calgary, Canada)
Silvia Miksch (Vienna Univ. of Technology, Austria)
Tamara Munzner (Univ. of British Columbia, Canada)
Chris North (Virginia Tech, USA)
George Robertson (Microsoft Research, USA)
Jean Scholtz (Pacific Northwest National Lab, USA)
John Stasko (Georgia Tech, USA)
Jarke Van Wijk (TU Eindhoven, Netherlands)
