Usability evaluation case study

Few evaluations of digital libraries have employed a sufficient blend of usability evaluation methods to reap the many benefits of these various approaches. One notable exception is the evaluation of the Virtual Data Center (VDC), a collaborative project between researchers at Harvard-MIT Data Center at Harvard University and the University of Michigan 's School of Information and College of Engineering (http://TheData.org) (Hovater, Krot, Kiskis, Holland, & Altman, 2002). The VDC is an open-source digital library that is designed to facilitate the management and dissemination of social science research data.

In the evaluation of this digital library, evaluators adopted not only usability inquiry approaches such as focus groups and user surveys, but they also employed usability inspection methods such as cognitive walkthroughs and think aloud usability testing methods. The VDC evaluation team used focus groups and user surveys to gain preliminary feedback on the usability of the digital library. The goals for the focus groups method were to identify: (a) how users were conducting research, and (b) how the VDC could help them better conduct research. The goals for the user survey method were to identify: (a) current patterns of use, (b) qualities of other sites that users found helpful, (c) traits of other users seeking data, and (d) usability issues within the library (as it existed then).

After the usability inquiry, the VDC evaluation team used the cognitive walkthrough protocol to inspect the usability of the system. Finally, the VDC evaluation team employed the usability testing think aloud method to test real users' abilities to navigate their digital library system. Through the systematic use of multiple usability evaluation methods, the VDC team has been able to address many usability issues to create a more user-friendly digital library.