UCL logo

UCL Discovery

UCL home » Library Services » Electronic resources » UCL Discovery

The PRET A Rapporter framework: Evaluating digital libraries from the perspective of information work

Blandford, A; Adams, A; Attfield, S; Buchanan, G; Gow, J; Makri, S; ... Warwick, C; + view all (2008) The PRET A Rapporter framework: Evaluating digital libraries from the perspective of information work. INFORM PROCESS MANAG , 44 (1) 4 - 21. 10.1016/j.ipm.2007.01.021. Green open access

[img]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
681Kb

Abstract

The strongest tradition of IR systems evaluation has focused on system effectiveness; more recently, there has been a growing interest in evaluation of Interactive IR systems, balancing system and user-oriented evaluation criteria. In this paper we shift the focus to considering how IR systems, and particularly digital libraries, can be evaluated to assess (and improve) their fit with users' broader work activities. Taking this focus, we answer a different set of evaluation questions that reveal more about the design of interfaces, user-system interactions and how systems may be deployed in the information working context. The planning and conduct of such evaluation studies share some features with the established methods for conducting IR evaluation studies, but come with a shift in emphasis; for example, a greater range of ethical considerations may be pertinent. We present the PRET A Rapporter framework for structuring user-centred evaluation studies and illustrate its application to three evaluation studies of digital library systems. (c) 2007 Elsevier Ltd. All rights reserved.

Type:Article
Title:The PRET A Rapporter framework: Evaluating digital libraries from the perspective of information work
Open access status:An open access version is available from UCL Discovery
DOI:10.1016/j.ipm.2007.01.021
Keywords:digital library, usability evaluation, HCI, case study, RETRIEVAL EXPERIMENTATION, SEEKING, BEHAVIOR, SYSTEM
UCL classification:UCL > School of Arts and Social Sciences > Faculty of Arts and Humanities > Information Studies
UCL > School of Life and Medical Sciences > Faculty of Brain Sciences > Psychology and Language Sciences (Division of) > UCL Interaction Centre
UCL > School of Life and Medical Sciences > Faculty of Life Sciences
UCL > School of BEAMS > Faculty of Engineering Science > Computer Science

View download statistics for this item

Archive Staff Only: edit this record