Getting into Context Early: A comparative study of laboratory and in-context user testing of low fidelity information appliance prototypes

Abstract

For designers developing information appliances, bringing together the physical and digital elements of a product early in the design process presents a prototyping challenge. Whilst prototyping methods have been developed to address this need, these methods have so far only been evaluated using laboratory-based testing approaches. This paper argues that testing in-context should also be supported by prototyping methods, and presents the findings of a comparative study between a laboratory and in-context user test of early information appliance prototypes. A key question was whether the type of ‘rough and ready’ prototypes frequently found in user laboratory setting might, with some careful development, be suitable for in-context testing.

The results of the study show that in-context and laboratory testing of early, ‘rough and ready’ prototypes uncovered different usability problems. In this study, in-context testing of prototypes uncovered problems with physical inputs and product format not seen in the laboratory environment. In contrast, the increased opportunities for spontaneous user reflection during laboratory testing provided insights into user expectations of functionality not seen during in-context testing.