Product user testing: The void between laboratory testing and field testing

View/ open
Author
Gordon, Bethan
Loudon, Gareth
Gill, Steve
Baldwin, Joe
Date
2019-09-02Acceptance date
2019-08-12
Type
Conference paper
Publisher
Manchester School of Art
Metadata
Show full item recordAbstract
User testing will frequently make the difference between an excellent product and a poor one. Moreover, in certain fields such as medical device development or training, the defence field or automotive industry, such testing can literally be the difference between life and death. Unfortunately, design teams rarely have the luxury of either time or budget to user test every aspect of a design at every stage, and so knowing where and when to devote time to testing, and the fidelity required for accurate results are all critical to delivering a good result.
This paper introduces research aimed at defining the optimum fidelity of mixed-reality user testing environments. It aims to develop knowledge enabling the optimisation of user testing environments by balancing effort vs. reward and thus developing critical and accurate data early in the design process.
Testing in a laboratory setting brings advantages such as the ability to limit experimental variability, control confidentiality and measure performance in great detail. Its disadvantages over ‘in the wild’ approaches tend to be related to ecological validity and the small but vitally important changes in user behaviour in real life settings. Virtual reality and hybrid physical-virtual testing environments should theoretically give designers the best of both worlds, finding critical design flaws cheaply and early. However, many attempts have focussed on high fidelity, technology-rich approaches that make them simultaneously more expensive, less flexible and less accessible. The final result is that they are less viable and hence somewhat counter-productive.
This paper presents the results of testing at a variety of fidelity levels within a mixed reality testing environment created by a team of artists and designers. It concludes with a series of recommendations regarding where and when fidelity is important.
Journal/conference proceeding
IASDR Conference 2019
Description
Conference paper presented at IASDR Conference 2019, 2-5 September 2019
Sponsorship
Cardiff Metropolitan University (Grant ID: Cardiff Metropolian (Internal))
Collections
- User Centred Design [72]
Related items
Showing items related by title, author, subject and abstract.
-
Reporting fidelity in the literature for computer aided design and additive manufacture of implants and guides
Burton, Hanna; Peel, Sean; Eggbeer, Dominic (Elsevier, 2018-08-25)The aim of this study was to critically evaluate the nature and reporting fidelity of literature about applications of computer aided design (CAD) and metal additive manufacture (AM) to surgical guides and implants. ... -
Emulation of a Real Life Environment via an Augmented Virtual Environment
Gordon, Bethan (2010-04-20)This research explores the issues regarding appropriate environments for the user testing of a product during the development stage of the product design process. This project focuses on simulating the context of use (for ... -
How to design and prototype an information appliance in 24 hours - Integrating product & interface design processes
Gill, Steve; Loudon, Gareth; Hewett, Bethan; Barham, Gareth (2005-06-01)One of two papers in this submission (see Output 2) resulting from an exercise set by the Audi Design Foundation, which required an information appliance to be produced from brief to prototype in 24 hours. Although this ...