Development of guidance for feasibility studies to decide whether and how to proceed to full-scale evaluation of complex public health interventions: a systematic review
MetadataShow full item record
Background The importance of feasibility studies (also referred to as exploratory or pilot studies) for optimising complex public health interventions and evaluation designs before evaluating effectiveness is widely acknowledged. In a systematic review of guidance on feasibility studies, we found that guidance is lacking or inconsistent on many aspects of their purpose, design, and conduct, and that it is lacking on the evidence needed to inform decisions about when to proceed to an effectiveness study. This work, building on that review, aimed to develop guidance for researchers, peer reviewers, and funders. Methods The systematic review was followed by a three-round web-based, Delphi exercise. We identified novel approaches to intervention optimisation and study designs from beyond public health through a scoping review and qualitative interviews with 15 experts in intervention design and evaluation. We discussed key aspects of the draft guidance with evaluation design specialists, funders, and journal editors in a consensus workshop (n=30), and we revised the guidance accordingly. The review is registered with PROSPERO, number CRD42016047843. Findings Our systematic review had identified 25 unique sets of guidance. The Delphi identified consensus on many aspects of feasibility study methodology, but disagreement on others, including terminology, how feasibility study data can inform decisions about sample size, how progression criteria should be set, and how progression decisions should be made. A number of study designs typically used in clinical studies (eg, n of 1), digital health (eg, A–B testing), and engineering (eg, fractional factorial designs) have the potential to be applied more widely in feasibility studies of complex public health interventions—for example, to optimise interventions or to explore variation in intervention effects. Interpretation The guidance will help researchers to develop and conduct feasibility studies, and take appropriate decisions on progression to an effectiveness study. It will provide peer reviewers and research funders with objective criteria against which to assess bids and publications. Study limitations include a lower response from less experienced researchers than from more experienced research methodologists in the Delphi exercise. The systematic review of guidance covered seven health-related bibliographic databases but might have missed guidance from other areas of social intervention research.
Craig, P., Martin, A., Browne, S., Simpson, S.A., Wight, D., Robling, M., Moore, G., Hallingberg, B., Segrott, J., Turley, R. and Murphy, S. (2018) 'Development of guidance for feasibility studies to decide whether and how to proceed to full-scale evaluation of complex public health interventions: a systematic review', The Lancet, 392, p.S7.
Abstract published in The Lancet available at https://doi.org/10.1016/S0140-6736(18)32265-7
Medical Research Council (MRC)/National Institute of Health Research (NIHR) Methodology Research Panel (MR/N015843/1).
Showing items related by title, author, subject and abstract.
Exploratory studies to decide whether and how to proceed with full scale evaluations of public health interventions: A systematic review of guidance Hallingberg, Britt; Turley, R.; Segrott, J.; Wight, D.; Craig, P.; Moore, L.; Murphy, S.; Robling, M.; Simpson, S.A.; Moore, G. (BMC (Springer Nature), 2018-05-28)Background: Evaluations of complex interventions in public health are frequently undermined by problems that can be identified before the effectiveness study stage. Exploratory studies, often termed pilot and feasibility ...
Resilience and vulnerability: Supporting the integration of unaccompanied asylum-seeking minors in the United Kingdom Wells, Mike (Cardiff Metropolitan University, 2017)There is a general agreement in the existing research that unaccompanied asylum-seeking minors (UAMs) are a particularly vulnerable group as a result of their traumatic experiences of forced migration and displacement ...
Group treatment in a male low secure mental health service: a treatment description and descriptive evaluation Nagi, Claire; Davies, Jason; Shine, Laura (Emerald, 2014)PURPOSE – The purpose of this paper is to describe the development, content and structure of an intensive group-based intervention designed to address a range of needs common to individuals within low secure forensic ...