State of the psychometric methods: patient-reported outcome measure development and refinement using item response theory.

dc.contributor.author

Stover, Angela M

dc.contributor.author

McLeod, Lori D

dc.contributor.author

Langer, Michelle M

dc.contributor.author

Chen, Wen-Hung

dc.contributor.author

Reeve, Bryce B

dc.date.accessioned

2019-09-03T12:42:56Z

dc.date.available

2019-09-03T12:42:56Z

dc.date.issued

2019-07-30

dc.date.updated

2019-09-03T12:42:54Z

dc.description.abstract

BACKGROUND:This paper is part of a series comparing different psychometric approaches to evaluate patient-reported outcome (PRO) measures using the same items and dataset. We provide an overview and example application to demonstrate 1) using item response theory (IRT) to identify poor and well performing items; 2) testing if items perform differently based on demographic characteristics (differential item functioning, DIF); and 3) balancing IRT and content validity considerations to select items for short forms. METHODS:Model fit, local dependence, and DIF were examined for 51 items initially considered for the Patient-Reported Outcomes Measurement Information System® (PROMIS®) Depression item bank. Samejima's graded response model was used to examine how well each item measured severity levels of depression and how well it distinguished between individuals with high and low levels of depression. Two short forms were constructed based on psychometric properties and consensus discussions with instrument developers, including psychometricians and content experts. Calibrations presented here are for didactic purposes and are not intended to replace official PROMIS parameters or to be used for research. RESULTS:Of the 51 depression items, 14 exhibited local dependence, 3 exhibited DIF for gender, and 9 exhibited misfit, and these items were removed from consideration for short forms. Short form 1 prioritized content, and thus items were chosen to meet DSM-V criteria rather than being discarded for lower discrimination parameters. Short form 2 prioritized well performing items, and thus fewer DSM-V criteria were satisfied. Short forms 1-2 performed similarly for model fit statistics, but short form 2 provided greater item precision. CONCLUSIONS:IRT is a family of flexible models providing item- and scale-level information, making it a powerful tool for scale construction and refinement. Strengths of IRT models include placing respondents and items on the same metric, testing DIF across demographic or clinical subgroups, and facilitating creation of targeted short forms. Limitations include large sample sizes to obtain stable item parameters, and necessary familiarity with measurement methods to interpret results. Combining psychometric data with stakeholder input (including people with lived experiences of the health condition and clinicians) is highly recommended for scale development and evaluation.

dc.identifier

10.1186/s41687-019-0130-5

dc.identifier.issn

2509-8020

dc.identifier.issn

2509-8020

dc.identifier.uri

https://hdl.handle.net/10161/19282

dc.language

eng

dc.publisher

Springer Science and Business Media LLC

dc.relation.ispartof

Journal of patient-reported outcomes

dc.relation.isversionof

10.1186/s41687-019-0130-5

dc.subject

Item response theory

dc.subject

Measurement

dc.subject

PROMIS®

dc.subject

Scale construction

dc.subject

Scale evaluation

dc.title

State of the psychometric methods: patient-reported outcome measure development and refinement using item response theory.

dc.type

Journal article

duke.contributor.orcid

Reeve, Bryce B|0000-0002-6709-8714

pubs.begin-page

50

pubs.issue

1

pubs.organisational-group

School of Medicine

pubs.organisational-group

Duke

pubs.organisational-group

Duke Cancer Institute

pubs.organisational-group

Institutes and Centers

pubs.organisational-group

Duke Clinical Research Institute

pubs.organisational-group

Population Health Sciences

pubs.organisational-group

Basic Science Departments

pubs.publication-status

Published

pubs.volume

3

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
State of the psychometric methods: patient-reported outcome measure development and refinement using item response theory.pdf
Size:
1.94 MB
Format:
Adobe Portable Document Format