Literature Review
Content Validity of Patient-Reported Outcome Measures of Satisfaction With Primary Care for Musculoskeletal Complaints: A Systematic Review
Journal of Orthopaedic & Sports Physical Therapy
Published Online:February 28, 2021Volume51Issue3Pages94-102Abstract
Objective
To evaluate the content validity of patient-reported outcome measures (PROMs) used to assess satisfaction in patients with musculoskeletal complaints who are treated in primary care.
Design
Systematic review of clinimetric measurement.
Literature Search
A literature search in MEDLINE, Embase, and CINAHL was undertaken (up to January 2020) to identify studies of the development or evaluation of content validity of a PROM that aimed to assess patient satisfaction.
Study Selection Criteria
A PROM was considered eligible if it aimed to measure satisfaction with care in patients with musculoskeletal complaints. Two independent reviewers performed study selection, quality assessment, and data extraction.
Data Synthesis
Evaluation of content validity of the included PROMs was performed according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidance, which includes an evaluation of PROM development, content validity studies, PROM content, and quality of evidence using the modified Grading of Recommendations Assessment, Development and Evaluation (GRADE).
Results
Seven PROMs were identified. Their quality of development was inadequate. No studies evaluating the content validity of the satisfaction PROMs were retrieved. The content validity of the patient satisfaction PROMs was insufficient and supported by very low- quality evidence.
Conclusion
In measuring satisfaction among patients with musculoskeletal complaints treated in primary care, none of the identified PROMs had adequate content validity. Future studies should address the relevance, comprehensiveness, and comprehensibility of PROMs used to measure patient satisfaction and emphasize patient involvement during the development of new instruments. J Orthop Sports Phys Ther 2021;51(3):94–102. Epub 12 Nov 2020. doi:10.2519/jospt.2021.9788
References
- 1. The problem with patient satisfaction scores. Fam Pract Manag. 2016; 23: 23– 27. Medline Google Scholar
- 2. Conceptualisation of patient satisfaction: a systematic narrative literature review. Perspect Public Health. 2015; 135: 243– 250. https://doi.org/10.1177/1757913915594196 Crossref Medline Google Scholar
- 3. Development and preliminary validation of the MedRisk instrument to measure patient satisfaction with chiropractic care. J Manipulative Physiol Ther. 2011; 34: 23– 29. https://doi.org/10.1016/j.jmpt.2010.09.003 Crossref Medline Google Scholar
- 4. Patient satisfaction with outpatient physical therapy: instrument validation. Phys Ther. 2002; 82: 557– 565. https://doi.org/10.1093/ptj/82.6.557 Crossref Medline Google Scholar
- 5. Medical consequences of missed appointments. Arch Intern Med. 1984; 144: 1163– 1166. https://doi.org/10.1001/archinte.1984.00350180075012 Crossref Medline Google Scholar
- 6. The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess. 2002; 6: 1– 244. https://doi.org/10.3310/hta6320 Crossref Medline Google Scholar
- 7. Advanced practice physiotherapy in patients with musculoskeletal disorders: a systematic review. BMC Musculoskelet Disord. 2012; 13: 107. https://doi.org/10.1186/1471-2474-13-107 Crossref Medline Google Scholar
- 8. The fallacy of formative measurement. Organ Res Methods. 2011; 14: 370– 388. https://doi.org/10.1177/1094428110378369 Crossref Google Scholar
- 9. Patient-reported outcome measures in advanced musculoskeletal physiotherapy practice: a systematic review. Musculoskeletal Care. 2018; 16: 188– 208. https://doi.org/10.1002/msc.1200 Crossref Medline Google Scholar
- 10. The assessment of patient satisfaction. In: Jenkinson C, ed. Assessment and Evaluation of Health and Medical Care. Maidenhead, UK: McGraw-Hill Education/Open University Press; 1997: 85– 101. Google Scholar
- 11. Non-attendance or non-invitation? A case-control study of failed outpatient appointments. BMJ. 1989; 298: 1343– 1345. https://doi.org/10.1136/bmj.298.6684.1343 Crossref Medline Google Scholar
- 12. The development of an instrument to measure satisfaction with physical therapy. Phys Ther. 2000; 80: 853– 863. https://doi.org/10.1093/ptj/80.9.853 Crossref Medline Google Scholar
- 13. Toward a theory of patient satisfaction with physiotherapy: exploring the concept of satisfaction. Physiother Theory Pract. 2007; 23: 243– 254. https://doi.org/10.1080/09593980701209394 Crossref Medline Google Scholar
- 14. Patient satisfaction with outpatient physiotherapy: an examination of needs and expectations of patients with acute and chronic musculoskeletal conditions [thesis]. London, UK: King's College London; 2003. Google Scholar
- 15. Reconsidering formative measurement. Psychol Methods. 2007; 12: 205– 218. https://doi.org/10.1037/1082-989X.12.2.205 Crossref Medline Google Scholar
- 16. Patient satisfaction with musculoskeletal physical therapy care: a systematic review. Phys Ther. 2011; 91: 25– 36. https://doi.org/10.2522/ptj.20100061 Crossref Medline Google Scholar
- 17. Patients' satisfaction and reported acceptance of advice in general practice. J R Coll Gen Pract. 1975; 25: 558– 566. Medline Google Scholar
- 18. Results of a survey of client satisfaction with outpatient physiotherapy care. Physiother Theory Pract. 2010; 26: 297– 307. https://doi.org/10.3109/09593980903164058 Crossref Medline Google Scholar
- 19. Patient satisfaction and patient-centered care: necessary but not equal. JAMA. 2012; 308: 139– 140. https://doi.org/10.1001/jama.2012.7381 Crossref Medline Google Scholar
- 20. Patient-Reported Outcome Measurement Group construct & instrument type filters. Available at: https://cosmin.nl/wp-content/uploads/prom-search-filter-oxford-2010.pdf#page=1&zoom=auto,-63,387. Accessed
January 11, 2020 . Google Scholar - 21. Substitution of doctors with physiotherapists in the management of common musculoskeletal disorders: a systematic review. Physiotherapy. 2017 ;103: 341– 351. https://doi.org/10.1016/j.physio.2016.11.006 Crossref Medline Google Scholar
- 22. Development and validation of an instrument for measuring patient satisfaction with physical therapy. Rev Bras Fisioter. 2007; 11: 369– 376. https://doi.org/10.1590/S1413-35552007000500007 Crossref Google Scholar
- 23. Preferred Reporting Items for Systematic reviews and Meta-Analyses: the PRISMA statement. J Clin Epidemiol. 2009; 62: 1006– 1012. https://doi.org/10.1016/j.jclinepi.2009.06.005 Crossref Medline Google Scholar
- 24. COSMIN risk of bias checklist for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018; 27: 1171– 1179. https://doi.org/10.1007/s11136-017-1765-4 Crossref Medline Google Scholar
- 25. Scale to measure patient satisfaction with physical therapy. Phys Ther. 2002; 82: 682– 691. https://doi.org/10.1093/ptj/82.7.682 Crossref Medline Google Scholar
- 26. Patient satisfaction in primary health care: a literature review and analysis. Eval Program Plann. 1983; 6: 185– 210. https://doi.org/10.1016/0149-7189(83)90002-2 Crossref Medline Google Scholar
- 27. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018; 27: 1147– 1157. https://doi.org/10.1007/s11136-018-1798-3 Crossref Medline Google Scholar
- 28. How to select outcome measurement instruments for outcomes included in a “Core Outcome Set” - a practical guideline. Trials. 2016; 17: 449. https://doi.org/10.1186/s13063-016-1555-2 Crossref Medline Google Scholar
- 29. Determinants of patient satisfaction in outpatient musculoskeletal physiotherapy: a systematic, qualitative meta-summary, and meta-synthesis. Disabil Rehabil. 2020; 42: 460– 472. https://doi.org/10.1080/09638288.2018.1501102 Crossref Medline Google Scholar
- 30. Development of the Physical Therapy Outpatient Satisfaction Survey (PTOPS). Phys Ther. 1999; 79: 159– 170. https://doi.org/10.1093/ptj/79.2.159 Crossref Medline Google Scholar
- 31. Satisfaction with physiotherapy among patients at a general hospital in Kuwait. Saudi Med J. 2002; 23: 981– 985. Medline Google Scholar
- 32. Patient satisfaction: a review of issues and concepts. Soc Sci Med. 1997; 45: 1829– 1843. https://doi.org/10.1016/s0277-9536(97)00128-7 Crossref Medline Google Scholar
- 33. Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Qual Life Res. 2009; 18: 1115– 1123. https://doi.org/10.1007/s11136-009-9528-5 Crossref Medline Google Scholar
- 34. COSMIN Methodology for Assessing the Content Validity of PROMs: User Manual. Amsterdam, the Netherlands: COSMIN Initiative; 2018. Google Scholar
- 35. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Qual Life Res. 2018; 27: 1159– 1170. https://doi.org/10.1007/s11136-018-1829-0 Crossref Medline Google Scholar
- 36. How perceptions of a simulated physician-patient interaction influence intended satisfaction and compliance. Soc Sci Med. 1982; 16: 1699– 1704. https://doi.org/10.1016/0277-9536(82)90095-8 Crossref Medline Google Scholar
