Patient-centered Outcomes Used in Pediatric Focused
Manual Therapies Research Studies: A Secondary
Data Analysis of a Systematic ReviewThis section is compiled by Frank M. Painter, D.C.
Send all comments or additions to: Frankp@chiro.org
FROM: J Patient Rep Outcomes 2021 (Apr 1); 5 (1): 31 ~ FULL TEXT
OPEN ACCESS Beth Carleo, Kristian Anderson, Carol Parnell Prevost & Katherine A. Pohlman
Palmer College of Chiropractic,
4777 City Center Parkway,
Port Orange, FL, 32129, USA.
Background: Patient-reported outcome measurements (PROM) are instruments that seek a patient's health or functional status. Inclusion of standardized PROMs in research studies and clinical practice provides a more comprehensive understanding of an intervention from the patient's viewpoint. This secondary analysis identified PROM usage and appropriateness of references for property measurements from clinical trials included in a recent systematic review of pediatric manual therapy.
Methods: All included manuscripts within a recent systematic review had two authors extract PROM and associated property measurement data, including the property measurements supporting citations. Inclusion criteria for the articles were published clinical trials (observational or experimental) of pediatric children receiving manual therapy (any profession) for any condition between 2001-March 2018. For each PROM's associated property measurement, two authors used the COSMIN study design checklist to appraise the quality of the cited study to evaluate the property measurement.
Results: Of the 50 manuscripts included in the systematic review, 20 manuscripts reported the use of 52 PROMs. Of the 52 PROMs assessed, 31 did not make a statement about the instrument's property measurement, 7 PROMs had property measurements stated but not referenced, 4 PROMs stated that the property measurement information was unknown, and 10 had property measurement data with reference(s). These 10 PROMs with referenced property measurements were from 7 unique PROMs: constipation assessment scale, satisfaction visual analog scale (VAS), crying time diary, sleep diary, fear avoidance belief questionnaire (FABQ), pain VAS, and autism treatment evaluation checklist. The assessment of the referenced property measurements found that several property measurement's dimensions had not been assessed and those that had were evaluated were done so with poor or fair standards.
Conclusions: This secondary analysis finds that clinical studies of pediatric manual therapy lack consistent use of PROMs with high quality property measurements. Further research to establish and implement PROMs to be used in future research studies and in clinical settings should become a priority for professions using manual therapy in children.
From the FULL TEXT Article:
Introduction
In recent years, researchers have produced multiple literature reviews on manual therapy use within the pediatric population. [1] Pediatric manual therapy can include spinal manipulative therapy, mobilization, chiropractic/osteopathic manipulative therapy, or cranial-sacral therapy. [1] While differences exist between them, all reviews conclude a paucity of evidence for effectiveness, mostly due to methodological flaws within the individual included studies. A consistent methodological flaw was the lack of standardized patient-reported outcome measurements (PROMs). [1]
PROMs are instruments or tools that seek a patient’s response to their health, quality of life, or functional status from their health care or treatment. [2] They allow health outcomes to be measured throughout a treatment plan directly from the patient’s perspective. Research of chiropractic, a profession that commonly uses manual therapy, frequently uses PROMS focused on musculoskeletal issues in the adult population. [3]
There are many obstacles to the adoption of PROMs in clinical practice. Many clinicians lack understanding about the instruments and have concerns that the time it will take to administer PROMs would increase their workload. [4] Additional challenges include achieving higher patient participation rates, especially among older, sicker, and illiterate patients. [5] Despite the understanding of PROM’s importance in clinical practice, the routine use of these tools is limited. [6]
This secondary data analysis aimed to identify PROMs reported in published clinical trials (observational or experimental) of children receiving manual therapy (any profession) for any condition between 2001-March 2018. For the identified PROMs, two authors extracted property measurement information and evaluated current CONSORT guidelines for reporting property measures. [7] When citations for property measurements were referenced, authors further used COSMIN checklists to evaluate and score the quality of the methods that were conducted to assess the stated property measurement. [8, 9]
Methods
Initial systematic review
Details of the initial systematic review used to identify studies for this research project have been previously published. [1] In brief, the systematic review’s inclusion criteria were: full-text reports of randomized controlled trials (excluding feasibility studies without outcome measures) or observational studies with pre and post measurements (case reports were excluded) that included two or more children under the age of 18 treated with any form of manual therapy from any healthcare provider and published in English. This research project was registered on PROSPERO: CRD42016033681 and the initial systematic review [1] was also registered there: CRD42018091835.
Patient-reported outcome measures (PROMs)
Every included study in the original SR was reviewed by one of the current authors and validated by another author. PROMs used in a study and details stated regarding the PROM’s property measurements were extracted. The extracted data were categorized into CONSORT reporting guidelines. [7] Those that did follow CONSORT guidelines were categorized as: “Stated that property measurements were unknown” or “Stated with references”. Those that did not follow CONSORT guidelines were categorized as: “None stated,” or “Stated, but not referenced”. If a reference was cited but then discovered by the authors not to include property measurement evaluations, these manuscripts were changed to “Stated, but not referenced.” All information was tabulated and reported.
PROM property measurement assessment
For unique PROM with property measurements referenced, two authors further evaluated the referenced manuscript. If the same PROM was cited by more than one manuscript, all citations from any of the manuscripts were evaluated for the PROM. First, the referenced manuscript was assessed for which property measurement dimension was being evaluated using the definitions determined by the COSMIN guidelines. [8] Exact property measurement dimensions are: Reliability, Internal Consistency, Measurement Error, Content Validity (including face validity), Criterion Validity, Construct Validity (including Structural Validity, Hypothesis-testing Validity, Cross-cultural Validity), Responsiveness, and Interpretability.
The lead author assessed the property measurement of each article using the respective COSMIN study design quality checklist. The senior author independently evaluated assessments and consensus was reached by discussions between the two authors. Scores for each checklist item were based on a 4-point scale: ‘poor’, ‘fair’, ‘good’, or ‘excellent’. [9] Based on the COSMIN recommendation, the overall quality score was determined by taking the lowest rating of any item in the checklist (‘worst score counts’).
Results
Patient-reported outcome measures (PROMs)
From the 50 studies that met the Parnell-Prevost [1] review’s inclusion criteria, 20 manuscripts (40%) reported the use of 52 PROMs, with 30 manuscripts (60%) not using any PROMs. Descriptive details of the 52 PROMs can be found in Supplement #1.
Table 1 As shown in Table 1, the majority of the 52 PROMs did not make a statement regarding the PROM’s property measurements (n = 31, 59.6%). Of the articles that did make a statement on the PROM’s property measurements, 7 manuscripts had statements of property measurements existing with no citations; in addition to these, two of the PROMs stated and referenced property measurements, but the references did not include property measurement assessments. A total of 7 PROMs (13.5%) were categorized as “Stated, but not referenced”. In addition, 4 PROMS (7.8%) described the property measurements as unknown. Only 10 of the 52 PROMs (19.2%) had references to prompt a property measurement evaluation. These 10 PROMs were from 7 of the 50 initial manuscripts (14.0%).
Property measurement assessment
Table 2 The 10 PROMs identified 7 unique and 3 repeat instruments. As shown in Table 2, at least one property measurement dimension was found for each PROM. Property measurement dimensions not assessed in any of the PROMs include: Measurement Error, Hypothesis-Testing Validity, and Cross-Cultural Validity.
For the 6 property measurement dimensions assessed with the references, Structural Validity was the most common dimension assessed; however, all 4 assessments receiving ‘poor’ methodological quality score. Responsiveness was the least referenced property measurement dimension with one PROM (Pain VAS- visual analog scale), and it also received a ‘poor’ methodological quality score. Among all 16 property measurements assessed, the most common score was ‘poor’ (n = 11). A few received a ‘fair’ score (n = 4), with only Content Validity for pain VAS receiving a ‘good’ methodological quality score. Checklist evaluations for each PROM and property measurement can be found in Supplement #2.
Discussion
This secondary analysis study found a lack of high-quality standardized PROMs reported in clinical studies of manual therapies for children. From the 50 studies reviewed, 52 PROMs were found to with 7 unique PROMs having appropriately referenced property measurements. When the methodology for these 7 PROMs’ property measurements were evaluated, most were of ‘fair’ or ‘poor’ quality. These findings are similar to those found when the spectrum of outcome measures used in pediatric orthopedic publications were evaluated. [15] Of their 2,251 reviewed studies, only 11.5% used a PROM, with few having appropriate validation. These reviews signify a need to encourage the use of the same scales across multiple trials, which could more efficiently impact treatment strategies for the pediatric population.
Of the 7 PROMs identified with evaluated property measurements, the Autism Treatment Evaluation Checklist [14], Constipation Assessment Scale, and Satisfaction Question with a visual analog scale (VAS) [10] were each used in 1 study only and their property measurements were all found to be developed with ‘poor’ quality. [10] In a 2015 systematic review of measurement outcomes for children with autism [16] and a 2018 scoping review of constipation [17], neither recommended the use of these tools or any other tool because of the lack of well-developed property measurements. The satisfaction question is commonly measured, especially in musculoskeletal studies; however, it is usually measured with non-standardized, locally-devised tools. [18] All of these outcomes emphasize the need for more standardization of PROMs and their use.
Of the remaining PROMs with evaluated property measurements, both crying time and sleeping duration were collected using a diary format and had Criterion Validity evaluated as either poor or fair, respectively. The diary format is desired as it should reduce recall bias by collecting data ‘in the field’. However, diary methods requires a patient or a proxy to self-monitor, with adherence to this protocol shown to be unreliable. [19] With technological advances and better methodological understanding, diaries are still considered viable ways to enrich PROM data, especially for quality of life measures. [20]
Studies with evaluated property measurements that looked specifically at musculoskeletal conditions identified 2 PROMs. The Pain VAS was the only PROM to be used in 3 studies. This measure had several property measurements evaluated with a range of quality from ‘poor’ to ‘good’. A Fear Avoidance Belief Questionnaire (FABQ) was also used and found to assess several property measurements with ‘fair’ or ‘poor’ quality ratings. [13] A recent commentary by Michaleff et al. highlighted the clinician’s challenges to assess pain. [21] They also provide 8 different age-appropriate suggestions for measuring self-report of pain intensity, which included a VAS, along with other validated scales that use color or faces. We recommend the use of one of the 8 scales in the age-appropriate clinical situations.
Importantly, the effort placed on selecting appropriate PROMs needs to include usability in the clinic setting in addition to clinical research. Stinson et al. suggest ease of use and scoring are points in the process where clinical research and clinical practice settings may present different needs. [22] There has been effort dedicated to identifying scales useful to the pediatric population for both settings (e.g., PedIMMPACT, PROMIS). McGrath et al. recommends PedIMMACT for the core outcome domains for both acute and chronic/recurring pediatric pain conditions. [23] PROMIS domains allow for a measure to capture the larger impact of an intervention on a pediatric pain condition. [24] Both measures are limited in use to those who are 5 years of age and older, leaving a void for those younger than this age.
This secondary data analysis is limited to studies included in the initial systematic review. While this limitation allows a more detailed review of the specific content area, these parameters do not allow for a specific review to be developed for this content. The limitation of only reviewing the citations for property measurements included in the studies also limited the potential measurement properties of each PROM; thus, the reporting is certainly incomplete. Another known limitation for all pediatric healthcare and research is the use of proxy-report by parent/caregiver. In the literature, proxy-report of child health has been shown to be contradictory, with both over- and under-estimates reported. [25] Further research is needed to better understand the effect of proxy-reporting of pediatric PROMs.
Conclusion
This secondary analysis documents the need to develop high-quality PROMs on manual therapy for pediatric populations. Without such PROMs, manual therapy research, as well as practitioners using this therapy, are at a loss for an approach to collect valuable patient data that could best assess patient progress. Further research to establish and implement PROMs to be used in future research studies and in clinical settings should become a priority for professions using manual therapy in children.
Additional Files
Additional file 1 Musculoskeletal (12 articles)
Additional file 2 COSMIN Analysis ResultsAbbreviations
CONSORT: = Consolidated Standards of Reporting Trials
COSMIN: = COnsensus-based Standards for the selection of health Measurement Instruments
PROMIS: = Patient Reported Outcomes Measurement Information System
PROMs: = Patient Reported Outcome Measures
VAS: = Visual Analog Scale
References:
Parnell Prevost C, Gleberzon B, Carleo B, Anderson K, Cark M, Pohlman KA.
Manual Therapy for the Pediatric Population:
A Systematic Review
BMC Complement Altern Med. 2019 (Mar 13); 19 (1): 60Weldring, T., & Smith, S. M. S. (2013).
Patient-reported outcomes (PROs) and patient-reported outcome measures (PROMs).
Health Services Insights, 6, 61–68.Khorsan, R., Coulter, I. D., Hawk, C., & Choate, C. G. (2008).
Measures in chiropractic research: Choosing patient-based outcome assessments.
Journal of Manipulative and Physiological Therapeutics, 31(5), 355–375Fleischmann, M., & Vaughan, B. (2018).
The challenges and opportunities of using patient reported outcome measures (PROMs)
in clinical practice.
International Journal of Osteopathic Medicine, 28, 56–61.Jahagirdar, D., Kroll, T., Ritchie, K., & Wyke, S. (2012).
Using patient reported outcome measures in health services: A qualitative study on including
people with low literacy skills and learning disabilities.
BMC Health Services Research, 12(1), 431.Nelson, E. C., Eftimovska, E., Lind, C., Hager, A., Wasson, J. H., & Lindblad, S. (2015).
Patient reported outcome measures in practice.
BMJ., 350, g7818.Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gřtzsche, P. C., Devereaux, P. J., et al. (2010).
CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials.
BMJ., 340, c869Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., … de Vet, H. C. W. (2010).
The COSMIN study reached international consensus on taxonomy, terminology, and definitions of
measurement properties for health-related patient-reported outcomes.
Journal of Clinical Epidemiology, 63(7), 737–745.Terwee, C. B., Mokkink, L. B., Knol, D. L., Ostelo, R. W. J. G., Bouter, L. M., & de Vet, H. C. W. (2012).
Rating the methodological quality in systematic reviews of studies on measurement properties:
A scoring system for the COSMIN checklist.
Quality of Life Research: an International Journal of Quality of Life Aspects of Treatment,
Care and Rehabilitation, 21(4), 651–657Tarsuslu, T., Bol, H., Sim?ek, I. E., Toylan, I. E., & Cam, S. (2009).
The effects of osteopathic treatment on constipation in children with cerebral palsy: A pilot study.
Journal of Manipulative and Physiological Therapeutics, 32(8), 648–653.Browning M, Miller J. (2008).
Comparison of the Short-term Effects of Chiropractic Spinal Manipulation
and Occipito-sacral Decompression in the Treatment of Infant Colic:
A Single-blinded, Randomised, Comparison Trial
Clinical Chiropractic 2008 (Sep); 11 (3): 122–129Miller, J. E., Miller, L., Sulesund, A. K., & Yevtushenko, A. (2009
Contribution of Chiropractic Therapy to Resolving Suboptimal Breastfeeding:
A Case Series of 114 Infants
Journal of Manipulative and Physiological Therapeutics 2009 (Oct); 32 (8): 670–674Walston, Z., & Yake, D. (2016).
Lumbar thrust manipulation and exercise for the treatment of mechanical low Back pain
in adolescents: A case series.
The Journal of Orthopaedic and Sports Physical Therapy, 46(5), 391–398Khorshid, K. A., Sweat, R. W., & Zemba, D. Z. B. (2006).
Clinical efficacy of upper cervical versus full spine chiropractic care on
children with autism: A randomized clinical trial.
Journal of Vertebral Subluxation Research, 9, 1–7.Truong, W. H., Price, M. J., Agarwal, K. N., Suryavanshi, J. R., Somasegar, S., Thompson, M., … Dodwell, E. R. (2019).
Utilization of a wide Array of nonvalidated outcome scales in pediatric Orthopaedic publications:
Can’t we all measure the same thing?
Journal of Pediatric Orthopedics, 39(2), e153–e158.McConachie, H., Parr, J. R., Glod, M., Hanratty, J., Livingstone, N., Oono, I. P., … Williams, K. (2015).
Systematic review of tools to measure outcomes for young children with autism spectrum disorder.
Health Technology Assessment, 19(41), 1–506.Jiang, R., Kelly, M. S., & Routh, J. C. (2018).
Assessment of pediatric bowel and bladder dysfunction: A critical appraisal of the literature.
Journal of Pediatric Urology, 14(6), 494–501.Fennelly, O., Blake, C., Desmeules, F., Stokes, D., & Cunningham, C. (2018).
Patient-reported outcome measures in advanced musculoskeletal physiotherapy practice: A systematic review.
Musculoskeletal Care, 16(1), 188–208.Hufford, M. R., & Shiffman, S. (2003).
Assessment methods for patient-reported outcomes.
Dis-Manage-Health-Outcomes, 11(2), 77–86.Schneider, S., & Stone, A. A. (2016).
Ambulatory and diary methods can facilitate the measurement of patient-reported outcomes.
Quality of Life Research: an International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 25(3), 497–506Michaleff, Z. A., Kamper, S. J., Stinson, J. N., Hestbaek, L., Williams, C. M., Campbell, P., & Dunn, K. M. (2017).
Measuring musculoskeletal pain in infants, children, and adolescents.
The Journal of Orthopaedic and Sports Physical Therapy, 47(10), 712–730Stinson, J. N., Kavanagh, T., Yamada, J., Gill, N., & Stevens, B. (2006).
Systematic review of the psychometric properties, interpretability and feasibility
of self-report pain intensity measures for use in clinical trials in children and adolescents.
Pain., 125(1), 143–157McGrath, P. J., Walco, G. A., Turk, D. C., Dworkin, R. H., Brown, M. T., Davidson, K., et al. (2008).
Core outcome domains and measures for pediatric acute and chronic/recurrent pain
clinical trials: PedIMMPACT recommendations.
The Journal of Pain, 9(9), 771–783DeWalt, D. A., Gross, H. E., Gipson, D. S., Selewski, D. T., DeWitt, E. M., Dampier, C. D., et al. (2015).
PROMIS(®) pediatric self-report scales distinguish subgroups of children within and across
six common pediatric chronic health conditions.
Quality of Life Research: an International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 24(9), 2195–2208Kamper, S. J., Dissing, K. B., & Hestbaek, L. (2016).
Whose pain is it anyway? Comparability of pain reports from children and their parents.
Chiropractic & Manual Therapies, 24(1), 24
Return to PEDIATRICS
Return to OUTCOME ASSESSMENT
Since 4-05-2021
| Home Page | Visit Our Sponsors | Become a Sponsor |
Please read our DISCLAIMER |