WHAT'S THE HARM? RESULTS OF AN ACTIVE SURVEILLANCE ADVERSE EVENT REPORTING SYSTEM FOR CHIROPRACTORS AND PHYSIOTHERAPISTS
 
   

What's the Harm?
Results of an Active Surveillance Adverse Event
Reporting System for Chiropractors
and Physiotherapists

This section is compiled by Frank M. Painter, D.C.
Send all comments or additions to:
    Frankp@chiro.org
 
   

FROM:   PLoS One 2024 (Aug 19); 19 (8): e0309069 ~ FULL TEXT

  OPEN ACCESS   


Katherine A Pohlman • Martha Funabashi • Maeve O'Beirne • David Cassidy
Michael D Hill • Eric L Hurwitz • Gregory Kawchuk • Silvano Mior
Quazi Ibrahim • Haymo Thiel • Michael Westaway
Jerome Yager • Sunita Vohra

Research Center,
Parker University,
Dallas, Texas, United States of America.


This prospective, community-based, active surveillance study aimed to report the incidence of moderate, severe, and serious adverse events (AEs) after chiropractic (n = 100) / physiotherapist (n = 50) visit in offices throughout North America between October-2015 and December-2017. Three content-validated questionnaires were used to collect AE information: two completed by the patient (pre-treatment [T0] and 2-7 days post-treatment [T2]) and one completed by the provider immediately post-treatment [T1]. Any new or worsened symptom was considered an AE and further classified as mild, moderate, severe or serious. From the 42 participating providers (31 chiropractors; 11 physiotherapists), 3819 patient visits had complete T0 and T1 assessments. The patients were on average 50±18 years of age and 62.5% females. Neck/back pain was the most common presenting condition (70.0%) with 24.3% of patients reporting no condition/preventative care. From the patients visits with a complete T2 assessment (n = 2136 patient visits, 55.9%), 21.3% reported an AE, of which: 7.9% were mild, 6.2% moderate, 3.7% severe, 1.5% serious, and 2.0% had missing severity rating. The most common symptoms reported with moderate or higher severity were discomfort/pain, stiffness, difficulty walking and headache. This study provides valuable information for patients and providers regarding incidence and severity of AEs following patient visits in multiple community-based professions. These findings can be used to inform patients of what AEs may occur and future research opportunities can focus on mitigating common AEs.



From the FULL TEXT Article:

Introduction

The United States’s Institute of Medicine (now the National Academy of Medicine) has urged providers across health care settings to monitor (AEs) to improve patient safety. [1] The importance of monitoring AEs includes not only the identification of risks and preventable injury, but also providing patients with an accurate safety profile for treatments, which can contribute to setting more appropriate expectations and improving informed decision making about treatment options. [1–3] The logistics of identifying and reporting AEs in health care systems can be complex, for example, reported incidents usually have multiple potential causes; data collected rarely have sufficient information to assess causation; and there may be a poor understanding of underlying mechanism of injury/disease processes. [4] Like other complex settings (e.g., aerospace, nuclear power), health care systems require substantial resources to develop and maintain successful monitoring systems and a corresponding just and trusting, open, constructive environment where reporting harms is not punished. [5]

However, the investigation of AEs in community-based health care settings is in its infancy. Reasons for this include: the lack of reporting systems that accurately collect AE information in these settings; heterogeneity in AE definitions; long periods between visits; and coordination of care among multiple providers. [6] In addition, the lack of a governance structure and administrative oversight in these settings compared to in hospitals, where institutional governance increases provider oversight and plays a major role in safe clinical care, is often convoluted and onerous. [7, 8]

Regardless of setting, all regulated health care providers are overseen by their regulatory body; while patient safety is part of their mandate, regulatory colleges do not typically act unless a patient complains about the care received. For spinal manipulation therapy (SMT) providers in community-based settings, there is the added complexity of the natural history of presenting musculoskeletal complaints (MSK), especially in regards to pain and stiffness that can be part of chronic, recurrent conditions that may wax and wane over time. [9] Given these known complexities, the first challenge in developing an AE monitoring system is to identify and report symptoms post-treatment. [10] Having an effective system to monitor post-treatment changes in symptoms can help to more accurately differentiate AEs from symptoms related to the conditions’ natural history and/or can be used to predict symptom changes following different treatments, including those commonly used in ambulatory care settings by non-medical doctors, such as chiropractors and physiotherapists.

SMT is a popular treatment widely sought by many patients for MSK complaints, and most often delivered by chiropractors and physiotherapists. [11, 12] AEs associated with SMT have been studied using different research designs, including clinical trials. [13, 14] However, clinical trials are not the optimal design to collect rare AEs [15] and many observational studies lack standardized instruments and operational definitions for relevant terms. [16] AEs following SMT in adult patients have been most often reported as self-limiting, usually consisting of symptoms such as radiating MSK pain, nausea, dizziness, or tiredness. [16–18] More serious, but rare AEs such as cauda equina syndrome [19, 19] and stroke [20, 21] have also been investigated in well-designed case-control studies (i.e., large sample size, no recall bias or interviewer bias).

To help overcome the absence of high-quality prospective data on the frequency of AEs following SMT, the SafetyNet research program was developed. SafetyNet reflects the efforts of a large international and multidisciplinary research team with expertise in chiropractic, physiotherapy, relevant medical specialties, research methodology, and patient safety. [22] One of the SafetyNet objectives aimed to develop and implement an active surveillance reporting system so that AEs could be reported to a central location and anonymously assessed. Details of the development of such a system has been reported elsewhere. [23] The primary aim of this study was to report the incidence of AE after patients being treated by chiropractors and physiotherapists, collected using the SafetyNet Active Surveillance Reporting System. [22, 23]



Materials and methods

This observational, prospective, community-based active surveillance study collected data between 19 October 2015 and 11 December 2017 in Canada and the United States of America (USA). To ensure similar data collection time periods, chiropractors were asked to collect data from 100 consecutive, unique patients, and physiotherapists, who self-reported commonly using SMT and were affiliated with the Canadian Academy of Manipulative Physiotherapy, were asked to collect data from 50 consecutive, unique patients since they provide SMT less commonly than chiropractors. Consecutive, unique patients were eligible whether they were new or returning patients, and were invited to participate only once during their provider’s data collection period, regardless if SMT was provided at that visit. The University of Alberta Health Research Ethics Board reviewed and approved this study (Pro00021870). Each participating provider signed an informed consent prior to participating in this study. Participating patients received study information from participating providers (or their front desk) as well as from a study information letter outlining that informed consent was implied if they completed and returned the study questionnaires. To ensure confidentiality of patient’s participation in this study, written and verbal consent was waived by the ethics committee.

      Patient and public involvement

Patients were involved in the design of the questionnaire described in the section named ‘Data Collection’.

      Definitions

The operational definition for the study’s primary outcome, reported AEs, was developed by an international, multidisciplinary team based on literature review and consensus with multiple stakeholders. [23] We defined AEs as any unfavorable sign, symptom or disease temporally associated with the treatment, whether or not caused by the treatment; specifically, any new or pre-existing symptom that is worse after treatment. Definitions of the four severity classifications self-rated by patients and practitioners and adjudicated centrally can be found in prior publications . [23, 25, 26]

      Provider recruitment

Community-based chiropractors and physiotherapists in Canada and the USA were recruited through announcements at professional events and/or communications through their respective professional organizations, as well as social media, professional newsletters/magazines, and referrals from colleagues or past study participants. After enrollment, all providers completed a demographic questionnaire (including years of experience and number of patients per hour). They also had study materials (e.g., questionnaires) sent to them via mail; and, along with their clinic staff, received online one-on-one training on the study protocol by one of the study investigators (MF/KAP).

      Data collection

Information on AEs was collected by using three content-validated questionnaires, two completed by the patient and one completed by the provider (i.e., chiropractor or physiotherapist), with all questionnaires assessing symptoms the patient was experiencing at the time the questionnaire was completed. Content validity, considered the most important measurement property for patient reported outcome measures [24], was evaluated for all study instruments (T0, T1, provider long form, T2) by a larger team of investigators and reported in detail elsewhere. [23, 25, 26]

Symptoms assessed were: pain/discomfort, stiffness, weakness, fatigue/tiredness, headache, dizziness, numbness/tingling, nausea/vomiting, difficulty walking, problem sleeping, and “other”. The patient completed a ‘pre-treatment questionnaire’ immediately prior to receiving their treatment (hereafter referred to as T0). This questionnaire included questions about patients’ demographic information, co-morbidities, use of medication and natural health products, the condition for which they were seeking care, and the symptoms they were experiencing at the time they were completing the questionnaire. After T0, the provider delivered the treatment as they normally would to that patient. There were no modifications in care due to participation in the study.

Immediately after treatment (hereafter referred to as T1), the provider completed the ‘immediate post-treatment questionnaire’. T1 information included what treatment(s) were provided, i.e., by type (manipulation, mobilization, mechanical device, other manual therapy, other non-manual therapy) and location (cervical spine, thoracic spine, lumbar spine, sacrum/pelvic, upper extremity, lower extremity, other). T1 also included information regarding the symptoms currently identified by the patient or reported by the provider. These symptoms were rated by the provider as mild, moderate, severe, or serious using the study operational definitions. If rated as moderate, severe, or serious, the provider was asked to provide detailed information about the symptom and potential associated factors (hereafter referred to as provider long form). The information was sent and reviewed independently by two content experts (described below in Adjudication for AE severity section).

To maintain anonymity, only the patients were given the ‘follow-up post-treatment questionnaire’ to complete up to one week following treatment (hereafter referred to as T2), together with a pre-addressed stamped return envelope to send the completed questionnaire directly to the study team. T2 asked patients whether a reported symptom was new, better, worse, or unchanged since treatment, as well as satisfaction with care (1-very satisfied to 5-very unsatisfied) and if any additional care was sought to manage their symptoms in the time between the treatment and questionnaire completion. To establish symptom severity (mild, moderate, severe, or serious) at T0 and T2, patients were asked questions about symptom-related limitations based on the operational definitions.

      Adjudication for AE severity

For symptom severity established as moderate, severe, or serious at T1, a provider long form was completed by the provider to give more detailed information about the event and potential associated factors.

For the adjudication process, there were two blinded content experts:

1)   an experienced (i.e., more than 10 years post-licensure) chiropractor (for AEs reported by chiropractors)
or physiotherapist (for AEs reported by physiotherapists) and

2)   an experienced physician with expertise in patient safety.

Initially, one of the study investigators (MF/KAP) prepared a summary of the reported adverse events (AE) using information from the provider long-form and any additional relevant previously data from T0, T1 and T2. The content experts then independently assessed the severity of the AE based on this summary.

If the content experts deemed the AE as moderate, severe, or serious, then the event was further evaluated by the content experts for causality/relatedness [23], preventability [27], and patient disposition. [28]

      Data quality assurance and cleaning procedures

All data were entered and managed by a single data entry clerk using REDCap electronic data capture tools, hosted at the University of Alberta. REDCap is a secure, web-based application designed to support data capture for research studies. [29, 30] Data from the first 100 participants were verified by a single study investigator (MF) who compared T0 and T1 source documents to the data entered on REDCap to identify inconsistencies. Identified errors were communicated to data entry clerk. Subsequently, 20% of all entered data were randomly verified and validated by the same study investigator (MF). Data entry error rate was less than 0.5%. For audit purposes and to ensure transparency, all data entry changes were recorded with the time, date and user ID. Discussion of any query occurred with another study investigator (KAP) with the query resolutions recorded. After all data entry was completed, data were exported into an Excel spreadsheet, where duplicates were removed (n = 2), additional entry errors corrected (n = 5), and data cleaned.

      Sample size justification

The sample size estimation was based on two pilot SafetyNET studies (unpublished data). We observed 29 (5.33%) incidences of moderate to severe adverse events among 544 patient visits with intra-provider correlation of 0.1. No serious adverse event was reported. We anticipated an absolute precision of 2% on either side of the incidence. A sample size consisting of 53 providers each with 100 patient visits would produce a two-sided 95% confidence interval with a width of 4% when the incidence of adverse event is 5.33%. In the pilot studies, we observed about 50% non-participation and or dropout among initially interested providers and patients. To account for such loss, we aimed to enroll double the number of providers and their patients.

      Statistical analysis

We identified the incidence of AEs from three sources:

1)   any new or worsening symptom reported by the provider on T1;

2)   any new or worsening symptom reported by the patient on T2; or

3)   any symptom on T2 reported by the patient with increased severity in comparison to the same symptom on T0 (irrespective of the patient self-reported symptom change, i.e., better, unchanged, worse, new).

If a new symptom was reported on T2, but the severity rating was missing, the symptom was considered worsened (i.e., an AE).

Patient demographics, presenting conditions, and health history were tabulated (mean with standard deviation or frequency with percentage). Incidence (%) of AEs either reported by patients, providers or both were calculated. Incidence of AEs were further classified according to symptoms and/or severity. For both classifications of AE and AE incidence, patients could report multiple AEs. Patients were considered to have an AE if they had one or more than one.

To assess type of data missingness, especially AE not missing at random, T0 and T1 were compared between patients who returned post-treatment form at T2 vs. those who did not. A two-step procedure was used to impute missing data:

1)   multiple imputation by chained equation (MICE) for missing covariates; [31–33] and

2)   imputation of missing AEs using a mixed model.

The covariates: age, sex, condition, treatment dose (i.e., number of treatments reported by the provider), treatment location, number of potential risk factors (e.g., patient’s T0 demographic and health history information), radicular pain, health insurance and providers’ years of experience, and number of patients per hour were used in the imputation process. Logistic regression for binary variables (yes or no) and linear regression for continuous variables were used to impute missing covariate values. In each imputed data set, for participants with missing AE, probability of AE was predicted using a random intercepts (providers) logistic regression model. If the predicted probability of AE > 0.5, an incidence of AE was imputed. Otherwise, no AE was imputed.



Results

Figure 1
see page 6

Table 1
see page 7

Table 2

Table 3

Figure 2

Figure 1 shows participant and data flow. Specifically, 42 providers collected data from 3,819 patient visits with complete data sets (T0, T1, and T2) from 2,136 patients (55.9%). The providers (31 chiropractors; 11 physiotherapists) had an average of 18 years (SD: 10) of clinical experience and saw a median of 75 discrete patients per week (IQR: 125). Table 1 provides patient demographics. The average age of patients was 50 years (SD: 18), were more commonly female (62.5%), presented with MSK conditions (i.e., neck/back pain and/or extremity pain) (75.7%), and 24.3% reported the reason for their visit as “no condition/preventative care”.

Tables 2 and 3 provide the incidence of AEs as reported by the patients and providers as new or worsening symptoms, and if self-reported, provider-reported, or identified from increased severity between T0 and T2. The overall incidence for all AEs was 21.3% per patient visit (n = 455/2136); the incidence of AE decreased to 6.3% (n = 12) in individuals with no prior symptoms, i.e., those who sought care for prevention/wellness with no presenting pain. Of all AEs reported, 7.9% (n = 168) were rated as mild in severity; 6.2% (n = 133) as moderate; 3.7% (n = 80) as severe; 1.5% (n = 33) as serious; and missing information did not allow for determining severity rating in 2.0% (n = 41). The majority of AEs were self-reported by the patient as worsening symptoms after the patient visit.

As shown in Figure 2, discomfort/pain and stiffness were the most common AEs (n = 152 and n = 87, respectively) with moderate, severe, and/or serious severity classification. These symptoms were usually reported as a worsening (i.e., pre-existing) symptom. The symptom reported least often was dizziness (n = 5); however, when it was reported, it was reported by the patient as worsening and as serious (i.e., led to hospitalization).

The T1 form, which was completed by the provider immediately following the treatment visit, identified 127 AEs, of which 25 were rated by the provider as moderate, severe, or serious. Of these, only 13 (52.0%) had the provider long form completed as per protocol by 8 providers. Consensus from content experts was that all 13 AEs were mild; therefore, were not further assessed for causality/relatedness, preventability, or patient disposition. Providers failed to complete the provider long form as per the study protocol for 12 AEs (48.0%) they reported as moderate or severe; these AEs could not be further assessed by the adjudication committee as insufficient information was available.

The frequency of AEs reported on T1 were less among patients who did not return T2 compared to the patients who did (8.7% vs. 11.5%). Patients whose symptoms were less severe at T0 or improving at T1 trended towards not returning the T2 form. The observed evidence indicated AE data were not missing at random; as such, the two-step imputation procedure was conducted. Based on the multiple imputed data sets, the incidence of AEs was estimated to be 12.3% (95% CI: 11.2%–13.3%).

The assessment of possible bias due to patients not returning T2, found that there were four variables, after adjusting for all variables, to be statistically associated with the patient returning of T2:

1)   for each additional potential risk factor (i.e., patient’s T0 demographic and health history information) a patient’s odds of returning the T2 increased by 16% (95% CI: 1.06, 1.27);

2)   for each decreased number of patients that the provider saw per hour, the odds of the participating patient returning the T2 increased by 5% (95% CI: 1.02, 1.10);

3)   for each additional year the provider was in practice, the odds of the patient returning their T2 increased by 3% (95% CI: 1.02, 1.04); and

4)   the increased number of manipulation (high-velocity, low-amplitude or grade 5 mobilization) versus mobilization (grade 1–4) or other treatments given at the visit, the odds of the patient returning T2 decreased by 2% (95% CI: 0.96, 1.00).



Discussion

We found almost a fifth of patient visits to a chiropractor or physiotherapist reported an AE. These visits were primarily for MSK conditions (75.7% of presenting patients) and the majority of the AEs were of mild or moderate severity. The incidence of AEs reported in our study was lower than the 30%-50% reported in a recent scoping review of 250 observational and experimental studies of manual treatments of the spine. [10] Specifically, in 1996, a similar prospective clinic-based survey collected data from 4,712 encounters from Norwegian chiropractors found that 55% of these encounters had an AE. [34] In 2003, 280 patients in a clinical trial of chiropractic care for patients with neck pain found that 30% reported an AE. [14] In 2013, the Scandinavian College of Naprapathic Manual Medicine in Stockholm collected AE information from 767 patients and found that 51% of those who had at least 3 SMT treatments reported an AE. [35]

There are many potential reasons for the differences in AE rates reported in studies. One is the heterogeneity in data collection including the timing of when AE information was sought. Prior to the start of our study, participating stakeholders recommended collecting AE information from the provider immediately after treatment but to not ask the patient until at least 48 hours later as it was felt that asking about AE immediately after treatment would identify common mild AEs that were expected after manual therapy and potentially deter providers from participating in the study. Other potential sources of heterogeneity include different levels and standards of training among the providers, the conditions for which patients sought care, cultural differences in reporting AE and litigation, differences in provider-patient communication/relationship, and use of nomenclature. Existing guidelines for creating optimal AE registries include the need to have standard nomenclature to code AEs to ensure accuracy and consistency, in addition to a systematic data collection system so that all AEs can be evaluated in a consistent and contemporaneous manner. [36]

In regard to the severity classification, Swait & Finch’s scoping review found that most of the AEs following manual treatments were transient and mild in nature. [10] Similarly, Senstad et al. described 85% of the AEs as mild or moderate. [34] In contrast, the severity mean range reported by Hurwitz et al. was between 1.0–6.0 (0–10 numerical scale) [14], while Paanalahti et al. reported the majority of the reports as ‘short minor’. [35] Our study found that 7.9% were mild, with moderate or higher rated severity occurring with a frequency of 11.4%, which is lower than those reported by Senstad et al. 1997, but higher than those reported by Paanalahti et al. 2014. Heterogeneity in how severity classification information is collected and synthesized can impact comparability between studies. For transparency and comparability with future studies, we used case definitions to determine both new and worsening AEs, as well as a series of questions to determine severity.

It is important to consider AE profiles for other common treatments used for MSK conditions, such as aspirin, NSAIDS, and opioids. Daily aspirin use has a range of AE from mild (e.g., minor bruising) to severe (e.g., gastrointestinal bleeding) [37] and NSAIDS range of AE symptoms include cardiovascular issues, kidney injuries, and intestinal bleeding. [38] The harms associated with opioids have also been well described, including addiction and death. [38]

The participating provider and patients in our study had similar demographic characteristics to those reported in a recent description of chiropractors’ and physiotherapist practice profiles in Canada. [39, 40] The chiropractic practice profile study had an average of 15 years of experience and in our study, the mean years of experience was 18. While the physiotherapist profile did not directly report the years of experience, the proportion of practicing physiotherapist less than 50 years of age was 36.8%. The average patient in Mior et al., was between 45–64 years of age and female (59%) [39], Sutherland reported the largest age group was 45–59 years of age with no report on sex [40], and in our study the average age was 50.0 (SD: 18) and most commonly female (62.5%). The most common reason for seeking care or diagnoses were back pain and neck pain in both Mior et al. and our study. Thus, our findings may be generalizable to other chiropractors and physiotherapists practicing in similar jurisdictions.

Although considered rare, serious AEs, such as disc herniations, spinal cord injuries, dural tears with intracranial hypotension, phrenic nerve paralysis, or cauda equina, have been reported after SMT. [10] Implementation of established reporting systems for popular interventions, such as SMT, would allow for rigorous prospective data collection, real-time investigation, and new learning opportunities. These reporting systems, also known as active surveillance systems, are often used with immunization programs and with drugs/devices in acute care. With enhanced electronic health record capacity, surveillance opportunities have increased, which can contribute to increasing intervention safety profile and public confidence, especially if used at a community-based level with multiple disciplines. [41] Identification of serious rare AEs could be enhanced through linkage between electronic health record data (e.g., linkage between community-based records and hospitalization data), which currently do not exist in Canada or the USA.

The SafetyNet Reporting System has been successfully used in chiropractic pediatric offices and a chiropractic teaching clinic. [25, 26] For the pediatric population seeking care within chiropractic offices for mostly MSK conditions, the overall incidence of AEs was found to be 8.8% (95% CI 6.72% to 11.18%) from 1,179 unique pediatric (<14 years of age) patients. [26] Within the chiropractic teaching clinics, the AE incidence rate following patient visit was found to be 8.9% in a small sample of 89 patients seeking care for mostly MSK conditions. [25] While the AE incidence reported in these previous studies are slightly lower than that reported in our current study, both studies had smaller sample sizes and represented different clinical populations and settings. With the need for more community-based methods to enhance patient safety, including improving the identification and reporting of adverse events, future studies could model the SafetyNet Reporting System to assess incidence of AEs in other parts of the world, other treatment modalities, and other populations.

As one of the first and largest prospective evaluation of AEs following a chiropractic or physiotherapist visit, our study has an additional notable strength. A common limitation in patient safety literature is the lack of a priori definitions for AEs and severity classifications. [42] Throughout the literature, when these definitions are given, there is a vast range of descriptors with a lack of consistency both in terms of use and application, which impedes aggregating patient safety data for a more comprehensive picture. [43, 44] The definition used in our study was deliberately chosen to be conservative in nature, as determined by the multidisciplinary team of patient safety and SMT content experts to enhance confidence in study findings. [23] While more work is needed to develop standardized definitions for AEs among all SMT providers and is underway [45], this study demonstrates the successful implementation of a system to identify and collect AE data and classify according to agreed upon a priori definitions.

Another safety incident reporting system implemented specifically in the chiropractic profession, the chiropractic patient incident reporting and learning system (CPiRLS), was launched in 2009 in the United Kingdom. [46] A recent analysis of the incidents reported to CPiRLS since its launch found that this passive surveillance methodology had an extremely low number of incidents reported, which was similar to the cluster RCT that compared SafetyNET active surveillance to CPiRLS. [25] Passive surveillance may not be adequate to improve the identification and reporting of potential harms. However, CPiRLS identifies and disseminates key areas for patient safety improvement, which is an important part of patient safety. [46] CPiRLS also allows for indirect incidents to be reported, which are also vital to support a patient safety culture. Future endeavors to reporting incidents should continue to explore use of active and passive reporting system for both direct and indirect incidents.

Since our study is observational, we focused on association rather than causation. This distinction is particularly important for conditions with chronic and/or recurrent symptoms, such as musculoskeletal (MSK) disorders. Natural variation in MSK conditions (i.e., fluctuations in symptoms regardless of treatment) may be incorrectly attributed to treatment. Despite this limitation, systematic and meticulous documentation and thoughtful analysis of observational data, is the foundation of advancing patient safety research. As a result, we feel the results from this study will help advance the field as it demonstrated successful data collection in multi-disciplinary community-based settings.

Our study methodology did not allow for comparison of patient and provider AE reports, as they were measured at different time points. Additionally, while patients were asked to complete the 2–7 days post-treatment [T2] assessment before their next treatment visit, this was not monitored and not all patients provided adequate information to allow for AE severity to be determined, specifically,1,683 participants due to missing T2 form. As stated in the results, the forms were not missing at random, likely associated with less severe symptoms or improving patients. The missing data likely biased the estimation of AE upward as shown on the pragmatic two-step imputation approach. The imputed data suggested lower percentage of AE than observed data (12.3% vs 21.3%). Also, our sample size may not have been sufficient to capture serious rare AEs. Finally, the measurement properties of instruments developed for this study were evaluated for content validity only. While this has been found to be the most important measurement property [24], further assessment of how best to assess change in symptoms should be conducted to minimize recall bias and maximize accuracy.



Conclusions

Our community-based active surveillance study found the incidence of AEs following chiropractic or physiotherapy patient encounters to be 21.3%. Of these AE reports, the severity classifications were noted as:

mild   (7.9%),
moderate   (6.2%),
severe   (3.7%),
serious   (1.5%), and
missing severity responses   (2.0%).

This innovative and novel study provides valuable information for clinicians and patients and serves as a framework to more fully understand post-visits AEs more fully and potential strategies to mitigate them.


Acknowledgments

We wish to thank all the participating providers and their patients. This study could not have been done without their support. We also acknowledge the numerous support personnel who ensured that providers were recruited, and data was collected accurately.


Funding

The study was Canadian Institutes of Health Research, Alberta Innovates – Health Solutions, and the generosity of the Stollery Children’s Hospital Foundation and supporters of the Lois Hole Hospital for Women through the Women and Children’s Health Research Institute. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.


Competing interests

The authors have declared that no competing interests exist


Data Availability:

Data cannot be shared publicly because ethics approval did not include this nor did participant consent to this.

Data are available from the Parker University Research Repository (accessed via
https://my.parker.edu/ICS/Research/Research_Data_Repository.jnz)
for researchers who meet the criteria for access to confidential data.



References:

  1. Kohn KT, Corrigan JM, Donaldson MS, eds
    Committee on Quality Health Care in America.
    To Err Is Human: Building a Safer Health System
    Washington, DC: National Academies Press 1999.

  2. Aspden P, Wolcott J, Bootman JL, Cronewett LR.
    Preventing Medication Errors: Quality Chasm Series.
    Washington, DC: National Academies Press 2007.

  3. Mitchell I, Schuster A, Smith K, Pronovost P, Wu A.
    Patient safety incident reporting: a qualitative study of thoughts
    and perceptions of experts 15 years after “To Err is Human.”
    BMJ Qual Saf 2016;25:92–9.

  4. Nsubuga P, White ME, Thacker SB, Anderson MA, Blount SB, Broome CV, et al.
    Public Health Surveillance: A Tool for Targeting and Monitoring Interventions.
    In: Jamison DT, Breman JG, Measham AR, et al., editors.
    Disease Control Priorities in Developing Countries. 2nd edition.
    Washington, DC: The International Bank for Reconstruction and Development /
    The World Bank; 2006. Chapter 53.
    https://www.ncbi.nlm.nih.gov/books/NBK11770/
    Co-published by Oxford University Press, New York.

  5. Oliver D.
    Are comparisons between acute healthcare and the aviation industry invidious?
    BMJ 2018;361:k2203.

  6. Neuspiel DR, Stubbs EH.
    Patient safety in ambulatory care.
    Pediatr Clin North Am. 2012;59(6):1341–1354.
    pmid:23116530

  7. Ghavamabad LH, Vosoogh-Moghaddam A, Zaboli R, Aarabi M.
    Establishing clinical governance model in primary health care:
    A systematic review.
    J Educ Health Promot 2021;10:338.
    pmid:34761024

  8. Halligan A, Donaldson L.
    Implementing clinical governance: turning vision into reality.
    BMJ 2001;322(7299):1413–1417.
    pmid:11397753

  9. Cassidy JD, Côté P, Carroll LJ, Kristman V.
    Incidence and course of low back pain episodes in the general population.
    Spine (Phila Pa 1976) 2005;30(24):2817–23.
    pmid:16371911

  10. Swait G, Finch R.
    What Are the Risks of Manual Treatment of the Spine?
    A Scoping Review for Clinicians

    Chiropractic & Manual Therapies 2017 (Dec 7); 25: 37

  11. Christensen MG, Hyland JK, Goertz CM, et al.
    Practice Analysis of Chiropractic 2015
    Greeley, CO: National Board of Chiropractic Examiners; 2015.

  12. Majkowski GR, Gill MW,
    Physical Therapy Modalities: The Sports Medicine Resource Manual, 2008
    https://www.sciencedirect.com/topics/nursing-and-health-professions/physiotherapy
    (last accessed 07.08.2021).

  13. Walker BF, Hebert JJ, Stomski NJ, Clarke BR, Bowden RS, Losco B, et al.
    Outcomes of Usual Chiropractic. The OUCH
    omized Controlled Trial of Adverse Events

    Spine (Phila Pa 1976). 2013 (Sep 15); 38 (20): 1723–1729

  14. Hurwitz EL, Morgenstern H, Vassilaki M, Chiang LM.
    Adverse reactions to chiropractic treatment and their effects on
    satisfaction and clinical outcomes among patients enrolled
    in the UCLA neck pain study.
    J Manipulative Physiol Ther 2004;27(1):16–25.
    pmid:14739870

  15. Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al., editors.
    Cochrane Handbook for Systematic Reviews of Interventions. 2nd Edition.
    Chichester (UK): John Wiley & Sons, 2019.

  16. Carlesso LC, Gross AR, Santaguida PL, Burnie S, Voth S, Sadi J.
    Adverse events associated with the use of cervical manipulation and
    mobilization for the treatment of neck pain in adults:
    a systematic review.
    Man Ther 2010;15(5):434–44.
    pmid:20227325

  17. Rubinstein SM.
    Adverse Events Following Chiropractic Care for Subjects
    with Neck or Low-back pain: Do the Benefits
    Outweigh the Risks?
    BR> J Manipulative Physiol Ther. 2008 (Jul); 31 (6): 461–464

  18. Cagnie B, Vinck E, Beernaert A, Cambier D.
    How Common Are Side Effects of Spinal Manipulation
    And Can These Side Effects Be Predicted?

    Manual Therapy 2004 (Aug); 9 (3): 151–156

  19. Assendelft WJJ, Bouter LM, Knipschild PG.
    Complications of spinal manipulation.
    J Fam Pract 1996;42(5):475–80.

  20. Cassidy JD, Boyle E, Cote P, He Y, Hogg-Johnson S, Silver FL, et al.
    Risk of Vertebrobasilar Stroke and Chiropractic Care:
    Results of a Population-based Case-control
    and Case-crossover Study

    Spine (Phila Pa 1976) 2008 (Feb 15); 33 (4 Suppl): S176–183

  21. Kosloff TM, Elton D, Tao J, Bannister WM.
    Chiropractic Care and the Risk of Vertebrobasilar Stroke:
    Results of a Case-control Study in U.S. Commercial
    and Medicare Advantage Populations

    Chiropractic & Manual Therapies 2015 (Jun 16); 23: 19

  22. Vohra S, Kawchuk GN, Boon H, Caulfield T, Pohlman KA, O’Beirne M.
    SafetyNET: An interdisciplinary research program to support
    a safety culture for spinal manipulation therapy.
    Eur J Integr Med 2014;6.

  23. Pohlman KA, O’Beirne M, Thiel H, Cassidy JD, Mior S, Hurwitz E, et al.
    Development and Validation of Providers’ and Patients’
    Measurement Instruments to Evaluate Adverse Events
    After Spinal Manipulation Therapy

    Eur J Integr Med. 2014 (Aug); 6 (4): 451–466

  24. Terwee CB, Prinsen CAC, Chiarotto A, Westerman MJ, Patrick DL, Alonso J, et al.
    COSMIN methodology for evaluating the content validity of
    patient-reported outcome measures: a Delphi study.
    Qual Life Res 2018;27:1159–70.
    pmid:29550964

  25. Pohlman KA, Carroll L, Tsuyuki R, Hartling L, Vohra S.
    Comparison of active vs. passive surveillance adverse event reporting
    in a pediatric ambulatory chiropractic care setting:
    a cluster randomized controlled trial.
    BMJ Qual Open 2020 Nov;9(4):e000972.

  26. Pohlman KA, Funabashi M, Ndetan H, Hogg-Johnson S, Bodnar P, Kawchuk G.
    Assessing adverse events after chiropractic care at a chiropractic
    teaching clinic: an active surveillance pilot study.
    J Manipulative Physiol Ther 2020;43(9):845–854.
    pmid:32863058

  27. Guidelines for Developing a Manual of Operations and Procedures (MOP)
    National Center for Complementary and Integrative Health

  28. Baker GR, Norton P.
    Making patients safer! Reducing error in Canadian health care.
    Healthc Pap 2001;2(1):10–31.
    pmid:12811154

  29. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG.
    Research electronic data capture (REDCap)– A metadata-driven methodology
    and workflow process for providing translational research informatics support.
    J Biomed Inform 2009;42(2):377–81.
    pmid:18929686

  30. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al.
    REDCap Consortium, The REDCap consortium: Building
    an international community of software partners.
    J Biomed Inform, May 9, 2019.
    pmid:31078660

  31. Brand J.P.L.
    Development, Implementation and Evaluation of Multiple Imputation
    Strategies for the Statistical Analysis of Incomplete Data Sets.
    Thesis Erasmus University Rotterdam—with summary in dutch.
    ISBN: 90-74479-08-1.

  32. Rubin DB.
    Multiple Imputation for Nonresponse in Surveys.
    First published:9 June 1987. Print ISBN:9780471087052.
    Online ISBN:9780470316696.10.1002/9780470316696.

  33. van Buuren S.
    Multiple imputation of discrete and continuous data by
    fully conditional specification.
    Stat Methods Med Res 2007;16(3):219–242.
    pmid:17621469

  34. Senstad O, Leboeuf-Yde C, Borchgrevink C.
    Frequency and characteristics of side effects of spinal manipulative therapy.
    Spine (Phila Pa 1976) 1997;22: 431–435. pmid:9055373

  35. Paanalahti K, Holm LW, Nordin M, Sker M, Lyander J, Skillgate E.
    Adverse events after manual therapy among patients seeking care for
    neck and/or back pain: a randomized controlled trial.
    BMC Musculoskelet Disord 2014;15:77. pmid:24618345

  36. Gliklich RE, Dreyer NA, Leavy MB, editors.
    Registries for Evaluating Patient Outcomes: A User’s Guide [Internet].
    3rd edition. Rockville (MD): Agency for Healthcare Research
    and Quality (US);
    2014 Apr. 12, Adverse Event Detection, Processing, and Reporting.
    https://www.ncbi.nlm.nih.gov/books/NBK208615/

  37. Stegeman I, Bossuyt PM, Yu T, Boyd C, Puhan MA.
    Aspirin for Primary Prevention of Cardiovascular Disease and Cancer.
    A Benefit and Harm Analysis.
    PLoS One 2015;10(7):e0127194.
    pmid:26151751

  38. Fassio V, Aspinall SL, Zhao X, Miller DR, Singh JA, Good CB, Cunningham FE.
    Trends in opioid and nonsteroidal anti-inflammatory use and adverse events.
    Am J Manag Care 2018 Mar 1;24(3):e61–e72.
    pmid:29553279

  39. Mior S, Wong J, Sutton D, Beliveau PJH, Bussieres A, Hogg-Johnson S, et al.
    Understanding patient profiles and characteristics of current
    chiropractic practice: a cross-sectional Ontario
    Chiropractic Observation and Analysis STudy (O-COAST).
    BMJ Open 2019;9(8):e029851.
    pmid:31455707

  40. Sutherland, Greg.
    The Market Profile of Physiotherapists in Canada.
    Ottawa: The Conference Board of Canada, 2017

  41. Wachter RM, Gupta K.
    Understanding Patient Safety, 3e; 2017
    http://mhmedical.com/ Copyright © 2018 McGraw-Hill Education.

  42. Rajendran D, Bright P, Bettles S, Carnes D, Mullinger B.
    What puts the adverse in ‘adverse events’? Patients’ perceptions of
    post-treatment experiences in osteopathy–
    a qualitative study using focus groups.
    Man Ther 2012;17(4):305–11.
    pmid:22425134

  43. Tabell V, Tarkka IM, Holm LW, Skillgate E.
    Do adverse events after manual therapy for back and/or neck pain have
    an impact on the chance to recover? A cohort study.
    Chiropr Man Therap 2019;27,27.
    pmid:31205681

  44. Funabashi M, Gorrell LM, Pohlman KA, Bergna A, Heneghan NR.
    Definition and Classification for Adverse Events Following
    Spinal and Peripheral Joint Manipulation and Mobilization:
    A Scoping Review

    PLoS One 2022 (Jul 15); 17 (7): e0270671

  45. Funabashi M, Pohlman KA, Gorrell LM, et al.
    Expert Consensus on a Standardized Definition and Severity Classification
    for Adverse Events Associated with Spinal and Peripheral Joint
    Manipulation and Mobilization: Protocol for an
    International e-Delphi Study.
    BMJ Open 2021;11(11):e050219.

  46. Thomas M., Swait G. & Finch R.
    Ten years of online incident reporting and learning using CPiRLS:
    implications for improved patient safety.
    Chiropr Man Therap 31, 9 (2023).
    pmid:36793096

Return to ADVERSE EVENTS

Since 8-21-2024

                  © 1995–2024 ~ The Chiropractic Resource Organization ~ All Rights Reserved