ACADEMIC EMERGENCY MEDICINE 2012; 19:640–649 © 2012 by the Society for Academic Emergency Medicine
Objectives: Adverse drug events (ADEs) are unintended and harmful consequences of medication use. They are associated with high health resource use and cost. Yet, high levels of inaccuracy exist in their identification in clinical practice, with over one-third remaining unidentified in the emergency department (ED). The study objective was to derive clinical decision rules (CDRs) that are sensitive for the detection of ADEs, allowing their systematic identification early in a patient’s hospital course.
Methods: This was a prospective observational cohort study carried out in two Canadian tertiary care hospitals. Participants were adults presenting to the ED having ingested at least one prescription or over-the-counter medication within 2 weeks. Nurses and physicians evaluated patients for standardized clinical findings. A second evaluator performed interobserver assessments of predictor variables in a subset of patients. Pharmacists, who were blinded to the predictor variables, evaluated all patients for ADEs. An independent committee reviewed and adjudicated cases where the ADE assessment was uncertain or the pharmacist’s diagnosis differed from the physician’s working diagnosis. The primary outcome was an ADE that required a change in medical therapy, diagnostic testing, consultation, or hospital admission. CDRs were derived using kappa coefficients, chi-square statistics, and recursive partitioning.
Results: Among 1,591 patients, 131 (8.2%, 95% confidence interval [CI] = 7.0% to 9.7%) were diagnosed with the primary outcome. The following variables were associated with ADEs and were used to derive two CDRs: 1) presence of comorbid conditions, 2) antibiotic use within 7 days, 3) medication changes within 28 days, 4) age ≥80 years, 5) arrival by ambulance, 6) triage acuity, 7) recent hospital admission, 8) renal failure, and 9) use of three or more prescription medications. The more sensitive rule had a sensitivity of 96.7% (95% CI = 91.8% to 98.6%) and required 40.8% (95% CI = 37.7% to 42.9%) of patients to have medication review. The more specific rule had a sensitivity 90.8% (95% CI = 81.4% to 95.7%) and required 28.3% of patients to proceed to medication review.
Conclusions: The authors derived CDRs that identified patients with ADEs with high sensitivity. These rules may improve the identification of ADEs early in a patient’s hospital course while limiting the number of patients requiring a detailed medication review.
It has been estimated that up to 23,750 Canadians die each year as a result of preventable adverse events related to medical care.1 This figure is eight times higher than the number of motor vehicle fatalities in Canada over the same time period.2 Of deaths related to adverse events, those related to medication use are the most common.3–6
Adverse drug events (ADEs) are unintended and harmful consequences of medication use. ADEs to outpatient medications account for up to one in nine emergency department (ED) visits in North America and for a large proportion of emergency hospital admissions.7–12 Recent data demonstrate that patients presenting to the ED with ADEs spend more days in the hospital, incur more outpatient health care encounters, and have higher health care costs after adjustment for known confounders, compared with other patients.13
Yet, despite the frequency of ADEs and their association with high health resource use, ADEs are commonly misdiagnosed in the ED.9,14 Estimates suggest that physicians misdiagnose 37% to 49% of presentations ultimately deemed medication-related.9,14,15 In one large prospective study, over half of these patients were discharged home without a medication review by a pharmacist.14 Lack of ADE identification, treatment, and documentation during the clinical encounter in the ED may contribute to the morbidity and health care cost associated with these events.13,15–19
Clinical pharmacists are a scarce and expensive resource, making routine screening of ED patients by pharmacists untenable.20–22 Even in centers that have access to ED pharmacists, there are no evidence-based criteria to assist pharmacists in identifying the highest-risk patients to optimize the use of their time, while ensuring that the majority of significant ADEs are identified. In centers with access to in-hospital pharmacists, long delays to inpatient services often exist, leading to inappropriate delays to the diagnosis of ADEs.23,24
The objective of this study was, therefore, to derive clinical decision rules (CDRs) that would identify patients at high risk for ADEs to improve early identification and treatment while limiting the number of patients requiring medication review by a pharmacist or another medication specialist.
This was a prospective cohort study conducted in two Canadian tertiary care teaching hospitals (Vancouver General Hospital and St. Paul’s Hospital, Vancouver, British Columbia) with a combined annual ED census of 135,000 patients. The study protocol was approved by the University of British Columbia Clinical Research Ethics Board and registered with ClinicalTrials.gov (NCT00727610).
Selection of Participants
Patients presenting to the EDs of participating institutions between July 2008 and January 2009 were eligible for enrollment. Data collection shifts were stratified by time of day (00:00 to 07:59, 08:00 to 15:59, and 16:00 to 23:59) and day of the week and scheduled proportional to the volume of patients who had presented during the same time interval in the prior year. We applied a systematic selection algorithm to ensure enrollment of a representative sample during data collection shifts (Data Supplement S1, available as supporting information in the online version of this paper).12
Patients 19 years of age or older who reported using at least one prescription or over-the-counter medication in the 2 weeks prior to presentation, and who spoke English or had a translator available, were eligible for enrollment. Patients were excluded if they exhibited violent behavior, presented with an intentional self-poisoning, were previously enrolled, presented for a scheduled revisit, were transferred directly to an admitting service, or left against medical advice or prior to seeing the physician or pharmacist.
After patients were enrolled, research assistants placed colored data collection forms containing potential predictor variables on top of the patients’ charts (Data Supplement S2, available as supporting information in the online version of this paper). Potential predictor variables were generated from a literature review, consultation with experts, and previous studies on ADEs.11 ED nurses and physicians filled out data collection forms at the beginning of each patient encounter. Forms were filled out by two nurses and two physicians on a convenience sample of patients to measure the interreliability of potential predictor variables. Data collection forms were then removed from patient charts.
Residency-trained clinical pharmacists (FH, CA, and WC) collected demographic and clinical information from patients and treating emergency physicians (EPs) and by chart review. They verified medication histories using PharmaNet, a province-wide prescription-filling database. All admitted patients were followed until discharge. Consenting patients were contacted after discharge by telephone when the pharmacists believed further follow-up was necessary.
Our case finding methods are described in detail in Data Supplement S3 (available as supporting information in the online version of this paper).12–14 Briefly, after completion of data collection, the pharmacists evaluated whether or not the patient’s ED visit was due to an ADE using three standardized causality algorithms (see Definitions, next paragraph).4,25,26 Inter-rater reliability of the pharmacists’ assessment algorithm was evaluated and reported. Research assistants then interviewed the patient’s treating physician using a standardized questionnaire to determine the physician’s working diagnosis (Data Supplement S4, available as supporting information in the online version of this paper). When the physician and pharmacist determinations of a patient’s diagnosis were concordant, this was considered the criterion standard. If there was disagreement, or if either of them were uncertain, an independent committee adjudicated the case using a previously developed algorithm.12
Outcome Measures and Definitions
Varying case definitions of ADEs are used in clinical practice.3,6,27,28 To derive CDRs that would meet the needs of clinicians, one rule was derived for each of the two commonly used definitions. The primary outcome, an ADE, was defined as an “untoward and unintended event arising from the use of prescription or over-the-counter medications.”3,6,27 To meet the primary outcome definition, the ADE had to be classified as either an adverse drug reaction or an adverse event due to nonadherence, a prescription error, drug withdrawal, or a drug interaction. The secondary outcome, an adverse drug reaction, was “a response to a drug that is noxious and unintended, and occurs at doses normally used in man for the prophylaxis, diagnosis, or therapy of disease.”3 All adverse drug reactions are ADEs; in other words, adverse drug reactions are a subset of ADEs.
The severities of all ADEs and ADRs were rated: 1) a severe event caused death or required admission; 2) a moderate event required a change in medical management (medical therapy, a diagnostic procedure or consultation); and 3) a mild event required no change in therapy.12 To meet either outcome definition, the event had to be at least moderate in severity.
To derive CDRs with stable test performance characteristics, we compared the potential predictor variables collected by two nurses and two physicians and measured the inter-rater agreement using intraclass correlation and kappa coefficients. Weighted kappas were calculated for variables with three or more ordinal categories. We selected potential predictor variables with substantial inter-rater agreement (kappa score ≥ 0.6) and subsequently included variables with moderate inter-rater agreement (kappa score ≥ 0.5) in the recursive partitioning tree. We used univariate odds ratios (OR), chi-square tests, or Fisher’s exact tests for categorical variables and Student’s t-tests for continuous variables to determine the strength of association between the potential predictor variables and the outcomes to identify the best potential predictor variables. The reliability of the outcome measure was calculated using Fleiss’ extension for multiple raters and reported using kappa scores.29
We used recursive partitioning analysis to derive the prediction rules.30 Patients for whom data were missing were excluded from the analysis to avoid the use of surrogate variables or data imputation. Our goal was to derive parsimonious rules that made clinical sense and led to the greatest possible reduction in unnecessary medication review while maintaining an a priori defined minimal threshold for sensitivity of 95% for our primary outcome measure (determined by a national survey of EPs).20 A rule for the secondary outcome measure with high specificity was desired for EDs with limited pharmacist resources to enhance feasibility and uptake. To meet this goal, an a priori defined minimal threshold for sensitivity of 90% for the secondary outcome measure was set. More details on the parameters used to build the decision trees are listed in Data Supplement S5 (available as supporting information in the online version of this paper).
The sensitivity and specificity with 95% confidence intervals (CIs) were calculated for each of the derived rules. We also determined the proportion of patients expected to proceed from screening to medication review with each of the rules.
The sample size calculation was based on 1) the median desired sensitivity of the rule for the primary outcome definition (of ≥95%) derived from a national survey of EPs;20 2) the desired precision of the sensitivity estimate, based on 95% CIs of ±5%; and 3) the estimated prevalence of the primary outcome measure using an estimated prevalence of moderate and severe ADEs meeting the primary outcome definition for this study of 8.8%, derived from our previous work.12 Based on these estimates, we required a sample of 130 events, to derive a rule with a target sensitivity of 95.4% (95% CI = 90.3% to 97.8%). This yielded a sample size requirement of 1,480 patients.
We approached 2,289 ED patients and enrolled 1,591 (Figure 1). The mean (±SD) age of enrolled patients was 51.4 (±20.3) years, and 50.9% were female (Table 1). The median number of prescribed medications was 2 (interquartile range [IQR] = 1 to 5).
|Patient Characteristic||All Patients (N = 1,591)|
|Mean age, yr (±SD)||51.4 (±20.3)|
|ED treatment location*|
|Acute care area of ED||749 (47.2)|
|Minor care area of ED||839 (52.8)|
|Nursing home||65 (4.1)|
|CTAS 1||6 (0.4)|
|CTAS 2||227 (14.3)|
|CTAS 3||703 (44.2)|
|CTAS 4||583 (36.6)|
|CTAS 5||72 (4.5)|
|Most common chief complaints|
|Abdominal pain||164 (10.3)|
|Chest pain||117 (7.4)|
|Shortness of breath||101 (6.3)|
|Most common comorbid conditions|
|Median no. of comorbid conditions (IQR)||2 (1–3)|
|Most common prescription medications|
|Acetaminophen and codeine||197 (12.4)|
|Median no. of prescription medications (IQR)†||2 (1–5)|
|Complementary medication use*||173 (11.0)|
|OTC medication use*||1101 (69.8)|
|Alcohol use ≥2 drinks/day*||174 (11.1)|
|Illicit drug use*||194 (12.4)|
|General practitioner*||1358 (86.2)|
|Median no. of prescribing physicians (IQR)*||1 (1–2)|
|Disposition from ED*|
The inter-rater reliability of the pharmacist assessment of ADE was 0.75 (95% CI = 0.52 to 0.98). Among enrolled patients, 131 (131/1,591; 8.2%, 95% CI = 7.0% to 9.7%) were diagnosed with 134 moderate or severe ADEs that met the primary outcome definition (Table 2 and Data Supplement S6, available as supporting information in the online version of this paper). Of these, 65 patients (4.1%, 95% CI = 3.2% to 5.2%) were diagnosed with one or more moderate or severe adverse drug reactions meeting the secondary outcome definition. Sixty-five patients were diagnosed with ADEs due to nonadherence (4.1%, 95% CI = 3.2% to 5.2%), and one patient (0.06%, 95% CI = 0.01% to 0.3%) had a drug interaction.
|Characteristics of ADEs||Number (%)|
|Relationship to chief complaint|
|Chief complaint-related||94 (70.1)|
|Incidentally found||40 (29.9)|
|Adverse drug reactions||68 (50.7)|
|Noncompliance or drug withdrawal||65 (48.5)|
|Drug interactions||1 (0.75)|
|Most commonly implicated medications*|
|1. Acetaminophen and codeine||8 (6.0)|
|2. Hydrochlorothiazide||6 (4.8)|
|3. Olanzapine||6 (4.8)|
|4. Phenytoin||6 (4.8)|
|5. Aspirin||4 (3.0)|
|6. Carbamazepine||4 (3.0)|
|7. Glyburide||4 (3.0)|
|8. Warfarin||4 (3.0)|
|9. Prednisone||4 (3.0)|
|10. Ramipril||3 (2.2)|
|Most common medication classes*|
|1. Antihypertensives/diuretics||22 (16.4)|
|3. Psychotropic agents|
|4. Narcotic analgesics|
|5. Endocrinologic agents|
|8. Nonnarcotic analgesics|
|10. Antihyperglycemic agents|
Numerous variables were associated with ADEs and adverse drug reactions and had inter-rater reliability that is considered acceptable (κ > 0.6) using a common classification system (Tables 3 and 4).29 These included age, the number and type of comorbid conditions reported, illicit drug use, some medication classes, the mode of arrival to the ED, and recent hospitalization, antibiotic use, or medication changes. The use of opioids or benzodiazepines and renal failure were fairly reliable (κ = 0.5 to 0.6) and considered secondary candidate variables for entry into the rules.
|Potential Predictor Variables||Patients Without ADEs* (n = 1,460)||Patients With ADEs* (n = 131)||p-value†||ORs (95% CIs)‡|
|Mean age, yr (±SD)||51.1 (±20.2)||54.0 (±21.3)||0.12||1.01 (1.00–1.02)|
|Age cutoff ≥ 80 yr||171 (11.71)||27 (20.61)||0.0031||1.96 (1.24–3.07)|
|Female||753 (51.6)||57 (43.5)||0.077||0.72 (0.50–1.04)|
|CTAS 1||4 (0.3)||2 (1.5)|
|CTAS 2||210 (14.4)||17 (13.0)|
|CTAS 3||631 (43.2)||72 (55.0)|
|CTAS 4||547 (37.5)||36 (27.5)|
|CTAS 5||68 (4.7)||4 (3.1)|
|Creatinine ≥ 150 mmol/L (>1.7 mg/dl)||59 (7.7)||12 (12.2)||0.12||1.68 (0.87–3.25)|
|Potential predictor variables§|
|Use of OTC supplements||549 (51.1)||45 (45.5)||0.28||0.80 (0.53–1.21)|
|Use of herbal remedies||164 (15.3)||11 (10.9)||0.24||0.68 (0.35–1.30)|
|Use of recreational drugs||120 (11.1)||17 (17.2)||0.069||1.67 (0.96–2.91)|
|Taking opioids or benzodiazepines||353 (24.3)||49 (37.4)||0.001||1.86 (1.28–2.71)|
|Taking ASA or other salicylates||245 (16.8)||27 (20.6)||0.27||1.29 (0.82–2.01)|
|Taking anticoagulant/antiplatelet agent||102 (7.0)||14 (10.7)||0.12||1.59 (0.88–2.87)|
|Taking NSAID||323 (22.1)||23 (17.6)||0.22||0.75 (0.47–1.20)|
|Taking insulin/hypoglycemic agents||74 (5.1)||18 (13.7)||<0.0001||2.98 (1.72–5.17)|
|Taking antihypertensive/diuretics||362 (24.8)||57 (43.5)||<0.0001||2.33 (1.62–3.36)|
|Taking antiarrhythmics||68 (4.7)||9 (6.9)||0.26||1.51 (0.74–3.10)|
|Taking seizure medications||59 (4.0)||17 (13.0)||<0.0001||3.54 (2.00–6.27)|
|Taking chemotherapeutic agents||11 (0.75)||2 (1.5)||0.29||2.04 (0.45–9.29)|
|Number of prescribing physicians||<0.0001|
|At most one||717 (68.7)||43 (42.2)||0.33 (0.22–0.50)|
|Two or more||327 (31.3)||59 (57.8)|
|History of renal failure||54 (3.7)||13 (9.9)||0.0007||2.86 (1.52–5.40)|
|History of heart failure||54 (3.7)||14 (10.7)||0.0002||3.11 (1.68–5.77)|
|History of atrial fibrillation||66 (4.5)||10 (7.8)||0.099||1.77 (0.89–3.54)|
|History of diabetes||98 (6.7)||18 (13.7)||0.0030||2.21 (1.29–3.79)|
|History of cancer||78 (5.4)||7 (5.3)||1||1.00 (0.45–2.21)|
|History of HIV||30 (2.1)||7 (5.3)||0.028||2.69 (1.16–6.25)|
|History of psychiatric problems||201 (13.8)||39 (29.8)||<0.0001||2.64 (1.77–3.96)|
|Had a rash in the past 2 weeks||84 (7.7)||15 (14.7)||0.015||2.06 (1.14–3.72)|
|Had a seizure in the past 2 weeks||19 (1.8)||12 (11.8)||<0.0001||7.50 (3.53–15.95)|
|On ≥2 prescription medications||692 (47.4)||93 (71.0)||<0.0001||2.70 (1.85–4.00)|
|On ≥3 prescription medications||555 (38.0)||76 (58.0)||<0.0001||2.27 (1.56–3.22)|
|Ambulance arrival||356 (27.4)||57 (53.8)||<0.0001||3.09 (2.07–4.61)|
|Regular general practitioner||839 (86.1)||70 (81.4)||0.23||0.70 (0.40–1.25)|
|Last blood work||0.21|
|≤7 days||176 (18.9)||22 (26.8)|
|1–4 weeks||163 (17.5)||9 (11.0)|
|1–3 months||123 (13.2)||12 (14.6)|
|≥3 months||468 (50.3)||39 (47.6)|
|Hospitalized in the past 28 days||129 (8.9)||23 (17.6)||0.0014||2.17 (1.34–3.53)|
|Medication changes within 2 weeks||377 (26.1)||55 (42.0)||<0.0001||2.05 (1.42–2.96)|
|Compliant with prescription medication||668 (91.1)||61 (76.3)||<0.0001||0.32 (0.18–0.56)|
|On antibiotics in the last 7 days||191 (13.1)||28 (21.4)||0.0089||1.80 (1.15–2.80)|
|Medications blister packed||97 (10.4)||17 (20.2)||0.0062||2.19 (1.23–3.88)|
|Assistance in taking medications||193 (13.5)||28 (21.9)||0.0093||1.79 (1.15–2.80)|
|Presence of mental health issues||139 (14.2)||25 (28.7)||0.0003||2.44 (1.48–4.01)|
|Confusion||104 (10.5)||16 (18.0)||0.032||1.86 (1.05–3.32)|
|≥1 Comorbid conditions||1089 (74.6)||125 (95.4)||<0.0001||7.10 (3.10–16.24)|
|Potential Predictor Variables||κ/ICC (95% CI)†||Association With Outcomes (p-values)*|
|ADE‡||Adverse Drug Reaction§|
|Age (continuous variable)||1.00 (1 to 1)||0.12||0.0016|
|Age cutoff ≥ 80 years||1.00 (1 to 1)||0.0031||<0.0001|
|Use of OTC supplements||0.35 (0.13 to 0.58)||0.28||0.95|
|Use of herbal remedies||0.55 (0.30 to 0.80)||0.24||0.59|
|Use of recreational drugs||0.80 (0.58 to 1)||0.07||0.087|
|Taking opioids or benzodiazepines||0.59 (0.36 to 0.82)||0.001||0.046|
|Taking ASA or other salicylates||0.78 (0.58 to 0.99)||0.27||0.048|
|Taking anticoagulants or antiplatelet agents||0.83 (0.65 to 1)||0.12||0.0059|
|Taking NSAID||0.72 (0.51 to 0.92)||0.22||0.97|
|Taking insulin or hypoglycemic agent||1.00 (1 to 1)||<0.0001||0.011|
|Taking antihypertensive or diuretic||0.92 (0.81 to 1)||<0.0001||<0.0001|
|Taking antiarrhythmic||0.38 (–0.18 to 0.93)||0.26||0.13|
|Taking seizure medications||0.20 (–0.21 to 0.61)||<0.0001||0.12|
|Taking chemotherapeutic agents||0.00||0.29||0.42|
|Number of prescribing physicians||0.42 (0.18 to 0.66)||<0.0001||0.018|
|History of renal failure||0.51 (0.13 to 0.88)||0.0007||0.0049|
|History of heart failure||0.65 (0.28 to 1)||0.0002||0.0003|
|History of atrial fibrillation||0.55 (0.11 to 1)||0.099||0.12|
|History of diabetes||1.00 (1 to 1)||0.003||0.049|
|History of cancer||0.51 (0.13 to 0.88)||1||0.78|
|History of psychiatric problem||0.64 (0.42 to 0.85)||<0.0001||0.44|
|Had a rash in the past 2 weeks||0.29 (–0.04 to 0.62)||0.015||0.0022|
|Had a Seizure in the past 2 weeks||0.49 (–0.11 to 1)||<0.0001||0.38|
|On ≥2 medications||0.78 (0.62 to 0.93)||<0.0001||<0.0001|
|On ≥3 medications||0.84 (0.70 to 0.97)||<0.0001||<0.0001|
|Ambulance arrival||0.87 (0.73 to 1)||<0.0001||0.0037|
|Regular general practitioner||0.94 (0.82 to 1)||0.23||0.7|
|Last blood work||0.90 (0.82 to 0.98)||0.21||0.092|
|Last hospitalization in the past month||0.76 (0.54 to 0.98)||0.0014||0.0426|
|Medication changes in the past 28 days||0.61 (0.38 to 0.84)||<0.0001||<0.0001|
|Compliant with prescription medications||0.59 (0.41 to 0.76)||<0.0001||0.42|
|On antibiotics in the last 7 days||0.79 (0.56 to 1)||0.0089||0.0002|
|Medications blister packed||1.00 (1 to 1)||0.0062||0.44|
|Requires assistance taking medications||0.63 (0.30 to 0.96)||0.0093||0.031|
|Presence of mental health issues||0.70 (0.38 to 1)||0.0003||0.27|
|Confusion||0.73 (0.38 to 1)||0.032||0.47|
|No medical problems reported||0.91 (0.86 to 0.95)||<0.0001||0.0007|
We derived one CDR for each outcome measure. The CDR for the primary outcome, the ADE Rule, initially screened patients for low-risk criteria: lack of comorbid conditions and lack of recent antibiotic use (Figure 2). If both low-risk criteria were met, no further workup for ADEs was recommended. In patients failing either or both low-risk criteria, the following five high-risk criteria were used to screen patients further: a recent medication change, arrival by ambulance and high triage acuity, recent admission to the hospital, renal failure, or taking three or more prescription medications. Application of these criteria identified 116 of 120 ADEs, yielding a sensitivity of 96.7% (95% CI = 91.8% to 98.6%), and would have required medication review in 40.8% of patients.
The CDR for our secondary outcome measure was designed for use in EDs with more limited pharmacist resources, and a higher specificity was targeted (Figure 3). The Adverse Drug Reaction Rule screened patients using the same low-risk criteria first. If both were met, the patient required no further workup. If neither or only one were met, the patient required further screening based on two high-risk criteria: age >80 years and a medication change within 28 days. This rule identified 59 of 65 adverse drug reactions, yielding a sensitivity of 90.8% (95% CI = 81.3% to 95.6%), and required 28.3% of ED patients to be referred for medication review. None of the ADEs or adverse drug reactions missed by either rule caused permanent disability or were fatal. All missed events were associated with good outcomes (Tables 5 and 6).
|ID||Symptom||Culprit Medication||Comment||Treatment Required|
|2583||Shortness of breath||Fluticasone||27M had shortness of breath after being noncompliant with his inhaled steroids. This patient was treated in the ED and discharged. No alternate cause for the asthma exacerbation was identified.||Restarted on prior medications.|
|2603||High BP||HCTZ||82M with hypertension who stopped HCTZ 3 weeks ago. No alternate cause for his elevated blood pressure was identified.||Restarted on previous medications.|
|ID||Symptom||Culprit Medication||Comment||Treatment Required|
|336||Eye pain||Moxifloxacin (ophthalmic)||24M given moxifloxacin eye drops for viral conjunctivitis. Immediate increase in local irritation, swelling, and redness after using the drops. Diagnosed with a chemical keratitis.||Discontinuation of drug.|
|888||Palpitations||Yohimbe||23M presented with palpitations (resolved on arrival) and anxiety shortly after ingesting yohimbe, an over-the-counter stimulant and aphrodisiac. No alternate cause was identified.||Discontinuation of drug.|
|464||Rash||Hydrocortisone dibucaine||72F with extensive local contact dermatitis after application of the cream for hemorrhoids.||Discontinuation of drug.|
|649||Decreased LOC||Glyburide||62F with type II diabetes mellitus with decreased appetite from community-acquired pneumonia, continued to take her antihyperglycemic medication without dose adjustment despite decreasing in oral intake. Presented to the ED with glucose of 30 mg/dL.||Treated for hypoglycemia in the ED, and her medications adjusted.|
|970||Constipation||Oxycodone||70M with 3-day history of constipation while on oxycodone for lung cancer. On no bowel protocol.||Addition of laxatives to existing regimen.|
|2424||Feeling unwell||HCTZ||79M presented with difficulty urinating. Incidentally found to be hyponatremic (Na 124) secondary to HCTZ. No alternate cause identified.||Discontinuation of drug.|
To our knowledge, this is the first prospective study to develop CDRs to identify patients at high risk of ADEs and adverse drug reactions in the ED setting. We created decision rules that are clinically sensible, parsimonious, and based on standardized variables, many of which are collected as part of patient care. Either decision rule could easily be integrated into existing ED triage or bedside nursing assessments. Both are sensitive for the detection of clinically significant ADEs and adverse drug reactions and missed no fatal events in the derivation study. They both limited the number of patients requiring medication review, with the Adverse Drug Reaction Rule being less sensitive to facilitate implementation in centers with less pharmacist manpower.
After validation, use of either rule would allow ED nurses or physicians to effectively identify high-risk patients who require further scrutiny of their medication regimen and increase the proportion of patients with ADEs that are identified and treated early in their hospital course and prior to being sent home if they are discharged. The present inaccuracy in ADE identification, along with the political enthusiasm for widespread application of costly and time-consuming medication review interventions such as medication reconciliation, suggests an identified need for this type of risk stratification.9,14,31 Future prospective implementation studies are required to quantify any benefit that might be obtained from this strategy.
To implement evidence-based best care practices to reduce drug-related morbidity, better information about the real-world safety of medications outside of the controlled environment of clinical trials is needed.32–34 Postmarket surveillance systems in North America rely largely on passive reporting of ADEs by health care workers or on documentation of ADEs in medical charts for manual or electronic review.33–39 Given the high rate of missed ADEs in ED patients, it is unlikely that a high proportion of ADEs are captured using these methods.9,14,15,40 This limits the utility of ED and hospital data for surveillance purposes and limits the effectiveness of ADE data capture using trigger tools.41 Implementation of either of the proposed CDRs could enhance the documentation of ADEs in ED and hospital data and have the potential to enhance surveillance and provide more complete data for drug safety and effectiveness evaluation. In addition, this methodology may assist researchers in identifying ADEs prospectively, by providing a more efficient means of identifying the majority of clinically significant events (≥90% based on our data) without the need to have pharmacists and physicians assess all patients for ADEs.
Strengths of this study include adherence to rigorous methodologic standards for the development of CDRs.30 The primary and secondary outcome measures were clearly defined and independently assessed by two raters: one a pharmacist and the other a physician. If any disagreement or uncertainty occurred, an independent committee reviewed and adjudicated the case. Our outcome measures took into account the varying case definitions of ADEs and reactions prevalent in the research literature and in clinical practice, enhancing the utility of our rules. The clinical variables used as predictors were standardized and collected without knowledge of the patient’s outcome. The reproducibility of the variables was assessed by having two physicians and two nurses independently collect data on a subset of patients. The study subjects were selected using a standardized enrollment algorithm to ensure a representative and unbiased sample. In addition, a more sensitive rule was derived based on performance characteristics determined by practicing EPs, and a second rule was derived taking into account the resource constraints of smaller centers with less pharmacist and medical consultant availability.
Our study is not without limitations. The sensitivity of our rules was deliberately not set to 100% to enhance specificity and facilitate their uptake into clinical practice. While some clinicians may view this as a disadvantage, no life-threatening ADEs or reactions were missed, and recognition of even 90% of events represents a substantial improvement compared to current practice in which only 51% to 62% of events are attributed to medication use.9,14
The range of severity of the identified ADEs varied from life-threatening consequences of medication use (e.g., saddle pulmonary embolus on a patient on the oral contraceptive pill) to less impressive presentations (e.g., constipation due to narcotics). While all presentations were bothersome to patients and significant from a health resource use perspective because they were associated with ED visits, only a proportion were immediately life-threatening. Because the manifestations of ADEs are heterogeneous, we were unable to define a physiologic cut-point for determining clinical significance and therefore relied on the decision of the treating physician to alter medical management as a consequence of the ADE. Clearly, the physicians felt that to prevent future health resource use and/or deterioration of the patient, treatment of less impressive manifestations of ADEs was warranted. We felt that using this threshold for treatment of the outcome was appropriate, because CDRs are intended to assist with medical decision-making.
Finally, our rules were derived in two Canadian tertiary care centers. Therefore, our rules’ generalizability is limited to similar institutions. In a prospective validation and refinement study, adaptation of the rules to community hospitals and non–tertiary care EDs can be conducted. The rules can also be used as a starting point for deriving and validating rules for other practice settings. Finally, the effectiveness of our rules at improving the identification of ADEs, and their effect on clinical practice and patient outcomes, needs to be assessed prospectively in a new sample of patients.
There is currently substantial variability and inaccuracy in the identification of adverse drug events and adverse drug reactions in ED patients. We have developed clinical decision rules that may enable resource-efficient, systematic screening in this patient population by flagging high-risk patients for medication review by a medication specialist. If prospectively validated, our rules have the potential to standardize and improve the efficiency with which drug-related morbidity is detected and reported in EDs and could streamline the referral process for time-consuming medication review.
The authors acknowledge the physicians and nurses working at Vancouver General Hospital and St. Paul’s Hospital emergency departments during the study period. This study would not have been possible without their dedication and support. Particular thanks go out to Jan Buchanan for her diligence and support, as well as Drs. Jim Christenson, Rob Stenstrom, and Riyad B. Abu-Laban for their critical review of the manuscript.