A tool for incorporating interprofessional perspectives into dental students decision‐making: A 2‐year follow‐up on this learning outcome

Abstract Objectives To analyze student performance when using a sustainable teaching tool developed to guide learning toward interprofessional perspectives. Methods This study compiled data about D4 students’ performance when using an interprofessional education (IPE) teaching tool reported previously in this journal, during their 5‐week Geriatric and Special Needs Program rotation in the academic years 2018–2019 and 2019–2020. Ninety‐two students were introduced to IPE concepts and teaching tools during their orientation. Students were then asked a question regarding the perspective of each healthcare team member and whether they would contact these healthcare team members for collaboration during the provision of oral care with regard to various patient cases. Students were scored on whether they answered the question about the perspective of each health care team member. The same two independent evaluators also noted whether the student thought each member of the health care team should be contacted. Results A majority (90.2%–95.7%) of dental students applied their knowledge to questions regarding each health care team member's perspectives. The profession that dental students most often indicated they wished to contact for collaboration was primary care providers (n = 70; 76.1%), followed by family caregivers (n = 54; 58.7%), and pharmacists (n = 46; 50.0%). The results of the interrater agreement between the two‐faculty scoring students were between 86.7% and 100%. Conclusions The teaching tool is sustainable and succinct. Students considered the perspectives of each health care team member at a rate above 90%, and the interrater agreement was high among the faculty evaluators. Students considered contacting primary care providers, family caregivers, and pharmacists more often than the other health care team members. We see this model as one approach to begin the articulation of learning outcomes for IPP.


| INTRODUCTION
Interprofessional Education and Practice (IPE/IPP) have been endorsed by every major health group to be a key to improved chances for favorable patient outcomes (Brandt et al., 2014;D'Amour et al., 2005;Gauger et al., 2018;Haresaku et al., 2021;Harnagea et al., 2017;Interprofessional_Education_Collaborative 2016;O'Malley & Reschovsky, 2011). To accomplish IPP, it is compelling for each member of the health care team to consider and even incorporate the key questions from every other team member for the next patient. In a previous paper in this journal, the authors offered a model for a learning outcome for Interprofessional (or Collaborative) Practice (Leary et al., 2019). The purpose of this paper is to consolidate the learning model from the previous paper and to assess its sustainability. To build on the previous work, some repetitions from the previous paper are incorporated into this paper and acknowledged. The current work incorporates the input from the interprofessional team as a first step to developing a learning outcome with the promise to improve patient outcomes.
Much progress has been made to enhance the culture of IPP.
Extensive national efforts have been made to get health care providers together to coordinate care better so that outcomes are improved.
Several gaps remain in realizing a true IPP. One gap is the scarcity of a model or learning guide for each team member to incorporate the thinking of each other team member. In addition, learning outcomes and learning guides have been elusive with a "wholesale lack of consistency in defining and describing learning [performance] outcomes and their assessment" for IPP, and "the continual lack of longitudinal studies remains problematic" (Thistlethwaite et al., 2010). One dilemma is the distinction between competencies and learning outcomes.
Definitions of competency have centered around capability, capacity, and competence. These perspectives are essential for gaining a larger view of capability, but they fall short of articulating what the practitioner is to do when interacting with the next patient. In the emulation model, the thought process of the expert is the outcome, the learning guide, and the assessment instrument and captures what the student is to do in assessing the next patient. A goal is to develop an outcome to guide learning and assess the performance of the student in the act of critical thinking. A task for the educator is to create or derive the act of critical thinking and inspire students to adopt this approach. An example of a learning outcome in critical thinking is a thought process of the expert emulating the intended activity (Johnsen, 2013;Johnsen et al., 2012;Lane & Stone, 2006). An assumption is that to effectively guide learning and assess performance, the first step is to know what the student is to do. Without knowing what the student is to do, the question arises of whether meaningful guidance and performance assessment can happen. A challenge in IPP is that there are multiple experts and no single expert.
The general purpose of this project is to follow up on the effectiveness of an emulation model for students in the act of critical thinking to apply key questions derived from multidisciplinary team members to the next patient (Table 1). The model was implemented 3 years ago (with 2 years of results) as an introductory IPP exercise during a student evaluation of a complex dental patient. The exercise was incorporated into a larger exercise in risk assessment in a geriatrics and special needs clinic (Leary et al., 2019;Marchini et al., 2017). This exercise introduced a succinct summary of the "first questions" each team member considered important during patient evaluations. The first purpose is to test the sustainability of that model. Since the paper appeared introducing the model, we are not aware of another peer-reviewed model to focus on explicit learning/ performance outcome(s) for IPP. A secondary purpose is to explore the students' propensity for engaging fellow team members with their patients.
Another gap in developing a learning model for IPP is the lack of any baseline for the level of awareness each health care team member has about the thinking of other team members. A second purpose is, therefore, to report 2 years of results from 3 years of model implementation to systematically include the primary question recommended for the next patient by other members of the team. In other words, did students systematically ask the questions recommended by fellow team members regarding their patients, and how frequently did dental students feel it important to seek input from another team member? While the project is for dental students, the approach could be used for any health discipline. While it is beyond the scope of this project to assess patient outcomes, it seems logical that a first step would be to follow the recommendations of experienced health care team members in patient assessment. We are not aware of this approach being used previously.
Concepts for the IPP model are based on emulating the thought processes of the experts on the health care team (Leary et al., 2019).
Previously reported critical thinking emulations have taken the thought process of people from a single discipline, for example, treatment planning, risk assessment, and so on (Benner, 1982; T A B L E 1 Interprofessional practice skillset (Leary et al., 2019) Provider question to ask:  Guzman-Armstrong et al., 2014;Johnsen, 2013;Johnsen et al., 2009Johnsen et al., , 2020Leary et al., 2019;Lane & Stone, 2006;Marshall et al., 2011Marshall et al., , 2017Marchini et al., 2017). The goal is to derive the expert's thought process succinctly enough for the novice to apply to the next patient or situation. The thought process becomes the learning outcome, the learning guide, and the assessment instrument (Johnsen, 2013;Johnsen et al., 2012;Lane & Stone, 2006). The IPP model derives the central thought process of each member of the health care team. The thought process for each team member is derived by asking, "What is the first question you want every member of the health care team to ask when they see their next patient?" The learning outcome for IPP is thus the collective thought processes collating the "first questions" for each member of the health care team (Table 1). While the questions are derived from respective health care team members, the questions are really common sense.
We are not aware of this approach being applied previously.
The collection of thought processes of individual health care team members-the patient, primary care, pharmacy, nursing, social work, nutrition, dentistry, physical therapy, family caregiver, ending with the patient-had not been previously reported. The patient is considered part of the health care team.

| AIMS
The first purpose is to test the sustainability of an emulation model by asking the first question of the primary care provider, pharmacist, nurse, dentist, nutritionist, physical therapist, social worker, and family caregiver. Since the paper appeared introducing the model, we are not aware of another peer-reviewed model to focus on explicit learning/performance outcome(s) for IPP. A secondary purpose is to explore the students' propensity for engaging fellow team members with their patients.  (Table 1).

| METHODS
During their previous dental coursework, the students have been exposed to the content related to IPP in different courses, such as oral surgery, pharmacology, pediatric dentistry, and others. Students also participated in IPE exercises with other health professional students in University-wide IPE exercises. During their orientation to the GSNP rotation, students reviewed basic IPE concepts and were introduced to specific IPE teaching tools. Students were then guided to (1) systematically ask the questions that each health care team member recommended for each patient and (2) whether they would contact these health care team members for collaboration during the provision of oral care. In the present project, students recommended contacting a specific member of the health team. There was no follow-up as to whether the identified member of the health care team was actually contacted.
Students were scored by two independent evaluators on whether they answered the question about the perspective of each health care team member as either applied the step (A), missed the step (M), or marked it as not applicable (N/A) to their patient/case.
The same two evaluators also noted whether the student thought each member of the health care team should be contacted. The questions on who to consult elicited intuitive responses. The next step is to add structure to the discussion on who to consult and why.
The same is true for the student intuitively designating a question as

| RESULTS
A high percentage of students asked and responded to the provider question for each discipline. Results are in Table 2. For respective discipline categories, over 90% of students (ranging from n = 88 to n = 83 depending on the question) asked and responded to the question for each discipline. A lower percentage of students recommended contacting any of the disciplines than asked and responded to the provider question from each discipline. Results are CRAIG ET AL. | 1297 in Table 3. The lowest percentage for asking and responding to a question from a discipline was 90.2% for "Nutrition" (n = 83), "Social Work" (n = 83), and "occupational therapy/phylical therapy" (n = 83).
The discipline that dental students most often indicated they wished to contact for collaboration was primary care providers (n = 70; 76.1%), followed by family caregivers (n = 54; 58.7%), and pharmacists (n = 46; 50.0%). Less commonly indicated to be contacted were nurses (n = 30; 32.6%), nutritionists (n = 30; 32.6%), and physical therapists/occupational therapists (n = 22; 23.9%). The results of the interrater agreement between the two-faculty scoring students were between 86.7% and 100%. Students who were judged to "Apply" a step were almost always judged to "Grasp" the meaning of the step.
Although there are no data to show student performance in systematically asking the questions of each discipline before the IPP exercise was introduced, faculty agree that students did not explicitly ask discipline-based questions before the learning exercise T A B L E 2 Group analysis; "Did the student ask and respond to the question from each discipline, "What is the first thing every member of the team should ask about the next patient?." was introduced. The question, "Do you recommend contacting a team member about this patient?" was also significantly different in the family caregiver-groups 2 and 3 had higher rates of contacting the family caregiver than group 1 (p < .001). No other significant differences were seen.

| DISCUSSION
This Emulation Model for IPP is shown as sustainable in eliciting dental students to systematically ask and respond to questions deemed important for every member of the health care team to ask regarding the next patient. The collective thought processes of the team members became the learning outcome, learning guide, and assessment instrument. The high-performance rate (over 90% for students asking and responding to the central question for all disciplines) is interpreted to mean that the exercise was effective in engaging students in incorporating the initial thinking of each discipline. The lower percentages of students who would recommend contacting respective disciplines is more difficult to interpret. One explanation could be that the student had enough confidence to manage the patient without actual consultation. A future direction in refining the exercise will be to add the question, "Why would you contact team member X?" Some association is seen between exposure to explicit clinical or clinically oriented material (whether didactic or in-clinic) and articulation of that discipline in the IPP exercise. The inclusion of "primary care provider" was most articulated by students and is the area with more extensive didactic and clinical exposure. Pharmacy is next most common in the IPP exercise and also has extensive didactic and clinical exposure.
Nursing is less frequently cited and is associated with no explicit didactic content in Nursing. Similarly, there is no explicit instruction in T A B L E 3 Group analysis (continued) "Do you recommend contacting team members about this patient?."