Natural language processing (NLP), a branch of artificial intelligence (AI), provides a means for computers to explore written narrative. Widely adopted in a broad range of contexts, including education, it may offer efficient processes to examine qualitative based interprofessional education (IPE) outcomes. AI can be used to explore narrative at many different levels (individual, program, institution). We applied NLP at the programmatic level to explore and understand the narrative data produced during one longitudinal community-based experiential interprofessional learning experience. This program evaluation study paired a common NLP method with an exploratory analytical procedure, topic modeling and correspondence analysis, to analyze learner reflections from the IPE experience. Reflective statements from student cohort years 2020-2021 were analyzed, with 565 students consented to provide data. Statements were evaluated using R and RStudio, employing topic modeling and correspondence analysis techniques. Topic modelling elicited the 20 most prevalent topics, including words reflecting the IPE experience’s broad learning goals, such as “team,” “patient,” “respect”, and “plan”. Correspondence analysis provided evidence of lexiconic similarities between student narratives from the dental, medicine, nursing, pharmacy, physical therapy, and veterinary medicine programs. Clinical dietetics, health administration and clinical health psychology narratives were dissimilar with other programs. Patterns of concordance among terms provided evidence of word groupings that similarly reinforced the program’s goals and objectives; words such as team, patient and communication were closely grouped. NLP provided a novel and efficient method to augment our program evaluation processes, rapidly identifying themes and information important for demonstrating value and enhancing future curriculum. This presentation addresses Building the IPE Case by examining how the IPE Case can be supported through use of AI tools. Attendees will be able to describe how AI can be used to better understand IPE impact on learners and other stakeholders for program evaluation and research purposes.
In support of improving patient care, this activity is planned and implemented by The National Center for Interprofessional Practice and Education Office of Interprofessional Continuing Professional Development (OICPD). The OICPD is accredited by the Accreditation Council for Continuing Medical Education (ACCME), the Accreditation Council for Pharmacy Education (ACPE), and the American Nurses Credentialing Center (ANCC) to provide continuing education for the healthcare team.
The National Center OICPD is approved by the Board of Certification, Inc. to provide continuing education to Athletic Trainers (ATs). This program is eligible for Category A hours/CEUs. ATs should claim only those hours actually spent in the educational program.
This activity was planned by and for the healthcare team, and learners will receive Interprofessional Continuing Education (IPCE) credit for learning and change.
Physicians: The National Center for Interprofessional Practice and Education designates this live activity for AMA PRA Category 1 Credits™. Physicians should only claim credit commensurate with their participation.
Physician Assistants: The American Academy of Physician Assistants (AAPA) accepts credit from organizations accredited by the ACCME.
Nurses: Participants will be awarded contact hours of credit for attendance at this workshop.
Nurse Practitioners: The American Academy of Nurse Practitioners Certification Program (AANPCP) accepts credit from organizations accredited by the ACCME and ANCC.
Pharmacists and Pharmacy Technicians: This activity is approved for contact hours.
Athletic Trainers: This program is eligible for Category A hours/CEUs. ATs should claim only those hours actually spent in the educational program.
Social Workers: As a Jointly Accredited Organization, the National Center is approved to offer social work continuing education by the Association of Social Work Boards (ASWB) Approved Continuing Education (ACE) program. Organizations, not individual courses, are approved under this program. State and provincial regulatory boards have the final authority to determine whether an individual course may be accepted for continuing education credit. The National Center maintains responsibility for this course. Social workers completing this course receive continuing education credits.
IPCE: This activity was planned by and for the healthcare team, and learners will receive Interprofessional Continuing Education (IPCE) credits for learning and change.
