Faculty perceptions of AI-versus human-summarized narrative exit survey data across three nursing programs.
Date
2026-01
Journal Title
Journal ISSN
Volume Title
Repository Usage Stats
views
downloads
Citation Stats
Attention Stats
Abstract
Aim
The purpose of this study was to compare faculty perceptions of the quality of artificial intelligence (AI)-generated versus human-generated summaries of narrative exit survey data to assess the feasibility of AI integration into program evaluation processes.Background
Generative AI tools are increasingly used in higher education to streamline data analysis. In nursing education, student evaluations offer rich insights but are time-consuming to summarize. AI tools like Microsoft Copilot offer potential efficiencies but raise concerns about reliability, bias and the preservation of reflective pedagogy and student voice.Design
A cross-sectional, descriptive pilot study design was used.Methods
Five faculty members independently rated summaries generated by Microsoft Copilot and by human analysis using a 7-point Likert scale. Ratings were based on accuracy, clarity, bias and relevance.Results
Quality ratings of the AI-generated summaries were higher (mean=5.9) compared with the human-generated summaries (mean=5.0).Conclusions
This pilot project suggests integrating AI as a supportive tool rather than a replacement for human review. The overall intent was to assist faculty in improving efficiency in program evaluations by using AI, in conjunction with human review, to maintain fidelity to the student voices and context.Type
Department
Description
Provenance
Subjects
Citation
Permalink
Published Version (Please cite this version)
Publication Info
Reynolds, Staci S, Elaine D Kauschinger, Allen Cadavero, Stefanie Conrad, Jacquelyn M McMillian-Bohler and Michelle Webb (2026). Faculty perceptions of AI-versus human-summarized narrative exit survey data across three nursing programs. Nurse education in practice, 90. p. 104648. 10.1016/j.nepr.2025.104648 Retrieved from https://hdl.handle.net/10161/34386.
This is constructed from limited available data and may be imprecise. To cite this article, please review & use the official citation provided by the journal.
Collections
Scholars@Duke
Staci Reynolds
Dr. Staci Reynolds is a Clinical Professor at Duke University School of Nursing (DUSON). At DUSON, Dr. Reynolds primarily teaches in the DNP program. Previously, she clinically served as a Clinical Nurse Specialist (CNS) at Duke University Hospital within the neuroscience inpatient units and Infection Prevention and Hospital Epidemiology department. In January 2023, Dr. Reynolds was appointed the Editor-in-Chief of the Journal of Nursing Care Quality. Before coming to DUSON, she was a neurocritical care nurse and a neuroscience CNS at Indiana University Health Methodist Hospital.
Dr. Reynolds received a baccalaureate degree in nursing science from Indiana University (IU) School of Nursing in Indianapolis, Indiana. She earned a Master’s degree as a Clinical Nurse Specialist at IU in 2011, and completed her PhD at IU in May 2016. Dr. Reynolds’ current scholarship interests include evidence-based practice implementation and evaluation, and she is an expert in quality improvement.
Elaine Dorean Kauschinger
Jacquelyn McMillian-Bohler
Dr. Jacquelyn McMillian-Bohler is an Assistant Professor, Associate Dean for Academic Innovation and Evaluation, and Director for Educational Excellence at Duke University School of Nursing (DUSON). Jacqui is a recognized leader in nursing education, passionate about faculty development and creating inclusive, evidence-based teaching and learning environments. Her work focuses on competency-based education and innovative teaching practices that enhance learning outcomes and promote student success.
Jacqui's scholarship is grounded in her "master teacher" model, which has shaped her approach to faculty development and supporting the professional growth of nurse educators. She has published and presented nationally and internationally on faculty development, teaching strategies, and educational innovation. She has received numerous awards for her academic contributions, including the 2021 Duke University Outstanding Teaching Faculty Award at DUSON.
Since joining the DUSON faculty in 2017, Jacqui has taught Health Promotion and Perinatal Nursing in pre-licensure and master's degree programs. She is deeply committed to addressing health disparities, particularly Black maternal mortality, and is currently a co-principal investigator on a grant to enhance doula training for Black families during the perinatal period.
Since 1998, Jacqui has been certified as a nurse-midwife and has provided full-scope women's health care in Charleston, South Carolina, Nashville, Tennessee, and Louisville, Kentucky. She is also a member of the Midwives in Focus International team and has precepted nursing students in China, South America, and the Philippines. Jacqui is currently working with colleagues in Tanzania to build a simulation program.
Jacqui holds a BSN from the University of North Carolina at Greensboro, an MSN in Nurse-Midwifery from Vanderbilt University, and a Ph.D. in Nursing Education from Villanova University.
Michelle Webb
Dr. Webb joined the faculty of Duke University School of Nursing in 2020. She earned a BSN from Indiana University, a MSN from The George Washington University and a DNP from the University of Minnesota. She has diverse nursing practice and leadership experience and has held executive leadership positions in behavioral/psychiatric-mental health, home health, acute care, and hospice care. She is a member of the American Nurses’ Association, DNPs of Color, North Carolina Nurses Association, National Black Nurses’ Association, Sigma Theta Tau International Honor Society of Nursing, and the Hospice and Palliative Nurses’ Association, where she served in numerous leadership positions on the Board of Directors for the Hospice and Palliative Nurses Association and Hospice and Palliative Nurses Foundation (President, President-elect, and Secretary-Treasurer). She is a certified hospice and palliative care administrator and has served as a faculty member for the CORE End of Life Nursing Education Consortium (ELNEC) Train-the-Trainer Course sponsored by the Hospice and Palliative Nurses’ Association. Dr. Webb is also a Fellow in Palliative Care Nursing, a Teaching for Equity Fellow, a Certified Cultural Intelligence Facilitator, and Unconscious Bias Coach. Prior to joining the faculty at Duke University School of Nursing, she was the Chief Nursing Officer and Chief Learning Officer for Teleios Collaborative Network.
Her scholarly and research interests include: the application of the cultural intelligence framework to advance diversity, equity, inclusion, and belonging, and build community; end-of-life nursing education for undergraduate students, graduate students and practicing professionals; innovation in healthcare delivery systems, and interprofessional education and practice. Dr. Webb continues to practice as a consultant for Teleios Collaborative Network.
Unless otherwise indicated, scholarly articles published by Duke faculty members are made available here with a CC-BY-NC (Creative Commons Attribution Non-Commercial) license, as enabled by the Duke Open Access Policy. If you wish to use the materials in ways not already permitted under CC-BY-NC, please consult the copyright owner. Other materials are made available here through the author’s grant of a non-exclusive license to make their work openly accessible.