AI-Assisted Qualitative Research: Measuring Student Discussion Board Engagement
This presentation describes an AI-assisted research study that investigated whether presenting students with ill-structured problems led to better or different patterns of student engagement in online discussion forums. It not only discusses the results of the research study but also explores the benefits and challenges of using generative AI for qualitative research.
Using ill-structured problems in the discussion prompts for the intervention group, researchers compared the frequency of discourse markers indicating the co-construction of knowledge in three online discussion forums. The researchers trained generative artificial intelligence in their classification system and compared the AI’s coding to that of two human coders.
This presentation briefly summarizes the scholarly literature supporting the instructional design approach and study methodology. It describes the coding system the researchers developed, the AI training technique, and the norming and calibration process. Finally, it presents preliminary study results and offers recommendations for online discussion prompt design.
Brigit McGuire, National American University, US
Dr. Brigit McGuire is a higher education professional who’s passionate about the power of well-designed learning experiences to change lives. She holds a Ph.D. in English from Columbia University with a focus on medieval literature. Over her 20-year career she has worked as an edTech content manager, instructional designer, and writing and literature instructor. She currently serves as the Dean of Academic Affairs for National American University.
Mary Dereshiwsky, Northern Arizona University, US
Mary I. Dereshiwsky is a Professor and adjunct faculty member at National American University. She teaches courses in statistics, career planning, and career development. She also serves on dissertation committees in education and business. Mary also publishes and presents research results in various aspects of online teaching and learning. She lives in Flagstaff, Arizona
Cindy Mathena, National American University, US
Dr. Cindy Mathena is an experienced educator and leader with 29 years in academia. She holds a Ph.D. in Educational Technology with a focus on the effectiveness of online education for physical and occupational therapists. Dr. Mathena’s scholarly interests have focused on interprofessional education and online education, reflecting her commitment to innovative teaching methods. She has presented her findings at national conferences and has co-authored a textbook titled “Interprofessional Education and Collaboration: An Evidence-Based Approach to Optimizing Health Care.” Her research interests include online education, AI and program development. She currently serves as the president and provost of National American University.
