Abstract Details

Title A Mixed-methods Approach to Teaching Critical Appraisal of Research to Neurology Residents Through Social Cognitive Theory

Topic Education, Research, and Methodology

Presentation(s) S39 - Broadening the Scope of Medical Education in Neurology (3:30 PM-3:42 PM)

Poster/Presentation
Number 001

Background SCLT and its associated four elements of observational learning: attention, retention, reproduction and motivation, have yet to be explored within journal club formats to teach critical appraisal of research to neurology residents.

Objective Using a social cognitive learning theory (SCLT) framework, the aim of the quantitative phase was to compare two different journal club formats for teaching methodology and clinical application. In the qualitative phase, we explored neurology resident experiences with both formats.

Design/Methods We implemented a sequential, explanatory mixed-methods design. We conducted four journal clubs: two flipped and two traditional, alternating between the two. We designed parallel pre- and post-test forms and analyzed the change in scores using a linear mixed effects model with fixed effects for format and pre-test score. We documented ethnographic observations and conducted semi-structured interviews with residents. The data is mixed during content analysis of interview data.

Results Resident participants (n=18 flipped, 17 traditional) of each journal club completed pre-tests (n=16 flipped, 11 traditional) and post-tests (n=8 flipped, 5 traditional). There was no difference in total (Estimate=8.54%, SE=8.21, p=0.33) and methodology (Estimate=12.98%, SE=10.94, p=0.27) scores. There was a statistically significant increase in clinical application pre- and post-test scores with the flipped format (Estimate = 56.37%, SE = 5.68, p < 0.001). Regarding the flipped format, ethnography noted consistent demonstrations of retention, reproduction, and motivation, and interviews noted limited preparation time and possible interpretive bias when designing the discussion guide.

Conclusions These results highlight the strengths of a flipped format that emphasizes retention, reproduction, and motivation in SCLT. Further altering the design to a “no-prep” approach and emphasizing individual interpretation of the data and results of the article may further optimize teaching critical appraisal of research.

Authors/Disclosures
Katherine Fu, MD (University of California, Los Angeles) PRESENTER	Dr. Fu has received personal compensation in the range of $500-$4,999 for serving as an Editor, Associate Editor, or Editorial Advisory Board Member for American Academy of Neurology: Neurology Journal .
Joy Chan, MD	Dr. Chan has nothing to disclose.
Katelyn Stepanyan (UCLA)	No disclosure on file
Ashley Manchanda	No disclosure on file
Alonso Zea Vera, MD (Children's National Hospital)	The institution of Dr. Zea Vera has received research support from American Brain Foundation, Tourette Association of America, American Academy of Neurology.
Michelle Vermillion	No disclosure on file
Holly Wilhalme	No disclosure on file
Adrienne M. Keener, MD (UCLA Neurology)	Dr. Keener has nothing to disclose.
Roy E. Strowd III, MD, FAAN (Wake Forest School Of Medicine)	Dr. Strowd has received personal compensation for serving as an employee of Kaplan. Dr. Strowd has received personal compensation in the range of $500-$4,999 for serving as a Consultant for Monteris Medical, Inc. Dr. Strowd has received personal compensation in the range of $500-$4,999 for serving as a Consultant for Novocure. Dr. Strowd has received personal compensation in the range of $5,000-$9,999 for serving as an Editor, Associate Editor, or Editorial Advisory Board Member for American Academy of Neurology. The institution of Dr. Strowd has received research support from Southeastern Brain Tumor Foundation. The institution of Dr. Strowd has received research support from Jazz Pharmaceuticals. The institution of Dr. Strowd has received research support from National Institutes of Health. The institution of Dr. Strowd has received research support from Alpha Omega Alpha. The institution of Dr. Strowd has received research support from American Board of Psychiatry and Neurology. Dr. Strowd has received publishing royalties from a publication relating to health care. Dr. Strowd has received publishing royalties from a publication relating to health care.