Abstract Details

Title A Formal Mentored Peer Review Program Quantitatively Improves the Quality of Peer Review

Topic Education, Research, and Methodology

Presentation(s) S34 - Research Methodology and Education (1:00 PM-1:12 PM)

Poster/Presentation
Number 001

Background

Peer review is an essential component of scientific publishing. Manuscript review is not a formal requirement in neurology residency training, resulting in variable review quality and fewer available reviewers. The Neurology^® RFS expanded and formalized a virtual, mentored peer review training program in 2020. We have previously demonstrated improved trainee confidence; however, it is unclear if this program improves peer review quality.

Objective To evaluate the impact of the Neurology® Resident & Fellow Section (RFS) Mentored Peer Review Program on residents and fellows.

Design/Methods The RFS Mentored Peer Review Program pairs faculty mentors with trainee peer reviewers. Mentors are chosen from a national pool of experienced reviewers with an interest in mentoring. Participants receive structured resources on how to review a manuscript and construct a written peer review. Mentor-mentee dyads complete two reviews over six months. Starting in 2021, mentees are also asked to complete pre- and post-program unassisted reviews that are quantitatively scored by three independent evaluators using a modified version of the Review Quality Index (RQI). Pre- and post-program RQI scores are then compared to determine the program’s impact on peer review quality.

Results In 2021, 20 mentor-mentee pairs were enrolled including 8 incoming members of the RFS editorial board and 12 neurology trainees who responded to a call for participants via AAN social media channels. On average, mentees were 32.9 years of age and 6.8 years from medical school graduation. Mean pre- and post-program RQI scores were 25.73 and 31.27, respectively. Post-program reviews were more structured and reviewers were more likely to discuss the originality and importance of the research question.

Conclusions Peer review quality substantially improved for residents and fellows from varied backgrounds following completion of a structured, mentored peer review curriculum. Structured mentoring is a valuable approach to expand the pool of quality peer reviewers.

Authors/Disclosures
Whitley W. Aamodt, MD (University of Pennsylvania) PRESENTER	Dr. Aamodt has received personal compensation in the range of $500-$4,999 for serving as an Editor, Associate Editor, or Editorial Advisory Board Member for Neurology.
Ariel M. Lyons-Warren, MD, PhD (Baylor College of Medicine)	Dr. Lyons-Warren has received personal compensation in the range of $0-$499 for serving as a Consultant for Guidepoint. Dr. Lyons-Warren has received personal compensation in the range of $500-$4,999 for serving as an Editor, Associate Editor, or Editorial Advisory Board Member for Neurology. The institution of Dr. Lyons-Warren has received research support from NIH.
Kathleen M. Pieper (Neurology Journal)	Ms. Pieper has received personal compensation for serving as an employee of American Academy of Neurology. Ms. Pieper has received personal compensation in the range of $100,000-$499,999 for serving as an Editor, Associate Editor, or Editorial Advisory Board Member for AAN - Neurology.
Roy E. Strowd III, MD, FAAN (Wake Forest School Of Medicine)	Dr. Strowd has received personal compensation for serving as an employee of Kaplan. Dr. Strowd has received personal compensation in the range of $500-$4,999 for serving as a Consultant for Monteris Medical, Inc. Dr. Strowd has received personal compensation in the range of $500-$4,999 for serving as a Consultant for Novocure. Dr. Strowd has received personal compensation in the range of $5,000-$9,999 for serving as an Editor, Associate Editor, or Editorial Advisory Board Member for American Academy of Neurology. The institution of Dr. Strowd has received research support from Southeastern Brain Tumor Foundation. The institution of Dr. Strowd has received research support from Jazz Pharmaceuticals. The institution of Dr. Strowd has received research support from National Institutes of Health. The institution of Dr. Strowd has received research support from Alpha Omega Alpha. The institution of Dr. Strowd has received research support from American Board of Psychiatry and Neurology. Dr. Strowd has received publishing royalties from a publication relating to health care. Dr. Strowd has received publishing royalties from a publication relating to health care.