Document Type

Issue/Research Brief/Blog

Publication Date

12-2023

Keywords

bar exam design, online testing

Abstract

This research project evaluated the Live Remote Proctoring (LRP) for the First-Year Law Students’ Examination (FYLSX) in terms of test performance, examinee experience, and exam violation incidents.

Utilizing LRP in the October 2022 FYLSX, the study compared this session to 20 previous exams spanning from 2012 to 2022 and analyzed post-exam feedback and violation reports. The findings indicate that LRP did not conclusively outperform previous remote testing modalities in terms of exam performance. While there was a modest improvement in pass rates, it fell within the expected range of historical fluctuations, suggesting that LRP may not have been the influencing factor. Furthermore, gender disparities in performance raise concerns, suggesting potential disadvantages for female examinees under the LRP modality. While LRP showed promise in reducing the rate of exam violations, the benefits observed from a single session's data are not sufficient to establish a conclusion. The most notable concern with LRP was the overwhelmingly negative examinee feedback regarding the testing experience, mainly due to the live monitoring aspect.

Given these mixed results, if LRP continues to be used, exploring alternative providers might be necessary to enhance the testing experience.

Download