Efficacy of Teaching Clinical Clerks and Residents how to Fill out the Form 1 of the Mental Health Act Using an e‑Learning Module

Abstract

Background: Every physician in Ontario needs to know how to fill out a Form 1 in order to legally hold a person against their will for a psychiatric assessment. These forms are frequently inaccurately filled out, which could constitute wrongful confinement and, in extreme circumstances, could lead to fines as large as $25,000. Training people to fill out a Form 1 accurately is a large task, and e‑learning (Internet‑based training) provides a potentially efficient model for health human resources training on the Form 1. Objective: In this study, we looked at the efficacy of an e‑learning module on the Form 1 by comparing baseline knowledge and skills with posttest performance. Methods: 7 medical students and 15 resident physicians were recruited for this study from within an academic health sciences setting in Hamilton, Ontario, Canada (McMaster University). The intervention took place over 1 hour in an educational computing lab and included a pretest (with tests of factual knowledge, clinical reasoning, and demonstration of skill filling out a Form 1), the e‑learning module intervention, and a posttest. The primary outcome was the change between pre‑ and posttest performance. A scoring system for grading the accuracy of the Form 1 was developed and two blinded raters marked forms independently. Participants were randomly assigned to one of two sequences of assessments (A then B vs B then A), with a balanced design determining which test the participants received as either the pretest or posttest. Inter‑rater reliability was determined using the Intraclass Correlation. Repeated measures analysis of variance was conducted. Results: The Intraclass Correlation (ICC) as the measure for inter‑rater reliability was 0.98. For all outcome measures of knowledge, clinical reasoning, and skill at filling out the Form 1 there was a statistically significant improvement between pretest and posttest performance (knowledge, F(1,21) 54.5, p