Page 12: of Maritime Reporter Magazine (August 2020)

The Shipyard Edition

Read this page in Pdf, Flash or Html5 edition of August 2020 Maritime Reporter Magazine

Training Tips for Ships

X © cartoonresource/AdobeStock

Tip #15

Using Student Exam Results to Measure OUR Performance xams are a staple of training. We know what facilitated by having the learners perform their exams in an they are, we know what they are for, and we LMS, as some LMSs produce the insights automatically for know how to write and deliver them. And, you. If your learners are doing their exams on paper, the vari- of course, we all use them to test trainee ous analyses could be done, but it would be a largely manual

E knowledge. But there is another bene? t of task. Let’s look at what is possible with the help of technology.

exams that the vast majority of maritime One of the most useful analyses we can run on exam re- trainers are ignoring. And since we give and sults is to group all of the questions by the competency they grade exams all the time, this bene? t is already there for the cover, and then look at average performance for the group of taking! The value I am referring to is that of providing out- questions covering that competency. As it stands now for most standing, actionable feedback on how effective our training organizations, we only monitor the average performance of is, organization-wide. Exams are normally used to measure an an exam as a whole. Thus, if (for example) the new deckhand individual trainee’s knowledge. But the same data we gener- exam is being performed with an average score of 80%, this ate for that purpose can be used as an outstanding indicator of might give us con? dence that the concepts are well learned. overall training program success. It is also a leading indicator This is false security. Within that exam it may be that there is a of organizational performance and safety - if we just examine set of questions that cover a particular competency which are the data a little differently. So - how do we do this? routinely being failed.

There are many ways that our exam data can provide valu- As an example, we could identify all of the ? re? ghting-relat- able insights. In general, all of these analyses are greatly ed questions in the exam (or across all exams) and look at how 12 Maritime Reporter & Engineering News • August 2020

MR #8 (1-17).indd 12 8/9/2020 10:31:51 PM

Maritime Reporter

First published in 1881 Maritime Reporter is the world's largest audited circulation publication serving the global maritime industry.