Learning Gateway and Electronic Learning Modules: FeedBack for Coaches

 
stock_group.jpg
 

Project: Feedback for Coaches 

Medical residents frequently complain about the lack of realtime feedback given to them during their rotations. To alleviate this situation, two modules were created to teach residents how to give and and how to receive feedback.

Feedback for Coaches is an e-learning module designed to inform residents and fellows on how to give proper feedback to peers and those who work underneath their supervision. The term coaches can be medical staff of any position. Those receiving the feedback are called Learners. This module is paired with the Medhub app where evaluations of feedback are hosted.

My usability testing takes place on the Feedback for Coaches Module and the Medhub app. 

 
 

Learning Gateway and Electronic Learning Modules

Learning Gateway is a learning management system created to educate residents and other medical staff on medical training, before and during their residency at the University of Washington School of Medicine. Electronic learning modules or e-modules are located on this learning management system. Residents must take various e-modules throughout medical school.

My objective is to test the usability of the online learning modules through usability tests. I am also currently performing usability testing on the Medhub mobile application. The results of these usability tests are presented to stakeholders. 

The e-learning modules are created using Articulate Storyline 3. I test the modules for content changes, usability issues, design changes, and interactions.  These changes are determined through two rounds of usability testing. 

 

team

Megan Wilson, Jon Anscher, Joe Wilson, Amy Law, Caleb Pong, Simona Lazar

my role

User Experience Research intern. Hired to be the lead of user research

workplace

University of Washington School of Medicine Graduate Medical Education: E-Learning

methods

Usability testing, think-aloud, data coding, focus groups, report creation, stakeholder readout creation  

 

Process

Usability testing is conducted when a module is completed but not in it's final format. Usability Testing is conducted in 2 phases, Alpha and Beta. Each phase requires 5 usability test sessions. After Beta is completed changes discovered in the usability tests are made to the module. These changes are tested in Alpha. The changes made in Alpha are used to make Gold. Gold is the completed version and will be released in the following year for residents to view on their learning management system.

As the lead of user experience I moderate every test taking session. There is a notetaker every session, but I also complete notes after each session. I choose to do this so that there are two interpretations of the data to reduce bias. 

Tools: 2 laptops, wireless mouse, document camera, Camtasia, Ipad or mobile phone, printed usability kit

1. Recruiting is run through a survey sent to medical residents though email. All participants of our tests must be medical residents currently at the University of Washington Medical School. 

2. Residents sign up with a time. Before testing a participant picks out a gift as a form of gratuity. 

3. A conference room for testing is booked by a coordinator.

4. Each test has a note-taker and moderator for each session. Each arrive half an hour early to set-up equipment and prepare the space for the participant.

5. The participant arrives and greetings are exchanged. The participant is given an explanation of the study and think-aloud, and a consent sheet for recording permission.

6. The participant runs and talks through the module. Pre-determined and free thinking questions are asked during the think-aloud.

7. A SUS is completed after the course is completed.

8. A participant is asked a list of pre-determined questions and opinions about the module.

9. The participant is asked if they would like to add anything. Thoughts, questions, observations.

10. Participant is thanked and participant leaves.

11. Researchers debrief.