Learning Gateway and Electronic Learning Modules: FeedBack for Coaches
Project: Feedback for Coaches
Medical residents frequently complain about the lack of realtime feedback given to them during their rotations. To alleviate this situation, two modules were created to teach residents how to give and and how to receive feedback.
Feedback for Coaches is an e-learning module designed to inform residents and fellows on how to give proper feedback to peers and those who work underneath their supervision. The term coaches can be medical staff of any position. Those receiving the feedback are called Learners. This module is paired with the Medhub app where evaluations of feedback are hosted.
My usability testing takes place on the Feedback for Coaches Module and the Medhub app.
Learning Gateway and Electronic Learning Modules
Learning Gateway is the a team focused on creating online educational materials to educate residents and other medical staff on medical training, before and during their residency at the University of Washington School of Medicine. An e-learning module is a tool that provides medical education in a logical, sequential, order, guiding residents through the content and assessments in the order specified by the instructional designer. (Much like a complex interactive powerpoint.) Content, navigation, tools, interactions, and assessments are implemented to enhance learning and engagement.
My objective is to test the usability of the online learning modules through usability tests. I test the content, navigation, interactions, and general usability of the module.
The e-learning modules are created using Articulate Storyline 3. I test the modules for content changes, usability issues, design changes, and interactions. These changes are determined through two rounds of usability testing.
The design recommendations are placed into a report that is presented to stakeholders. Stakeholders, the designers, and I review what changes need to be made. Finalized design recommendations are then implemented into the final module.
Megan Wilson, Jon Anscher, Joe Wilson, Amy Law, Caleb Pong, Simona Lazar
User Experience Research intern. Hired to be the lead of user research
University of Washington School of Medicine Graduate Medical Education: E-Learning
Usability testing, think-aloud, data coding, focus groups, report creation, stakeholder readout creation
Usability testing is conducted when a module is completed but not in it's final format. Usability Testing is conducted in 2 phases, Alpha and Beta. Each phase requires 5 usability test sessions. After Beta is completed changes discovered in the usability tests are made to the module. These changes are tested in Alpha. The changes made in Alpha are used to make Gold. Gold is the completed version and will be released in the following year for residents to view on their learning management system.
As the lead of user experience I moderate every test taking session. There is a notetaker every session, but I also complete notes after each session. I choose to do this so that there are two interpretations of the data to reduce bias.
Tools: 2 laptops, wireless mouse, document camera, Camtasia, Ipad or mobile phone, printed usability kit
1. Recruiting is run through a survey sent to medical residents though email. All participants of our tests must be medical residents currently at the University of Washington Medical School.
2. Residents sign up with a time. Before testing a participant picks out a gift as a form of gratuity.
3. A conference room for testing is booked by a coordinator.
4. Each test has a note-taker and moderator for each session. Each arrive half an hour early to set-up equipment and prepare the space for the participant.
5. The participant arrives and greetings are exchanged. The participant is given an explanation of the study and think-aloud, and a consent sheet for recording permission.
6. The participant runs and talks through the module. Pre-determined and free thinking questions are asked during the think-aloud.
7. A SUS is completed after the course is completed.
8. A participant is asked a list of pre-determined questions and opinions about the module.
9. The participant is asked if they would like to add anything. Thoughts, questions, observations.
10. Participant is thanked and participant leaves.
11. Researchers debrief.