LEARNING GATEWAY AND ELECTRONIC LEARNING MODULES: AntiMicrobial Stewardship
Project: Antimicrobial Stewardship
"Antimicrobial stewardship is a coordinated program that promotes the appropriate use of antimicrobials (including antibiotics), improves patient outcomes, reduces microbial resistance, and decreases the spread of infections caused by multi drug-resistant organism." (APIC.org, 2017).
Antimicrobial Stewardship is an electronic learning module designed to inform incoming medical residents about the proper use of and prescribtion of antibiotics. This module was also made for Washington's Department of Health and will be distributed to health care institutions outside of the University of Washington School of Medicine.
Learning Gateway and Electronic Learning Modules
Learning Gateway is the a team focused on creating online educational materials to educate residents and other medical staff on medical training, before and during their residency at the University of Washington School of Medicine. An e-learning module is a tool that provides medical education in a logical, sequential, order, guiding residents through the content and assessments in the order specified by the instructional designer. Content, navigation, tools, interactions, and assessments are implemented to enhance learning and engagement.
My objective is to test the usability of the online learning modules through usability tests. I test the content, navigation, interactions, and general usability of the module.
The e-learning modules are created using Articulate Storyline 3. I test the modules for content changes, usability issues, design changes, and interactions. These changes are determined through two rounds of usability testing.
The design recommendations are placed into a report that is presented to stakeholders. Stakeholders, the designers, and I review what changes need to be made. Finalized design recommendations are then implemented into the final module.
Megan Wilson, Jon Anscher, Joe Wilson, Amy Law
User Experience Research intern. Hired to be the lead of user research
University of Washington School of Medicine Graduate Medical Education: E-Learning
Usability testing, think-aloud, data coding, report creation, stakeholder readout creation
Usability testing is conducted when a module is completed but not in it's final format. Usability Testing is conducted in 2 phases, Alpha and Beta. Each phase requires 5 usability test sessions. After Beta is completed changes discovered in the usability tests are made to the module. These changes are tested in Alpha. The changes made in Alpha are used to make Gold. Gold is the completed version and will be released in the following year for residents to view on their learning management system.
As the lead of user experience I moderate every test taking session. There is a notetaker every session, but I also complete notes after each session. I choose to do this so that there are two interpretations of the data to reduce bias.
Tools: 2 laptops, wireless mouse, document camera, Camtasia, Ipad or mobile phone, printed usability kit
1. Recruiting is run through a survey sent to medical residents though email. All participants of our tests must be medical residents currently at the University of Washington Medical School.
2. Residents sign up with a time. Before testing a participant picks out a gift as a form of gratuity.
3. A conference room for testing is booked by a coordinator.
4. Each test has a note-taker and moderator for each session. Each arrive half an hour early to set-up equipment and prepare the space for the participant.
5. The participant arrives and greetings are exchanged. The participant is given an explanation of the study and think-aloud, and a consent sheet for recording permission.
6. The participant runs and talks through the module. Pre-determined and free thinking questions are asked during the think-aloud.
7. A SUS is completed after the course is completed.
8. A participant is asked a list of pre-determined questions and opinions about the module.
9. The participant is asked if they would like to add anything. Thoughts, questions, observations.
10. Participant is thanked and participant leaves.
11. Researchers debrief.