What is in this article?:
Editor’s note: Jeremy Lundberg, MSSW, chief executive officer of EthosCE Learning Management System and DLC Solutions, has some really smart friends. So, he thought, why not ask them if they’d be willing to share some of their expertise? He did, and the result is a series of webinars that provide practical advice on continuing medical education topics.
In addition to the webinar summarized here, there are two more webinars currently available on demand: “New Data on Clinician Learning: What Does It Mean for Your CME Programs?” and “Driving CME Process Innovation Using Lean Six Sigma Methodologies.” The next webinar, scheduled for live viewing in February, will be on overcoming organizational obstacles to e-learning. Lundberg plans to offer one per month throughout 2014.
2. Measure to your educational design.
- Your content, and your outcomes measures, will depend on where you expect changes to occur—knowledge/awareness, confidence, competence, performance, or patient outcomes.
- Use your organization’s mission to help guide your outcomes strategy.
- Be very specific about the level to which you plan to measure outcomes. Many use Moore Levels:
Level 1 Participation
Level 2 Satisfaction
Level 3A Learning: Declarative Knowledge (Knows)
Level 3B Learning: Procedural Knowledge (Knows How)
Level 4 Learning: Competence (Shows How)
Level 5 Performance (Does)
Level 6 Patient Health
Level 7 Community Health
- Determine whether you need objective assessments, including chart pulls and quality assurance/quality improvement and patient safety data, which will require more resources but may be necessary for higher level outcomes—or if you can make do with subjective measures, such as self-reported performance change and observations of patient outcomes. Dietze said, “You can always measure beyond your design, but if your content is focused on enhancing knowledge and creating intentions to improve performance, measuring beyond that may not yield optimal results”
- Specify not just the outcome level you’re aiming for, but what that means to you, in your grant requests, said Viereck. For example, to measure Level 5 outcomes, are you going to use objective chart pulls or subjective self-reported data? Spell it out so there are no misunderstandings that could affect your credibility in the future.