Check Your Knowledge 5

Back to Topic: Instructional Design > User Testing of E-Learning Courses > Analyzing the Results


Knowledge Check 1

Read the user testing data and then indicate whether it is quantitative or qualitative by selecting the appropriate radio button. When you are finished making your selection, click the "Submit" button.


1. Scoring trend on a particular exam item.

QUALITATIVE
QUANTITATIVE

2. Comment on the use of periods at the end of items on a bulleted list.

QUALITATIVE
QUANTITATIVE

3. Average seat-time on a particular lesson.

QUALITATIVE
QUANTITATIVE

4. Summative results of a satisfaction survey.

QUALITATIVE
QUANTITATIVE

5. Comment on how slow the learning management system loads each page of a course.

QUALITATIVE
QUANTITATIVE

6. Comment on how the learner struggles to figure out what button to click during a software application simulation practice task.

QUALITATIVE
QUANTITATIVE

Your score is 0 / 0


Knowledge Check 2

Read the user testing data and then indicate whether its severity by selecting the appropriate radio button. For the purposes of this exercise, you have already confirmed each item's veracity. When you are finished making your selection, click the "Submit" button.


1. It would be nice to know where the midline torus is reflected in the computer record (although it is shown later in the training). This is an opportunity to reinforce this concept.

Deal Breaker
Serious
→ This user has indicated a possible improvement to the training's content. A big clue is the "...nice to know..." comment. Your decision to designate a FIX or NO FIX to this item will depend on the level of effort for the revision. If the decision is "NO FIX," be sure an keep this suggestion on file for future revisions.
Minor
N/A

2. Is this an error? Shouldn't you select the “US HUMERUS” to navigate to the Additional Details page instead of the "Procedures" button?

Deal Breaker
→ Because this tester is an actual user of the system in the field, he has caught an error in the content. You never want to convey wrong information to the learner, so this is something that should definately be fixed during final revisions to the course.
Serious
Minor
N/A

3. I personally feel that this lesson needs to be divided in two. Provider Access and then the separate one call Beneficiary Resources. You could actually tailor beneficiary resources directly to patients. This could be put on Kiosks at MTF, send out CD’s with the lesson.

Deal Breaker
Serious
Minor
→ Remember that by the time a course gets to the user testing phase, it is at the end of the development cycle. In most cases, returning to the storyboard phase to rechunk a lesson's content will be out of scope. In addition, the suggestion to provide the information on Kiosks/CDs is out of scope in this case. This type of action would have needed to be indicated during front-end analysis during requirements gathering. Although assigned a "NO FIX" status, these are both great suggestions and should be documented for future revisions to the e-learning course.
N/A

4. This does an excellent job of explaining the different roles. I wasn’t clear on my role until now. Didn’t know we could modify the webpage for the MTF - good info. This may be the best WBT I have ever used. It shows you what you need to know with out a lot of unnecessary information.

Deal Breaker
Serious
Minor
N/A
→ Comments like this one require no action on your part. However, they should remain a part of your formal user testing documentation. They also provide you and your team-members a great pat on the back for a well-designed course.

5. When you typed in the last name, you typed it in the ‘Find NAS by Patient SSN box’ which is wrong and then hit the wrong search button.

Deal Breaker
→ Because this tester is an actual user of the system in the field, he has caught an error in the content. You never want to convey wrong information to the learner, so this is something that should definately be fixed during final revisions to the course.
Serious
Minor
N/A

6. When I returned to the course the next day, all my bookmarks were gone.

Deal Breaker
→ This either a problem with the content or the delivery platform and needs to be resolved prior to deployment of the course.
Serious
Minor
N/A

Your score is 0 / 0

Knowledge Check 3

In the previous lesson, Conducting User Testing, you conducted your own user test on an e-learning page from Wikiversity. In this knowledge check, practice what you know about analyzing results by judging the severity of each your findings. If you believe that the item needs resolution, think about how you might go about fixing it.

Previous Next

Click Next to conclude this module.


Back to Topic: Instructional Design > User Testing of E-Learning Courses > Analyzing the Results

This article is issued from Wikiversity - version of the Sunday, April 13, 2008. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.