Preparing for the Test (from Sakshi)

Camtasia & the Logitec webcam may cause some installation problems with Windows Vista. So, it would be preferable if students used Windows 2000 or XP. Make sure to keep this in mind and not postpone your software installations until the last moment thinking it will be easy & quick.

• Sakshi’s advice is a standard principle for any kind of testing. Make sure you have rehearsed and are familiar with the technology you plan to use–otherwise the results could be DISASTROUS!

Usability Test Diagram

One group provided a good example how to present a usability testing diagram that might be useful:

Scenario Overview Pdf.

You can find more information about scenario creation here.

Conducting a Usability Test

Make sure to take the HSC test by next Thursday.

Tips for conducting a usability test (Barnum 2002, Molich, 2001, Nielsen Norman Group)
Before the test

• rehearse the test before the actual tests
• confirm wtih users for scheudles before the test dates is important
• when writing task, avoid hidden clues (or leading them to the actions you’re intending to test)
• do not describe too detailed steps to complete a task

Recruitment

• make sure you screen participating users before they actually participate
• make sure your users are not experts in design or development or usability (thus, it’s not the best idea to get other HCI students to take your tests)
• usually its not a good idea to bring previously participated users again to another test for a new project
• generally, novice users  are best to use to discover critical usability problems

During the Test

• make sure you make users feel at ease, start from a simple task (e.g. beginning with a login task)
• you may give one task at a time
• make sure to give some time for preparations for each test (at least 20 minutes between tests)
• make a checklist for things-to-do before each test session starts (setting up video recording hardware/software, deleting broswer history, etc..)

During the debriefing session

• you can add more debriefing questions in addtion to the ones you already have
• collect all the quesitons from all your team members
• return to key problems the participant user encountered

For your testing, you can download the trial version of Camtasia to use on your laptop.

Project 2 Clarifications

What should a datalogging sheet look like?
The focus of the sheet should be on what exactly you are trying to capture. You don’t specifically have to follow the material examples provided on OnCourse, however it may be helpful when developing and formating your template.

If you have a situation where a person can not finish the task and not advance forward in the overall test, then ask the person to move onto the next task based upon your own experience and judgment.

Scenarios are very important in helping the users contextualize the tests. SO, first show the scenario and then present each task in relation to the scenario.

Debriefing questions are tightly attached to each test and you pose more open-ended questions. Post-test questionnaires are for obtaining quantitative data investigate any overarching patterns about how people feel about the product that was tested.