Usability Test Diagram

One group provided a good example how to present a usability testing diagram that might be useful:

Scenario Overview Pdf.

You can find more information about scenario creation here.

Conducting a Usability Test

Make sure to take the HSC test by next Thursday.

Tips for conducting a usability test (Barnum 2002, Molich, 2001, Nielsen Norman Group)
Before the test

• rehearse the test before the actual tests
• confirm wtih users for scheudles before the test dates is important
• when writing task, avoid hidden clues (or leading them to the actions you’re intending to test)
• do not describe too detailed steps to complete a task

Recruitment

• make sure you screen participating users before they actually participate
• make sure your users are not experts in design or development or usability (thus, it’s not the best idea to get other HCI students to take your tests)
• usually its not a good idea to bring previously participated users again to another test for a new project
• generally, novice users  are best to use to discover critical usability problems

During the Test

• make sure you make users feel at ease, start from a simple task (e.g. beginning with a login task)
• you may give one task at a time
• make sure to give some time for preparations for each test (at least 20 minutes between tests)
• make a checklist for things-to-do before each test session starts (setting up video recording hardware/software, deleting broswer history, etc..)

During the debriefing session

• you can add more debriefing questions in addtion to the ones you already have
• collect all the quesitons from all your team members
• return to key problems the participant user encountered

For your testing, you can download the trial version of Camtasia to use on your laptop.

Project 2 Clarifications

What should a datalogging sheet look like?
The focus of the sheet should be on what exactly you are trying to capture. You don’t specifically have to follow the material examples provided on OnCourse, however it may be helpful when developing and formating your template.

If you have a situation where a person can not finish the task and not advance forward in the overall test, then ask the person to move onto the next task based upon your own experience and judgment.

Scenarios are very important in helping the users contextualize the tests. SO, first show the scenario and then present each task in relation to the scenario.

Debriefing questions are tightly attached to each test and you pose more open-ended questions. Post-test questionnaires are for obtaining quantitative data investigate any overarching patterns about how people feel about the product that was tested.

Project 1 Reflections

The focus of the disposable camera study should be centered on understanding people, not objects. You are not just investigating the ones they took the pictures of, but trying to understand the meaning behind the pictures. Make sure the next studies are focused on humans, rather than objects or systems themselves. If you are new to qualitative/social science research, you may feel uncomfortable with inferring the deeper meaning of what a person said or did, however it is the role of a designer to critically understand what people said. It takes a while to develop a sensibility for this critical stance, however this mindset will lead to much more meaningful & interesting insights.

• Usability can be formally evaluated through empirical measurements, however when we talk about experience (and how we define experience), thus it is important to use methods to understand experience and inspire design based upon qualitative feedback.

• There’s not an optimal amount of pictures to be taken, however the point is to understanding the deeper meaning that the pictures collectively reveal about the person’s life.

• How do you maintain objectivity, while still getting a sense of the person?
  It is challenging for researchers to be objective when dealing with understanding human experiment. This question alludes to the divide between research and design practice. From an HCI perspective, we are concerned with deeply learning about a very specific domain and the implications for future research within our field. However, from a Design perspective, the point is to provide inspiration to new designs.In this case achieving the best possible outcome is important, rather than objective results.

HCI / D Evaluation Methods

This blog will be updated with insight and advice on evaluation methods for HCI /Design.  Information from class discussions will be posted and students can feel free to post questions here, however participation here it is not required.