COMP3511/COMP9511: Human Computer Interaction
UNSW - School of Computer Science and Engineering (2004- Session 2)
Paper 2 - Assignment Only Strand
This assignment is worth 3% of your final grade.
Assignment Due: Wednesday, 27th October 2004.
Cover sheet(PS) Cover sheet(PDF)
The maximum page limit for this assignment is 9 pages (excluding diagrams, references and appendices). Please don't feel compelled to reach this limit.
Usability Study: Consumer Electronics Devices
In this assignment you will create and perform a usability study for one of the following situations:
Setting television channels on a video cassette recorder, or
Programming a video recorder to record different television programmes, or
Setting the alarm, time and mode of wake-up (alarm/radio) on a digital clock radio, or
The aim of the exercise is to observe 2 users interacting with the device using the think aloud technique (see Preece, p365-368, Laboratory 2). The device must have some mode that requires setting values, programming or storing information into the device.
In this experiment you will be expected to time tasks and identify the types of usability problems encountered. Use your design diary to record your observations and the times that particular events occurred. Do not record personal information of the subject in any part of your submission.
Preliminary Evaluation
Select and identify the device, noting the brand and model numbers
As an "expert", provide a critique of the interface. What do you believe are the usability issues of the device? Under what circumstances do you think other users, not familiar with the device, will have problems? This must be done before conducting the experiment. Do not amend this after carrying out the experiments.
Develop one scenario for each typical user type aged in their mid 20s and mid 40s. (0.5 page)
Include a picture (sketch, photo or extract of the manual of the interface) to help illustrate some of the issues.
Experiment Design
Based on your preliminary evaluation, define the aim of your usability experiment
Construct an appropriate set of tasks for observation and justify why you have selected this particular task. Note that the actual experiment should only take 15-20 minutes.
Identify several significant points that will be used to measure the task timing (eg. User started/completed entering the date; User started/completed choosing channel).
Preparing Documentation for Experiment
Based on the tasks you are proposing, create a background sheet that will be used to prepare the subject for the task. Use the scenario developed previously to provide context for the subject to carry out the task. This must not be a step-by-step detailed description. Remember that you are conducting a usability experiment to find out what the user will typically do.
Create a single page of questions (around 5) to discover background information that is relevant to your experiment (eg. They are comfortable with programming the VCR, Have they used this particular model/brand before?). Leave space for you or the subject to write their answers.
Prepare your design diary with appropriate blank tables to help you record your observations. Note that you will need to document errors and record task times.
Running the experiment (in your design diary)
Identify two people who match the demographics (age range of the people in the scenarios) and are willing to participate in the experiment. Run individual one-on-one sessions with each to:
Provide them with a background and consent sheets explaining the purpose of the experiment
Explain that the study is to evaluate the device, not the subject
Request their consent to carry out the experiment
Ask the background questions you have prepared
Document the broad demographic details of the participant.
Conduct a think aloud experiment, taking detailed notes, noting timing and errors
Listen and observe, do not correct their mistakes or guide them through the task unless absolutely necessary. Do not tell them that they are wrong.
After the tasks are over allow time for them to ask questions or provide feedback about the experiment
Thank the subject for participating
Analysis of the results
Prepare an overall summary of the experiments
What user interface problems were revealed by the experiment?
How long did it take to carry out specific stages of your experiment?
Conclusions
Discuss the usability issues revealed in the experiments and compare this against your expert discussion. What were the differences?
Discuss the usefulness of the think aloud technique for assessing consumer electronic devices.
What solution(s) would you propose to the manufacturer to correct any problems?
References
Preece 2002, Ch10, Ch12, 14.1-14.4