You are on page 1of 13

HCI Lesson 7

USABILITY07Homework

Prof. Garzotto
SUBJECT OF THE EVALUATION
http://www.rijksmuseum.nl/
WHAT TO DO
Activity 1: USABILITY EVALUATION USING
MILE+
(TECHNICAL INSPECTION only)

Activity 2: EMPIRICAL TESTING (min 5 USERS)

Activity 3: REPORTING evaluation results


Activity 4: Greenberg&Buxton paper
ACTIVITY 1
Inspection:
Define 3-5 relevant scenarios (the site is big)
Execute the inspection using MILE+ method
TECHNICAL INSPECTION ONLY

PLEASE REFER TO THE MILE Report FOR THE LIST OF


HEURISTICS
USE A 0-5 SCALE TO SCORE HEURISTICS
0= this heuristic is not relevant
1= this heuristic is violated

5= th
Define a severity rate scale (weight) for the importance of
each heuristic in your inspection (e.g., 0-1)
ACTIVITY 2
User testing:

Design the test (see slides)

Conceive the test for ONE user profile


Consider profile and the tasks in the scenarios defined for
inspection
Define clearly which measures you want to take and how

Execute the test involving at least 5 users


ACTIVITY 3:Reporting
Describe the work done; key information to be included:
Inspection:
few lines about MILE+
Steps followed (at a glance)
heuristics used and their weight
Scores of each relevant heuristics (with examples of screenshots and
comments why a violation occurred)
PROVIDE AGGREGATED DATA, e.g., MEAN VALUE FOR EURISTICS
(with score different from zero) BY DIMENSIONS (e.g., a mean for all
values of CONTENT HEURISTICS, NAVIGATION HEURISTICS, ect.)
PROVIDE VISUAL REPRESENTATIONS OF RESULTS (diagrams, summary
tables...)
Discuss results and requirements for redesign
ACTIVITY 3:Reporting (cont.)
User testing
Design of the study (metrics used, data collection method,
tasks assigned, how you recruited users, where the test has
been carried on...)
Results - please provide both analytical and aggregated data
(e.g. mean values for the various measures, visual
representation of results, ...)
Discussion of results
Recommendations

(optional Annexes- photos, or any further information you may
find usefull)
ACTIVITY 3:Reporting (cont.)
AT THE BEGINNING:
Cover (1 page)
Table of contents WITH PAGE NUM (1 page)
Executive Summary (1/2 page)
Overview of the Application (max 1 page)

AT THE END: FINAL CONSIDERATIONS


Final comparisons of the results the 2 evaluations
your opinion and judgement about the methods and the work
done (what do you think about Mile? About UT? What did you
learn from this HM?...)
ACTIVITY 3: Reporting - Remember
SEE NOTES
This report is the input for a redesign activity
You are not asked to propose re-design solutions (but
should discuss the requirements for re-design)
Your report is for the general manager of the
institution (the hypothetical client who pays for this
work) AND the design manager
They both want to have a clear idea of problems and their
severity, with proper examples
The design manager may need further examples and details
(if you want to consider this aspect, include details or
examples in an annex
ACTIVITY 3: Reporting - Lengh
Maximum length of the report (without
annexes), font Times New Roman 11) including
images, diagrams, graphs, tables
Max 20 pages for MILE+ inspection
Max 8 pages for user testing
Max 2 pages for final considerations
Activity 4
Read Greenberg&Buxton paper
Present the key points of the paper (as done
for the previous assignments)
For practical reasons, please include this short
presentation in the usability report
Delivery deadline of HM1:

Nov 24 (postponed)
Post on the Beep platform
IMPORTANT: file name MUST BE
COGNOME-NOME-MAT-HCI-USABILITY HM
Learning resources
Slides on
MILE+
User testing
MILE+ heuristics
Articles (see Resources)
ID book chapters: 12, 14, 15, 7 and 8
http://www.id-book.com/secondedition/

You might also like