Preparation of ULAB EVAL part C
 Before Tuesday, Nov 1 – decide and state the roles of
your team members:
◦ One Breifer/Debriefer for each eval
◦ One User for each eval
◦ Rest of members are Loggers for each eval

B/D responsibilities

Loggers responsibilities

Users Responsibilities
◦ Read, practice, and if necessary, edit the eval you will lead
◦ Decide on the metrics you will uncover to assess the design
stance of the site. Document this with justifications.
◦ Practice the “think out loud” method by documenting your
Web D site task 2 again.
Ulab
1
your ULAB team will be given 3 Evals to
perform on their design stance.
Need:
 Day/Time, members present, setting,
environment & location
 To start each of the Evals – need:

 Demographics of the User
 Validation that your have a “True User” -
Assurance that you have representative
users.
◦ Let’s look at an example of the start of an eval:
Ulab
2
Did you have any problems finding our location?
 Please tell us the following:
1.
Your age ____
2.
Profession _______________
3.
Amount of free time per week ________
4.
Have you played the game “Reversi” or “Othello”? Yes No
5.
Do you like to play games? Yes
No
If yes, Go to the next page.
__________________________
If no, please answer:
5. Would you play a game when you had free time. Yes No
If yes, Go to the next page.
__________________________
If no, Thanks for you time! Here is your $50 payment.

Ulab
3

You are a person that likes to play
games when you have free time.
You have lots of free time today. Is this
true right now?______________
 A friend has given you the URL for a fun
game.
http://www.gamesforthebrain.com/ga
me/reversi/

You decide to try it out on the
computer..
Remember to think out loud

Ulab
4
You have found the online Reversi game site and
have decided to get started to be able play computer
opponent. Do this now but don’t start playing yet.
Please remember to think out loud.
Please speak out loud the following information:
 What do you see? Give your initial reactions and comments about
what you see.
 What will you do? Give your thoughts about what you will do. Can
you explain why you will do your first action and exactly how will
you do the action (give all movements, key strokes, etc.)

When you have explain all that you see and what
will you do and why will you do what you decided
on, you have completed Task 1 - please raise your
hand.
Ulab
5











Recorded Time started
Facial Expressions Initial reactionsComments
Items clicked on the interface:
Positive reactions:
Negative reactions:
Time Ended for task (raised hand).
Ulab
6
At this time we would like you to play your first move
of the game. Please remember to think out loud.
Slowly do your first move and give us everything that
you see and hear.
 What do you see after the first move?
 What will you do for your second move? Give your
thoughts about what you will do.
Can you explain why you will do your second action and
exactly how will you do the action (give all movements,
key strokes, etc.)


When you have explain all that you see
and what will you do and why will you do
what you decided on, you have
completed Task 2 - please raise your
hand.
Ulab
7
At this time we would like you to play your second
move of the game. Please remember to think out
loud.




Slowly do your second move and give us everything that
you see and hear.
What do you see after the second move?
What will you do for your third move? Give your
thoughts about what you will do.
Are you winning the game?
When you have explain all that you see
and what will you do and why will you do
what you decided on, you have completed
Task 3 - please raise your hand.
Ulab
8
Take a few minutes to look at the game. Please remember to
think out loud. Tell us:

What do you think of the game?




Describe what you see.
What can you do in the game? You can do any
movements to discover the game. (Tell us your thoughts
as you explore)
What would you do to find help for the game?
Do you see anything that would be your score?
Please give us any other comments you have about
what you see.
When you feel you have given us all your impressions, you
have completed Task 4 - please raise your hand.

Ulab
9





Did you enjoy yourself?
What was the hardest?
What was the easiest?
What needs to improve?
Any other comments you would like to give
us?
Ulab
10

Each Breifer/Debriefer hands into D2L a
separate file of the documentation for their
eval with the data, metrics, results, etc..
Ulab
11