Part B – 20 pts due 10/30
Part C – 20 pts due 11/9
ULAB presentation – 25 pts due 11/16
Ulab
1
You may want to meet in the computer lab so that
each of you has a computer to do the evaluation.
1. Make sure all team members have brought a
copy of their Web D evaluation sheet. If any
member did not bring their web D evaluation
sheet – cancel meeting and reschedule.
2. One of the members needs to be the Scribe
(secretary) for this meeting. Name: __________
3. List the Ulab member by last name (alphabetical
order) and Mark their Eval as “XD1, XD2, XD3,
XD4, etc. (where X is your ULAB team number)
Ulab
2
4. Give the Web D evaluation sheets to each
member using the alphabetical order (round
robin). {If team is Badre, Johnson, Sawler, Quin.
The Badre’s goes to Johnson, Johnson’s goes to
Sawler, etc)
5. Separate, go to a quiet place and do the
evaluation sheet while recording all the sheet asks
you to record. If you want to make other notes –
please do so.
6. Come back together and discuss the findings.
The scribe should take notes of the discussion.
7. Decide on the top three and edit those
evaluations as team. These three evals will be
given to another team on Tuesday Nov. 1 so they
need to be edited till perfect…
Hand into Ulab assignment folder by 10/23 10/30
Ulab
3
Ulab
4
Preparation of ULAB EVAL part C
 Before Tuesday, Nov 1 – decide and state the roles of
your team members:
◦ One Breifer/Debriefer for each eval
◦ One User for each eval
◦ Rest of members are Loggers for each eval

B/D responsibilities

Loggers responsibilities

Users Responsibilities
◦ Read, practice, and if necessary, edit the eval you will lead
◦ Decide on the metrics you will uncover to assess the design
stance of the site. Document this with justifications.
◦ Practice the “think out loud” method by documenting your
Web D site task 2 again.
Ulab
5
your ULAB team will be given 3 Evals to
perform on their design stance.
Need:
 Day/Time, members present, setting,
environment & location
 To start each of the Evals – need:

 Demographics of the User
 Validation that your have a “True User” -
Assurance that you have representative
users.
◦ Let’s look at an example of the start of an eval:
Ulab
6
Did you have any problems finding our location?
 Please tell us the following:
1.
Your age ____
2.
Profession _______________
3.
Amount of free time per week ________
4.
Have you played the game “Reversi” or “Othello”? Yes No
5.
Do you like to play games? Yes
No
If yes, Go to the next page.
__________________________
If no, please answer:
5. Would you play a game when you had free time. Yes No
If yes, Go to the next page.
__________________________
If no, Thanks for you time! Here is your $50 payment.

Ulab
7

You are a person that likes to play
games when you have free time.
You have lots of free time today. Is this
true right now?______________
 A friend has given you the URL for a fun
game.
http://www.gamesforthebrain.com/ga
me/reversi/

You decide to try it out on the
computer..
Remember to think out loud

Ulab
8
You have found the online Reversi game site and
have decided to get started to be able play computer
opponent. Do this now but don’t start playing yet.
Please remember to think out loud.
Please speak out loud the following information:
 What do you see? Give your initial reactions and comments about
what you see.
 What will you do? Give your thoughts about what you will do. Can
you explain why you will do your first action and exactly how will
you do the action (give all movements, key strokes, etc.)

When you have explain all that you see and what
will you do and why will you do what you decided
on, you have completed Task 1 - please raise your
hand.
Ulab
9











Recorded Time started
Facial Expressions Initial reactionsComments
Items clicked on the interface:
Positive reactions:
Negative reactions:
Time Ended for task (raised hand).
Ulab
10
At this time we would like you to play your first move
of the game. Please remember to think out loud.
Slowly do your first move and give us everything that
you see and hear.
 What do you see after the first move?
 What will you do for your second move? Give your
thoughts about what you will do.
Can you explain why you will do your second action and
exactly how will you do the action (give all movements,
key strokes, etc.)


When you have explain all that you see
and what will you do and why will you do
what you decided on, you have
completed Task 2 - please raise your
hand.
Ulab
11
At this time we would like you to play your second
move of the game. Please remember to think out
loud.




Slowly do your second move and give us everything that
you see and hear.
What do you see after the second move?
What will you do for your third move? Give your
thoughts about what you will do.
Are you winning the game?
When you have explain all that you see
and what will you do and why will you do
what you decided on, you have completed
Task 3 - please raise your hand.
Ulab
12
Take a few minutes to look at the game. Please remember to
think out loud. Tell us:

What do you think of the game?




Describe what you see.
What can you do in the game? You can do any
movements to discover the game. (Tell us your thoughts
as you explore)
What would you do to find help for the game?
Do you see anything that would be your score?
Please give us any other comments you have about
what you see.
When you feel you have given us all your impressions, you
have completed Task 4 - please raise your hand.

Ulab
13





Did you enjoy yourself?
What was the hardest?
What was the easiest?
What needs to improve?
Any other comments you would like to give
us?
Ulab
14

Each Breifer/Debriefer hands into D2L a
separate file of the documentation for their
eval with the data, metrics, results, etc..
Ulab
15



The last member who was not a B/D will be the
presenter of the evaluations in the “Ulab
Presentation” for 25 pts. If all team members
were B/D – then the Ulab presentation is done by
each of you.
The presentation is a Utube recording with all
team members in attendance. The presenter
discusses the design stance found by each user.
Team members interject a final comment on each
eval.
Please submit the URL of the recording in D2L.
Make sure that the recording is not private so
that I can view.
Ulab
16