Authentic Assessment Strategies for Online
Learning
AUTHENTIC ASSESSMENT STRATEGIES
FOR ONLINE LEARNING
Denise Lowe | University of Central Florida |
[email protected]
1
AFTER PARTICIPATING IN THIS WEBCAST…
…. You will be able to align assessments with learning
activities and outcomes in an online environment.
2
Academic Impressions
1
Authentic Assessment Strategies for Online
Learning
AGENDA
• Student Integrity
• Faculty Methodology
• Authentic Assessment
• Cognitive Load
• Anatomy of a Test Item
• LMS Assessment Tool Options
3
“Do you expect technology to compensate for a lack of ethics?”
Charles Dzuiban, PhD, RITE, UCF
STUDENT INTEGRITY
4
Academic Impressions
2
Authentic Assessment Strategies for Online
Learning
STUDENT INTEGRITY
Cheating is being redefined….
“Helping”
5
25%
6
Academic Impressions
3
Authentic Assessment Strategies for Online
Learning
TOP 5 WAYS STUDENTS CHEAT WITH TECHNOLOGY
FORD, C. (2009) ACADEMICS, SPECIAL REPORT: HTTP://WWW.HIGHEREDMO RNING.COM/CATEGORY/SPECIAL-REPORT
7
STUDENT INTEGRITY
• No magical way to prevent cheating
• Cheating occurs in all educational modalities
• No such thing as a “closed book” assessment in online courses
8
Academic Impressions
4
Authentic Assessment Strategies for Online
Learning
Using a learning taxonomy as a guide…
FACULTY METHODOLOGY
9
Bloom’s Learning Taxonomy
10
Academic Impressions
5
Authentic Assessment Strategies for Online
Learning
Traditional
Alternative
11
Bloom’s Learning Taxonomy
12
Academic Impressions
6
Authentic Assessment Strategies for Online
Learning
Learning, not control
Learning is the goal
13
How is the issue of academic
integrity being handled at your
institution?
14
Academic Impressions
7
Authentic Assessment Strategies for Online
Learning
Using other assessment strategies…
AUTHENTIC ASSESSMENT
15
16
Academic Impressions
8
Authentic Assessment Strategies for Online
Learning
Interpretations
Quote applied to different eras, economies, countries, etc.
October 7, 2008
"...I think it [health care] should be a right for every
American. In a country as wealthy as ours…”
March 2, 1943
“National compulsory insurance for all classes for all
purposes from the cradle to the grave.”
17
Different messages in time and modality with similar
meanings
18
Academic Impressions
9
Authentic Assessment Strategies for Online
Learning
Pictorials and Audio
Using photographs, drawings, schematics, artwork, or
musical clips
19
Using “hot spots” to edit a technical document
20
Academic Impressions
10
Authentic Assessment Strategies for Online
Learning
Simulations, Role Play, Learning Games
Medicine
Theater
21
Home Studies, Real-World Events
Social Work
Political Science
22
Academic Impressions
11
Authentic Assessment Strategies for Online
Learning
Collaboration
Use problem-based learning as a group project with a
specific challenge to address
23
Socratic Dialogue
Small group discussions
Buzz groups
Case discussions
Debate
Jigsaw groups
Mock trials
24
Academic Impressions
12
Authentic Assessment Strategies for Online
Learning
Assessment Construction
25
Assessment Construction
Critical Thinking
Relevant
Transfer of Knowledge
26
Academic Impressions
13
Authentic Assessment Strategies for Online
Learning
What is the acceptance level
among faculty for using
alternative assessments at your
institution?
27
What factor seems to mostly
affect the adoption of alternative
assignments in online courses?
28
Academic Impressions
14
Authentic Assessment Strategies for Online
Learning
What is it and how does it effect my assessment strategy?
COGNITIVE LOAD
29
Cognitive Load
http://theelearningcoach.com/learning/what-is-cognitive-load/
30
Academic Impressions
15
Authentic Assessment Strategies for Online
Learning
Types of Cognitive Load
http://theelearningcoach.com/learning/what-is-cognitive-load/
31
Magic #7
32
Academic Impressions
16
Authentic Assessment Strategies for Online
Learning
33
Overload?
34
Academic Impressions
17
Authentic Assessment Strategies for Online
Learning
Impact?
Higher Complexity
Less Items Needed
35
Examples of effective test questions…
ANATOMY OF A TEST ITEM
36
Academic Impressions
18
Authentic Assessment Strategies for Online
Learning
Anatomy of Test Item
Keep it simple:
• Only include relevant information in the question stem
• Add common words to stem instead of in each alternative
37
Anatomy of Test Item
Limit the use of:
• Negatives (e.g., Not, Except)
• Distractors (All or None of the Above)
Put alternatives in a logical order
Include the same number of alternatives for each item
38
Academic Impressions
19
Authentic Assessment Strategies for Online
Learning
True / False: #1
Test Objective: Identify how the issue of slavery impacted the
Civil War and American society at that time.
One of the causes of the Civil War were differences
concerning the elimination of slavery.
This is simple recall of information, yes/no answer.
39
Test Objective: Identify how the issue of slavery impacted
the Civil War and American society at that time.
Improved
The type of individual that would support abolitionism
would likely be a rural farmer or capitalist.
This requires an understanding of the concept of abolitionism
and its impact on the lives & livelihood of societal members.
40
Academic Impressions
20
Authentic Assessment Strategies for Online
Learning
Multiple Choice #1
When differentiating between a supervisor and a leader, it is
best to remember that a leader:
a. Is a person who has commanding authority or influence
b. Is at the forefront of a movement
c. Is tending toward a definite result
d. All of the above*
Requires knowledge recall, no concept understanding
41
Improved
As the overseer of a major retail department store, Jennifer received a
directive to increase departmental profits. She implements a change in
procedures, but this has never been tried before. The leadership trait
she is mostly demonstrating is:
a. Commanding authority or influence
b. Using existing policies to address an issue
c. Taking initiative by setting a new precedent*
d. Discussing the concerns of superiors with her staff
Requires differentiation of traits and knowledge application
42
Academic Impressions
21
Authentic Assessment Strategies for Online
Learning
Multiple Choice #2
As discussed in the lecture notes, the three power bases are:
a. Knowledge, educational, and textbook
b. Positional, personal, and knowledge*
c. Educational, experiential, and practical
Requires knowledge recall only, no concept relationships
43
Improved
Jack works for IBM as a computer programmer. He is known for his
multi-colored hair styles, casual dress, and body piercings. Jack is a
talented programmer who works well with his peers. Jack’s style is
expressed through which power base?
a. Knowledge
b. Personal*
c.
Positional
d. Educational
Requires knowledge application and concept understanding
44
Academic Impressions
22
Authentic Assessment Strategies for Online
Learning
Multiple Choice #3
Being proactive as a leader, as defined by Covey, is to:
a. Take responsibility for the course of our lives*
b. Prioritize
c. Creatively cooperate with others
d. All of the above
Requires knowledge recall, no understanding of the
individual concepts
45
Improved
Sandy has experienced conflict with a co-worker for some time. She
has complained of her situation to her peers. After learning about
Covey’s 7 Habits, she decides on a proactive approach - taking
responsibility for her actions. Which of the following actions best
reflects that position?
a. Speaks directly with her co-worker to resolve the issue*
b. Blames her co-worker for creating the conflict
c. Signs up for a team project with her co-worker
d. Files a complaint against her co-worker with their supervisor
Requires knowledge application, concept relationship
46
Academic Impressions
23
Authentic Assessment Strategies for Online
Learning
Multiple Choice #4
Ribosomes are important for:
a) the nucleus
b) DNA
c) Cellulose
d) Protein synthesis*
Knowledge recall - Must know what ribosomes are.
47
Improved
Suppose you thoroughly and adequately examined a particular type of
cell, using the transmission electronic microscope, and discovered
that it completely lacked ribosomes. You would then conclude that
this cell also lacked:
a) A nucleus
b) DNA
c) Cellulose
d) Protein synthesis*
Knowledge application - must know the relationship between
ribosomes and cells.
48
Academic Impressions
24
Authentic Assessment Strategies for Online
Learning
Multiple Choice #5
Which of the following is a category in the taxonomy of the cognitive
domain?
a. Reasoning ability
b. Critical thinking
c.
Rote learning
d. All of the above
e. None of the above*
Only asks for simple identification of a category; contains “all of
the above” and “none of the above” as option choices, which should
be avoided, if possible. (recall)
49
Improved
What is the most complex level in the taxonomy of the cognitive
domain?
a. Knowledge
b. Synthesis
c.
Evaluation*
d. Analysis
e. Comprehension
This item asks for differentiation between levels. (comprehension)
50
Academic Impressions
25
Authentic Assessment Strategies for Online
Learning
Which tool options should I use….and why?
LMS ASSESSMENT TOOL
OPTIONS
51
LMS Assessment Tool
Randomization
52
Academic Impressions
26
Authentic Assessment Strategies for Online
Learning
LMS Assessment Tool
Assessment time limits
53
LMS Assessment Tool
Rules for assessment completion
Proctoring
54
Academic Impressions
27
Authentic Assessment Strategies for Online
Learning
What type of faculty development
is offered at your institution to
encourage authentic
assessment?
55
Resources Available
Faculty Seminars in Online Teaching
• http://teach.ucf.edu/2010/12/14/effective-online-assessmentscalable-success-strategies/
Socratic Dialogue
• http://www.ion.uillinois.edu/resources/otai/Socratic.asp
Teaching Online Pedagogical Repository
• http://topr.online.ucf.edu/index.php/Main_Page
56
Academic Impressions
28
Authentic Assessment Strategies for Online
Learning
Questions, Comments, Feedback
Dr. Denise Lowe
Instructional Design Team Lead
University of Central Florida
[email protected]
407-823-4272
57
THANK YOU!
Please remember to complete the event evaluation.
You comments will help us continually improve the
quality of our programs.
Follow us:
58
Academic Impressions
29