Pedagogical v. Pathfinder:
Reimagining Course & Research Guides for
Student Success
Yoo
Young
Lee
M.
Sara
Lowe
Bronwen
K.
Maxson
Sean
M.
Stone
Digital User Experience Librarian
Educational Development Librarian
Humanities Librarian
Dentistry Librarian
@ IUPUI University Library
@ IUPUI University Library
@ IUPUI University Library
@ IU School of Dentistry
POLL
In one word or
short phrase,
what is the
purpose of
research/course
guides?
https://respond.cc
Session Key: 377971
Responses: https://mqlicker.com/r/i8m1
Q
Does the d esign
a nd la yout of
course & resea rch
guid es impa ct
stud ent lea rning?
Why?
http://www.digitalpedagogylab.com/hybridped/libguides-pedagogy-to-oppress/
Critical Pedagogy
Learning Theory
Cognitive
Load
h t t p s : / / t e a c h i n g h o w 2 s . c o m / b l o g / c o g n i t i v e - l o a d
Guide Design
Pedagogical
Pathfinder
F o r a n e x a m p l e o f a c u r r e n t
p e d a g o g i c a l g u i d e :
h t t p : / / i u p u i . c a m p u s g u i d e s . c o m / b r i d g e
Guide Design
Pathfinder
Guide Design
Pedagogical
O utsid e of the cla ssroom
aka self-directed learning
Methodology
n=22
Workflow
7
6
5
Pre-Survey
4
3
2
1
0
Pathfinder or
Pedagogical
Guide
Simulated
Research
Assignment
Post-Survey
(Usability)
3 scholarly
sources
Methodology
Learning Outcome
Keywords & Synonyms
Developed
Level of Achievement
Emerging
Initial
3
2
1
Sufficient keywords and synonyms
●
●
Rubric
Multiple keywords identified
Multiple, appropriate synonyms
identified for each keyword
Insufficient keywords or synonyms
●
●
Limited identification of keywords
Few or improper synonyms
Minimal keywords and no synonyms
●
●
No keywords beyond those used in
the original question/topic
No viable synonyms found for the
keywords
Research Question
Question is relevant to the topic
Question is kind-of relevant to the topic
– containing elements of the topic but
not everything (e.g., Islam in America)
Question is not relevant to the topic,
very vague, OR only repeats the topic in
question form
Article (Relevance)
Article content seems appropriate for
the proposed question/topic
Article is from an appropriate scholarly
journal
Article is only tangentially related to the
proposed question/topic
Article is from an authoritative source
(e.g., NY Times) but not a scholarly
journal
Explanation is not completely thought
out or clearly copied from article
abstract
Article is not related to the proposed
question/topic
Article is not from an authoritative
source nor a scholarly journal
Article (Scholarly)
Evaluation
Well thought out explanation of how
the article was relevant to the topic or
research question
No explanation or no effort to explain
(e.g., it’s scholarly, I found it in a
database, etc.)
Results
Pedagogical
T1: Home
Guide Interaction
Pathfinder
T4: Articles
T2: 1. Your Question
T3: Reference
Materials
T3: 2. Background
Information & Books
T4: 3. Find Materials
T4: Articles
Results
Pedagogical
Guide-Database Interaction
Pathfinder
Results
Rubric
3
2
1
0
Scholarly Artice
Source Evaluation Research Question
Pedagogical
Keyword
Pathfinder
Sources
Results
Post-Survey
I would like to be able to refer to any subject research guide provided by the…
The research guide helped me find scholarly sources.
I easily remembered how to use the research guide.‡
I learned to use the research guide quickly.*
I was able to recover from mistakes quickly and easily.
I quickly became skillful with it.‡
The resources listed on the research guide were sufficient for my needs.
Overall, I am satisfied with the ease of using the research guide to find a…
The research guide was user friendly.
Overall, I am more confident about research.*
The research guide helped me develop my research question.
I would recommend the research guide to a friend.
The research guide was easy to use.
The research guide helped me improve my research skills.
The research guide helped me evaluate sources (decide if something was a…
I was able to use the research guide without any additional instructions.
The research guide worked the way I want it to work.*
The resources listed on the guide were too many for me.
0
Pedagogical
1
Pathfinder
2
3
4
5
p-value close to 0.05
p-value < 0.05
Results
Post-Survey
I would like to be able to refer to any subject
research guide provided by the library for my…
I easily remembered how to use the research
guide.
I quickly became skillful with it.
I learned to use the research guide quickly.
Overall, I am more confident about research.
The research guide worked the way I want it to
work.
0
Pedagogical
1
Pathfinder
2
3
4
5
Student Perceptions
Pedagogical
Pathfinder
• It is helpful to define
what a scholarly article
is as I didn’t know what
it really meant.
• I don’t know where to
start.
• This is so cool!
[Infographic of the
research process]
• I like the way the
resources are
organized.
• I don’t know how to use
databases and the
research guide doesn’t
help me figure out.
• So confusing.
Insid e the cla ssroom
Methodology
Instruction
•T w o s e c t i o n s o f f i r s t - y e a r
seminar
•n = 4 0
•S a m e p r o f e s s o r
•S a m e l i b r a r i a n
•S a m e c o u r s e c o n t e n t
Assessment
•P r e - T e s t
•P o s t - T e s t & U s a b i l i t y Q u e s t i o n s
•2 w e e k s a f t e r l i b r a r y s e s s i o n
•E n d - o f - S e m e s t e r T e s t
•A n n o t a t e d B i b l i o g r a p h i e s
•R u b r i c
Improvement Between
Assessments
Results
15%
10%
5%
0%
pre-test to post-test
post-test to end-of-semester
-5%
-10%
Pedagogical
Pathfinder
Annotated Bibliography
Rubric
Results
3
2
1
0
Source
Annotation
Evaluation
Pedagogical
Citation‡
Pathfinder
Mechanics
Results
“The research guide helped me…”
choose and/or refine a research topic or research question.‡
choose appropriate databases and places in which to look for
resources.‡
understand the research process and academic scholarship in general.‡
evaluate resources and choose the ones with the highest quality.‡
understand the difference in types of resources like scholarly and
popular.
effectively search for resources (choose keywords, use Booleans, limiters,
etc.).‡
organize and begin to synthesize my resources for use in my research
project.‡
write using proper attributions and citations.
know where to look to find differences and changes in a topic or
discipline.
0
Pedagogical
1
Pathfinder
2
3
4
5
Results
“The research guide helped me…”
choose and/or refine a research topic or research question.‡
choose appropriate databases and places in which to look for
resources.‡
understand the research process and academic scholarship in general.‡
evaluate resources and choose the ones with the highest quality.‡
understand the difference in types of resources like scholarly and
popular.
effectively search for resources (choose keywords, use Booleans, limiters,
etc.).‡
organize and begin to synthesize my resources for use in my research
project.‡
write using proper attributions and citations.
know where to look to find differences and changes in a topic or
discipline.
0
Pedagogical
1
Pathfinder
2
3
4
5
Closing the Loop
Conclusions
Outside the classroom study
Although
no
statistically
significant
performance difference between the two,
students using the pedagogical guide
reported a more positive experience and
greater self-efficacy not seen in students
using the pathfinder guide.
In-classroom study
Students using the pedagogical course
guide demonstrated better learning and
retention of concepts than students using
the pathfinder guide.
Actions
Task
Force
Actions
Heat
Mapping
Changes
Old
New
Student Perceptions
Critical
Pedagogy
Discuss how you think your research process might differ from
someone who does not have access to the resources you have
because you are a student at IUPUI.
• I think it would be fairly difficult because they would have to
go search for research at a library or somewhere else. They
wouldn't have the online resources we used.
• I think anyone outside of college has the exact same
resources as anyone in college. Some databases just require
payment and usually [the] school pays for it.
• They may have to find a different way to access the
information which may be challenging if you do not live near
a library or the people and resources to help you.
Thank You!
Yoo Young Lee
[email protected]
M. Sara Lowe
[email protected]
Bronwen K. Maxson
[email protected]
Sean M. Stone
[email protected]
Questions?
POLL
Will you make
changes to your
guides based
on this
presentation?
https://respond.cc
Session Key: 299976
If so, how?
Responses: https://mqlicker.com/r/s8m3