LECTURE 18:
(EVEN MORE) OPEN PROBLEMS
May 1, 2017
SDS235:
Visual Analytics
Announcements
• Final Project Reception: Wednesday 6pm in Hillyer Atrium
• FP5 Write-ups due May 12th by 4:59pm
• Office hours tomorrow 11:30am – 1pm and by appointment
Details on Final Project Write-ups 1/2
• Abstract and introduction: what is the big question your system
answers? Who is it helping?
• Description of your data: what it looks like, where it came from,
and how you collected it / enriched it
• A discussion of the visualization techniques you chose, and
why they make sense for your application
• An evaluation of your system (this can be a self-evaluation, an
expert critique, a user study: just justify the choice)
• Any future directions you would like to explore
Details on Final Project Write-ups 2/2
CAUSE / APA USCLAP
Undergraduate Statistics Class Project Competition
Deadline for Submission: 30 June 2017
Discussion
What do we know about
Visual Analytics?
Discussion
What are we still learning?
Lesson 1: Perception Matters
• Which of the following scatterplots shows a stronger
correlation?
Harrison, Lane, et al. "Ranking visualizations of correlation using weber's law." Visualization
and Computer Graphics, IEEE Transactions on 20.12 (2014): 1943-1952.
Lesson 1: Perception Matters
Harrison, Lane, et al. "Ranking visualizations of correlation using weber's law." Visualization
and Computer Graphics, IEEE Transactions on 20.12 (2014): 1943-1952.
Lesson 1: Perception Matters
Harrison, Lane, et al. "Ranking visualizations of correlation using weber's law." Visualization
and Computer Graphics, IEEE Transactions on 20.12 (2014): 1943-1952.
Lesson 1: Perception Matters
Harrison, Lane, et al. "Ranking visualizations of correlation using weber's law." Visualization
and Computer Graphics, IEEE Transactions on 20.12 (2014): 1943-1952.
Open Question: How Much?
Kay, Matthew, and Jeffrey Heer. "Beyond Weber's Law: A Second Look at Ranking
Visualizations of Correlation." Visualization and Computer Graphics, IEEE Transactions on 22.1
(2016): 469-478.
Lesson 2: Individual Differences Matter
Brown, Eli T., et al. "Finding waldo: Learning about users from their interactions." Visualization
and Computer Graphics, IEEE Transactions on 20.12 (2014): 1663-1672.
Lesson 2: Individual Differences Matter
Brown, Eli T., et al. "Finding waldo: Learning about users from their interactions." Visualization
and Computer Graphics, IEEE Transactions on 20.12 (2014): 1663-1672.
Open Question: When and How?
Ottley, Alvitta, Huahai Yang, and Remco Chang. "Personality as a Predictor of User
Strategy: How Locus of Control Affects Search Strategies on Tree Visualizations."
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing
Systems. ACM, 2015.
Open Question: When and How?
Ottley, Alvitta, Huahai Yang, and Remco Chang. "Personality as a Predictor of User
Strategy: How Locus of Control Affects Search Strategies on Tree Visualizations."
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing
Systems. ACM, 2015.
Lesson 3: Improving Memorability
Bateman, Scott, et al. "Useful junk?: the effects of visual embellishment on comprehension and
memorability of charts." Proceedings of the SIGCHI Conference on Human Factors in Computing
Systems. ACM, 2010.
Lesson 3: Improving Memorability
Borkin, Michelle, et al. "What makes a visualization memorable?." Visualization and Computer
Graphics, IEEE Transactions on 19.12 (2013): 2306-2315.
Open Question: Does Memorability Matter?
“Visualizations don’t need to be designed for memorability
– they need to be designed for comprehension. For most
visualizations, the comprehension that they provide need
only last until the decision that it informs is made. Usually,
that is only a matter of seconds. When the comprehension
has lasting value, it should be stored in memory, not the
visualization.”
“Information Visualization Research as Pseudo-Science.” Stephen Few, Perceptual Edge.
Visual Business Intelligence Newsletter, October/November/December 2015
Lesson 4: Complementary Strengths
Crouser, R. Jordan, and Remco Chang. "An affordance-based framework for human
computation and human-computer collaboration." Visualization and Computer Graphics,
IEEE Transactions on 18.12 (2012): 2859-2868.
Open Question: How Do We Measure It?
Crouser, R. Jordan, Alvitta Ottley, and Remco Chang. "Balancing Human and Machine
Contributions in Human Computation Systems." Handbook of Human Computation.
Springer New York, 2013. 615-623.
Open Question: How Do We Measure It?
Open Question: How Do We Measure It?
`
Open Question: How Do We Measure It?
ex. Visual Analytics
Adaptive Wise & Supplemental
ex. Fold.it
Adaptive
Wise
Predetermined
Forgetful
`
Predetermined
Wise
ex. ESP Game
ex. reCAPTCHA
Adaptive
Forgetful
ex. Active Learning
Closing activity
• One useful / interesting
thing you learned
• One thing you wish we’d
done differently
• One lingering question
you still have