Outline A Study of Digital Ink in t Background & - PDF document

Outline A Study of Digital Ink in ε t ε ε ε • Background & Motivation Lecture Presentation • Study Richard J. Anderson * , Ruth Anderson *† , • Attentional Marks & Hand Gestures Crystal Hoyer * , and Steven A. Wolfman *‡ • Ephemerality & Persistence * U. Washington, † U. Virginia, ‡ U. British Columbia • Conclusions & Future Directions Steve Wolfman presenting http://www.cs.washington.edu/research/edtech/ Steve Wolfman A Study of Digital Ink in Lecture Presentation 2 Research History Expected Use of Ink ε ε t ε ε ε t ε ε ε Distance & Large Class Studies [SIGCSE ’02, ITiCSE ’02 & ’03] Presenter [SIGCSE ’04] Classroom Feedback Ink System [CSCL ’03] Study Retro/Prospective Student Interaction Systems Feedback Patterns [ITiCSE ’04] [CHI ’03] Steve Wolfman A Study of Digital Ink in Lecture Presentation 3 Steve Wolfman A Study of Digital Ink in Lecture Presentation 4 Common Use of Ink Outline ε ε t ε ε ε ε t ε ε Background & Motivation • Study • Attentional Marks & Hand Gestures • Ephemerality & Persistence • Conclusions & Future Directions Steve Wolfman A Study of Digital Ink in Lecture Presentation 5 Steve Wolfman A Study of Digital Ink in Lecture Presentation 6 1

Ink Study Prevalence of Attentional Marks ε ε t ε ε ε t ε ε ε Interpretive analysis [Erickson] of 3 courses: Segmented strokes from six hours of lecture into coherent episodes and coded into four – Distance courses ( ∴ , A / V and ink archives) categories: – “Slideware-style” – Experienced instructors % of strokes % of episodes Lectures Time Topic B C B+C B C B+C Prof A. 4 6 hrs Compilers Attentional 49 53 51 77 74 76 Prof B. 8 20 hrs AI Diagram 9 7 8 8 8 8 Writing 41 38 40 14 16 15 Prof C. 10 23 hrs Databases Other 1 2 1 2 2 2 Steve Wolfman A Study of Digital Ink in Lecture Presentation 7 Steve Wolfman A Study of Digital Ink in Lecture Presentation 8 Outline Understanding Attentional Marks ε ε t ε ε ε ε ε ε t Background & Motivation Properties: Study – brief, simple markings • Attentional Marks & Hand Gestures – occur with speech – augment meaning of speech • Ephemerality & Persistence – ad hoc form • Conclusions & Future Directions Is there a linguistic context in which to understand these marks? Steve Wolfman A Study of Digital Ink in Lecture Presentation 9 Steve Wolfman A Study of Digital Ink in Lecture Presentation 10 Gesture Types: Iconic Spontaneous Hand Gestures ε t ε ε ε ε ε t ε ε Spontaneous Hand gestures [McNeill]: – are synchronous w/speech – are co-expressive w/speech – lack standard of form Attentional marks share these properties. Steve Wolfman A Study of Digital Ink in Lecture Presentation 11 Steve Wolfman A Study of Digital Ink in Lecture Presentation 12 2

Gesture Types: Deictic & Cohesive Outline ε ε t ε ε ε t ε ε ε Background & Motivation Study Attentional Marks & Hand Gestures • Ephemerality & Persistence • Conclusions & Future Directions Steve Wolfman A Study of Digital Ink in Lecture Presentation 13 Steve Wolfman A Study of Digital Ink in Lecture Presentation 14 Persistent Representation vs. Persistent Representation vs. Ephemeral Meaning Ephemeral Meaning ε ε t ε ε ε ε t ε ε Steve Wolfman A Study of Digital Ink in Lecture Presentation 15 Steve Wolfman A Study of Digital Ink in Lecture Presentation 16 Design Recommendations “Whiteboard” Effect [Prince] ε ε t ε ε ε ε t ε ε • Separate strokes w/non-homogenous color • Show co-occurrence/ordering w/age cues • Show process w/incremental rendering Steve Wolfman A Study of Digital Ink in Lecture Presentation 17 Steve Wolfman A Study of Digital Ink in Lecture Presentation 18 3

Candy-Striping [Prince] Conclusions ε ε t ε ε ε ε t ε ε • Identified important ink use pattern: Attentional Marks • Established gestural framework for understanding/analyzing Attentional Marks • Demonstrated tension between ephemeral meaning and persistent representation • Generated design recommendations to resolve tension • Characterized instructors’ parsimonious use of UI features Steve Wolfman A Study of Digital Ink in Lecture Presentation 19 Steve Wolfman A Study of Digital Ink in Lecture Presentation 20 Future Directions URLs for More Info ε ε t ε ε ε ε t ε ε • Alternate ink renderings UW CS&E Education & Ed. Tech. Group: http://www.cs.washington.edu/research/edtech/ • Augmented transcripts Classroom Presenter: – Keyframing http://www.cs.washington.edu/education/dl/presenter/ – Deixis resolution for blind students • Improved recognition – Auto-captioning – Link time/speech to slide locations • Further analysis Steve Wolfman A Study of Digital Ink in Lecture Presentation 21 Steve Wolfman A Study of Digital Ink in Lecture Presentation 22 Surprising Use of Attentional Marks (1 of 3) EXTRA ε t ε ε ε ε ε t ε ε SLIDES: NEW SURPRISING USE Steve Wolfman A Study of Digital Ink in Lecture Presentation 23 Steve Wolfman A Study of Digital Ink in Lecture Presentation 24 4

Surprising Use of Attentional Marks (2 of 3) Surprising Use of Attentional Marks (3 of 3) ε ε t ε ε ε ε ε ε t Steve Wolfman A Study of Digital Ink in Lecture Presentation 25 Steve Wolfman A Study of Digital Ink in Lecture Presentation 26 EXTRA ε t ε ε ε ε ε ε ε t SLIDES: MOTIVATING PROBLEMS Steve Wolfman A Study of Digital Ink in Lecture Presentation 27 Steve Wolfman A Study of Digital Ink in Lecture Presentation 28 “Sticky” Colors “Feature Recovery” Problem ε ε t ε ε ε ε ε ε t Steve Wolfman A Study of Digital Ink in Lecture Presentation 29 Steve Wolfman A Study of Digital Ink in Lecture Presentation 30 5

Gesture Types: Metaphoric EXTRA ε ε t ε ε ε t ε ε ε SLIDES: GESTURE TYPES Steve Wolfman A Study of Digital Ink in Lecture Presentation 31 Steve Wolfman A Study of Digital Ink in Lecture Presentation 32 Gesture Types: Beats ε t ε ε ε Steve Wolfman A Study of Digital Ink in Lecture Presentation 33 6