CSE5390 & 7390 Special Topics in Ubiquitous and Cognitive Computing Tangible User Interfaces Eric C. Larson, Lyle School of Engineering, Computer Science and Engineering, Southern Methodist University 1 1
class logistics • P1 Due this Friday by 5PM • no class this Thursday! • next up for lecture: Danh, Luke, Alex • natural gestures • how were flipped lecture videos last time? 2
presenting discussion • I am sitting in the audience • but I still start lecture… • you summarize the points of the paper • trade off as often as possible: don’t divide by section • bring in your own stories • use contemporary issues, examples • open up debate • less text >= lots of text 3
presenting discussion • these papers are different: less vision; more building • how does it fit into the vision of ubicomp? • motivate the work like you wrote it (own the paper) • explain what was built or evaluated (and if you liked it) • is it good science or just a novel idea? • what can we learn from it? 4
UbiComp Visions • lots of talking thus far, no real apps - is this how you guys feel? say Weiser’s vision again! 5
agenda • tangible bits then and now (ish) 6
tangible bits • Hiroshi Ishii, Associate Director of the MIT Media Lab the development of tangible interfaces requires the rigor of both scientific and artistic review 7
tangible bits • to make the digital bits of information tangible and graspable, physically- embodied digital information in physical space • 1997: • computer beats chess world champion (at chess) • steve jobs returns to apple • end of oklahoma city bombing trial • 2008: • obama elected president • heath ledger dies • tornado in burma; earthquakes in china 8
tangible bits tangible bits is about scientific art projects conceived in such a way to be visionary which lasts generations… 9
art and science 10
tangible bits 1997 • claim is that it is different than ubiquitous computing • thesis : tangible interfaces afford more traditional interaction and are naturally ubiquitous • ubicomp genre : interaction • “I nteractions between people and cyberspace are now largely confined to traditional GUI-based boxes sitting on desktops or laptops. The interactions with these GUIs are separated from the ordinary physical environment within which we live and interact. ” 11
TUI example 1: metaDESK 12
TUI example 1: metaDESK what are tangible equivalents of other UI design elements? toggles breadcrumbs list box notifications date/time picker modal image 13
TUI example 2: ambientROOM • tangible gives better affordances • when constant, we tune it out • changes trigger attention • would this be a better way to get notifications? • TUI3: they also did transBOARD • but it wasn’t all that compelling 14
TUI example 2: ambientROOM 15
strengths / weaknesses • explored an unprecedented number of new interactions techniques • extremely technical implementations without technical baggage • but this also hides deficiency in the design • how many people thought all these things were created and usable? • visionary in that it codified a field of existing research and made it into a field of HCI • created the field of tangible computing • tangible UIs are limited in a way that pixels are not 16
tangible bits 2008 • claim TUI are appropriate for many spaces, but not general computing • thesis : application space of TUIs is mature and we are ready to move to the next phase • ubicomp genre : interaction and vision • “ Where the sea meets the land, life has blossomed into a myriad of unique forms in the turbulence of water, sand, and wind. At another seashore between the land of atoms and the sea of bits, we are now facing the challenge of reconciling our dual citizenships in the physical and digital worlds. ” 17
tangible bits 2008 slides provided by Hiroshi Ishii • TUI has many genres for applications: • tangible telepresence • kinetic memory • constructive assembly • tokens and constraints • tabletop surfaces • continuous plastic (deformable) • augmented everyday objects • ambient media 18
designing tangible bits • build on design through MVC • defines how each element communicates model “radios” to subscribers model controller has direct reference to view and controller model view “targets” generic controller from actions view 19
designing tangible bits • build on design through MVC • defines how each element communicates digital info “radios” to subscribers information controller has direct reference to view and model, interprets collisions controller visual/force feedback intangible view tangible view view “targets” generic controller from actions 20
design gets complicated quickly tangible intangible view view 21
properties of a tangible view • often NOT visual changes that get conveyed • weight • size excellent affordances: tangible view • temperature plus the tactile representation in our brain! • texture • springy-ness • sound • shadow 22
an example of tangible 23
vision should not be ignored 24
the elephant in the room Through the design of a variety of TUIs, however, we have learned that TUIs are limited by the rigidity of “atoms” in comparison with the fluidity of “bits” . TUIs have limited ability to change the form or properties of physical objects in real time. This constraint can make the physical state of TUIs inconsistent with the underlying digital models. 25
26
a vision for 100 years 27
a vision for 100 years 28
a vision for 100 years 29
for next class... • Thursday: no class! • Tuesday: first student lead discussion • natural user interfaces 30
CSE5390 & 7390 Special Topics in Ubiquitous and Cognitive Computing Tangible User Interfaces Eric C. Larson, Lyle School of Engineering, Computer Science and Engineering, Southern Methodist University 31 31 31
phantom haptics: leveraging the digital • thesis: richer haptic output can be achieved • ubicomp genre: interaction • problem: creating phantom sensations from a vibration array CSE5390 & 7390 Special Topics in 32 Ubiquitous Computing
phantom haptics: technique CSE5390 & 7390 Special Topics in 33 Ubiquitous Computing
phantom haptics: evaluation • four users • various continuous motions • “clarity” of creeping effect was then evaluated CSE5390 & 7390 Special Topics in 34 Ubiquitous Computing
strengths and weaknesses • work in progress • weak user study • interesting idea, with good motivation • no control case • limited to entertainment • only on back! CSE5390 & 7390 Special Topics in 35 Ubiquitous Computing
more tangible bits 36
Recommend
More recommend
