Pervasive Displays Reto Achermann acreto@student.ethz.ch March 12, - PowerPoint PPT Presentation

Pervasive Displays Reto Achermann acreto@student.ethz.ch March 12, 2013 Distributed Systems Seminar 1

March 12, 2013 PERVASIVE DISPLAYS PART I: Distributed Systems Seminar http://www.1815.ch/images/4419_1.jpg 2 http://www.google.com/sync/images/sync-contacts.png http://www.google.com/glass/start/what-it-does/ http://g-ecx.images-amazon.com/images/G/01/electronics/detail-page/B004TT01JS-cloudl.jpg

Pervasive Displays  Just “screens everywhere” ? http://www.timessquarenyc.org/image.aspx?id=1838&width=1370&height=870 Not really… March 12, 2013 Distributed Systems Seminar 3

Pervasive Displays  Pervasive  “ spreading widely throughout an area or a group of people ”  Display  “ electronic device for visual presentation ”  “printing the arrangement and choice of type in a style intended to attract attention ”  “a collection of objects for public viewing ” - Oxford English Dictionary March 12, 2013 Distributed Systems Seminar 4

Pervasive / Ubiquitous Computing  Pervasive displays as part of pervasive / ubiquitous computing  Principles of Ubiquitous Computing  “The purpose of a computer is to help you do something else. ”  “The best computer is a quiet, invisible servant .”  “The more you can do by intuition the smarter you are; the computer should extend your unconscious .” http://en.wikipedia.org/wiki/File:Mark_weiser.jpg  “Technology should create calm .” - Mark Weiser (1952-1999) March 12, 2013 Distributed Systems Seminar 5

“Today’s public display systems are largely closed and isolated, with tightly controlled screen access .” Analogy: Old mobile phones – current public display systems - Nigel Davies et al. March 12, 2013 Distributed Systems Seminar 6

March 12, 2013 In the early days… Public Information Distributed Systems Seminar Advertisement 7 http://4.bp.blogspot.com/_UtUFvF_vRlo/SFAlhV1cwXI/AAAAAAAAAUU/G5GpdArwqtg/s1600/1904+coke+ad.jpg http://store.ushistory.org/images/medium/want-dalton.jpg

… and today http://blog.hslu.ch/outofhomedisplays/wp-content/blogs.dir/183/files/point-of-transportation/apg_epanel_zuerich_2.jpg  Information presented to the user interleaved with ads  Content is very repetitive: Information / News Display User gets bored  No interaction or possibility to change content http://www.1815.ch/images/4419_1.jpg  Showed content may be moving / flickering to attract Electronic Advertising the attendance March 12, 2013 Distributed Systems Seminar 8

… and today  Interaction needs application (tag reader) or sending SMS http://www.hersche.at/uploads/plakat_appenzeller_kalte_fusse_gr10_zugeschn_korr.jpg  Augmentation is sometimes Poster Advertising inaccurate / impossible without location service http://upload.wikimedia.org/wikipedia/commons/thumb/7/7b  Maps just show “Here are you” indicator (hard to find) Augmentation March 12, 2013 Distributed Systems Seminar 9

Display Types  Static Displays:  Dynamic Displays:  Cannot change the content  Can change content shown shown dynamically  Provide no direct feedback  Can provide direct feedback http://www.hersche.at/uploads/plakat_appenzeller_kalte_fusse_gr10_zugeschn_korr.jpg  Cheap (big surface)  Relatively expensive  Require no energy  Require energy and actively driven input  LCD Screens, Projectors  Posters, Maps, Objects http://www.1815.ch/images/4419_1.jpg Both may be location / environment aware March 12, 2013 Distributed Systems Seminar 10

Are today’s displays pervasive?  “ Yes ” in the sense of Oxford dictionary  No in the sense of ubiquitous computing  People have adapted to ignore the displays http://www.timessquarenyc.org/image.aspx?id=1838&width=1370&height=870  Fast moving pictures distract calmness http://www.beobachter.ch/typo3temp/pics/SBB-Automaten_d5c70a1bcd.jpg  Almost no interaction / non-intuitive interaction  Interaction / augmented reality is “plug -and- play” instead of “arrive -and- operate”  Displays provide no / too less help in doing something http://1.bp.blogspot.com/ March 12, 2013 Distributed Systems Seminar 11

Observation: Smartphones are everywhere http://www.springwise.com/img/uploads/2012/09/dandeacon.jpg “The first truly pervasively available interaction devices ” - Robert Hardy 12

Observation: Smartphones are everywhere  Equipped with various sensors, radio interfaces, acoustic & haptic feedback and touch displays  Problem: Interaction with displays using smart phones today is inconvenient, not always working and clumsy  Idea: use of technology provided by the smartphone in a smart way for interaction March 12, 2013 Distributed Systems Seminar 13

March 12, 2013 The vision in the movies DreamWorks Pictures Minority Report, Distributed Systems Seminar 20 th Century Fox Avatar Visions 14 http://jordster4000.blogspot.ch/2011/09/layout-design-research.html http://www.bitrebels.com/wp-content/uploads/2010/12/Kinect-Minority-Report-UI-2.jpg

Visions Interactive Street Map  Intuitively select an element on the map  Get related information of selected object  Query / Filter: Get list of all restaurants in a specific area  Show directions to object http://www.pre.ethz.ch/address/ March 12, 2013 Distributed Systems Seminar 15

Visions Interactive Mensa Menu  Show additional information:  Menu ratings  Alternative Menus at other location  Filter according to preferences http://a5.mzstatic.com/us/r1000/103/Purple/ef/b1/26/mzl.jlmdxofp.320x480-75.jpg  Example: Diet help  Caloric values directly added to diary  Do not show menu which do not fit  Example: Allergic / Health  Hide menus containing certain ingredients  Show warnings March 12, 2013 Distributed Systems Seminar 16

Visions Passive Interaction with Displays  No need for taking the phone out of the pocket  Walk-by / be present as interaction event  Display spontaneously react to your presence and shows content you like (pictures, videos) Privacy?  Example: Screen at CAB Foyer  You like to see images of D-INFK events  Your phone tells the screen wirelessly  Screen displays selection of photos March 12, 2013 Distributed Systems Seminar 17

Visions Personalized Content  Content is chosen according to personal preferences  Switch paintings of e-gallery  Show news you’re interested in / weather of your location  Show tailored advertisement http://i.telegraph.co.uk/multimedia/archive/01655/flags-street1_1655777i.jpgc  Showing related information to query  Several social issues  Example: Team Support  A group of soccer fans meet www.google.com  The displays show the colors of the favorite team March 12, 2013 Distributed Systems Seminar 18

Visions Augmented Displays  A tablet’s display augment the view of the current display  Different angle / layer  Annotations  Show additional information of the elements shown http://jordster4000.blogspot.ch/2011/09/layout-design-research.html  Example: Doctors  Different experts analyze a patient  Cardiologist  Sinologist  Surgeon  All have different interests concerning the patient’s health state March 12, 2013 Distributed Systems Seminar 19

Visions Houses as Displays http://troyh.us/photos/City%20Skylines%20&%20Downtown/13704%20Dallas%20skyline%20at%20night.jpg  Using the façade of a house as a game display Boring et al 2011 March 12, 2013 Distributed Systems Seminar 20

Visions Projected Displays  Video:  http://www.youtube.com/watch?feature=player_embedded &v=df1NO7MoAUY March 12, 2013 Distributed Systems Seminar 21

March 12, 2013 INTERACTION WITH DISPLAYS PART II Distributed Systems Seminar 22 http://farm4.staticflickr.com/3259/3221222512_723ed0e083_z.jpg?zz=1 http://b.vimeocdn.com/ts/356/389/356389029_640.jpg

Physical Buttons 1. Physical Buttons  Select elements by pressing buttons  Buttons can be marked to distinguish them blindly  Drawbacks:  Not always clear what different buttons do http://preview.turbosquid.com/Preview/2011/09/  Unclear element highlighting  No button adaption to different content  Button interface is not extensible March 12, 2013 Distributed Systems Seminar 23

Touch Screens 2. Touch Screens  Interact by touching the element directly on the screen  More intuitive than physical buttons, adaptable interface https://activecaptain.com/articles/mobilePhones/iPhone/iPhone_Keyboard.jpg  Drawbacks:  Indistinguishable buttons (no blind navigation)  Dirty displays  Not well suited for very large screens  Not working with  Displays behind security glass  Displays far away  Wet fingers / gloves March 12, 2013 Distributed Systems Seminar 24

Bluetooth 3. Bluetooth Device Names for Interaction  Idea: send service requests to displays wirelessly  Issues tackled:  SMS: untrusted number (premium service), need to know display ID  App: download necessary (inconvenient)  Touching may not be possible  Observation: many users have device supporting Bluetooth and have set a custom USB device names [Nigel Davis et al]  Approach: Use of Bluetooth device discovery and Bluetooth device names to send requests March 12, 2013 Distributed Systems Seminar 25