GIAnT: Visualizing Group Interaction at Large Display Walls Ulrich - PowerPoint PPT Presentation

GIAnT: Visualizing Group Interaction at Large Display Walls Ulrich von Zadow , Raimund Dachselt CHI, May 2017

Background: Display Walls Display walls: § Very large surfaces § Interactive: Touch, tangibles, pen, distal Wild Room pointing,... [Beaudouin-Lafon et al., 2008] GraSp [Kister et al., 2017] § Very high resolution § Users move around § Multiple users § Public/semi-public NiCE Room [Haller et al., 2008] CityWall [Morrison et al., 2008] 2 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Background: Research in Display Wall Interaction Application Cases Collaboration [Rajabiyazdi et al., 2015] [Jakobsen and Hornbæk, 2014] Awareness Locomotion [Ball et al., 2008] [von Zadow et al., 2016] 3 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

What visualizations would allow us to Research Question: understand multi-user interaction at large display walls more effectively? Challenges: § Support time periods : Provide visualizations that show user behavior over time periods § Provide dimensional mapping : Display high-dimensional data (e.g., 3D position + time) on a 2D display § Support relevant research topics , e.g., collaboration, locomotion, awareness 4 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Related Work: Interaction Analysis Tools Video Coding Tools Tabletop Visualization Toolkits VCode and VData VisTaCo [Hagedorn et al., 2008] [Tang et al., 2010] 5 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Group Interaction Analysis Toolkit GIAnT git repository: https://github.com/imldresden/GIAnT 6 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Time Slider 7 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Video 8 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Timeline View 9 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Wall View 10 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Floor View 11 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Statistics 12 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Visualizations: Timeline View Colors Distance § L*C*h Color Space Position from wall § Different hues across wall § Equal perceptual brightness White dots: Touches Time 13 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Visualizations: Alternative Timeline Distance from wall White dots: Touches Time 14 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Visualizations: Wall View § Color-coded heat map of gaze points § Scatterplot of touches Colors § Additive blending § Regions with overlapping gaze are brighter 15 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Visualizations: Floor View § Heat map of user positions § Current positions as dots, viewpoints as lines 16 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Live Demo 17 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

18 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

GIAnT System Design Visualizations Timeline Wall Floor Statistics Derived data Data Sources User Pos Gaze Dir Touch Video 19 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

GIAnT System Design Data Sources Abstract User Pos Gaze Dir Touch Video data sources Concrete data Marker-based User coding sources Tracking using tangible markers 20 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

GIAnT System Design Technologies Open Source § § Python/libavg https://github.com/imldresden/GIAnT § § SQLite database GPL license § § C++ visualizations for speed Any issues? Contact us! § Preprocessor script 21 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Conclusion: Contributions Group Interaction Analysis Set of Visualizations for Toolkit GIAnT Wall Interaction Analysis § Shows user interaction over § Open Source configurable time periods § § Expandable to new Intelligent dimensional visualizations, data sources, mapping derived data § Supports relevant research topics 22 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

GIAnT GIAnT: Visualizing Group Interaction at Large Display Walls Th Thank ank yo you! https://www.imld.de/giant https://github.com/imldresden/GIAnT Contact: Ulrich von Zadow ulrich.zadow@tu-dresden.de

References 24 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Visualizations: Statistics View • Shows derived data • Parallel coordinates emphasize correlations • Candidate for expansion 25 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

... Extrafolien: • Research topics • ... 26 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays

Visualizations: Colors • Colors determined in L*C*h space. • Users differentiated by hue, equal perceptual brightness and distance. • Lightness available to visualize other variables. • Additive blending results in clearly visible overlaps (e.g. heatmaps) 27 ACM CHI 2017 – IML Dresden – GIAnT: Visualizing Group Interaction at Large Wall Displays