gaussbricks
play

GaussBricks: Magnetic Building Blocks for Constructive Tangible - PowerPoint PPT Presentation

Sep 20, 2023 •176 likes •847 views

GaussBricks: Magnetic Building Blocks for Constructive Tangible Interactions on Portable Displays Rong-Hao Liang, Liwei Chan, Hung-Yu Tseng, Han-Chih Kuo, Da-Yuan Huang, De-Nian Yang, and Bing-Yu Chen National Taiwan University & Academia

  1. GaussBricks: Magnetic Building Blocks for Constructive Tangible Interactions on Portable Displays Rong-Hao Liang, Liwei Chan, Hung-Yu Tseng, Han-Chih Kuo, Da-Yuan Huang, De-Nian Yang, and Bing-Yu Chen National Taiwan University & Academia Sinica

  2. Creating Physical Forms to Interact with Virtual Contents on Portable Displays

  3. Building Blocks

  4. Creating Geometries and Structures by Nathan Sawaya

  5. Creating Mechanical Movements

  6. Constructive Assembly TUIs Topobo [Raffle et. al. CHI ’04]

  8. Blocks [Anderson et. al. SIGGRAPH ’00] Active Blocks: battery & microcontroller

  9. DuploTrack [Gupta et. al. UIST ’12] Passive blocks - Cameras

  10. ? Portable Displays

  11. X Passive blocks - Optical Camera

  12. Token Passive blocks - Capacitive Tracking

  13. Capstones [Chan et. al. CHI ‘12] Passive blocks - Capacitive Multitouch Displays

  14. Optical tracking is occlusion-sensitive Optical Optical Tags 3D Cameras 2D Hardware Token+Surface Constructive Assembly TUI Design Space of Portable Displays

  15. Capacitive tracking cannot effectively support form construction Optical Optical Tags 3D Cameras CapStones [Chan et. al. CHI’12 ] Capacitive Capacitance Multitouch 2D Tags Display Hardware Token+Surface Constructive Assembly TUI Design Space of Portable Displays

  16. New Materials and Techniques are Needed Optical Optical Tags 3D Cameras CapStones [Chan et. al. CHI’12 ] Capacitive Capacitance Multitouch 2D Tags Display Hardware Token+Surface Constructive Assembly TUI Design Space of Portable Displays

  17. GaussSense GaussBits Attachable Magnetic Hall-Sensor Grid Tangible Bits [Liang et al. UIST’12 ] [Liang et al. CHI’13 ] Magnetic Tangibles

  18. GaussSense GaussSense Analog Hall-Sensor Grid Attachable Attachable portable magnetic-field camera Hall-Sensor Grid Hall-Sensor Grid [Liang et al. UIST’12 ]

  19. GaussSense GaussBits GaussBits Magnetic Tangibles Magnetic Attachable Magnetic passive, small, and occlusion-free Tangible Bits Hall-Sensor Grid Tangible Bits [Liang et al. CHI’13 ]

  20. A technique and material that support Portable and Occlusion-Free Interaction Design On and Above Portable Displays 3D Optical Cameras Optical Tags CapStones Near-Surface [Chan et. al. CHI’12 ] GaussSense GaussBits 3D Capacitive Attachable Magnetic Capacitance Hall-Sensor Grid Tangible Bits Multitouch 2D Tags [Liang et al. UIST’12 ] [Liang et al. CHI’13 ] Display Hardware Token+Surface Constructive Assembly TUI Design Space of Portable Displays

  21. A technique and material that Feasible for Designing Building Blocks by Magnets? 3D Optical Cameras Optical Tags CapStones Near-Surface [Chan et. al. CHI’12 ] GaussSense GaussBits 3D Capacitive Attachable Magnetic Capacitance Hall-Sensor Grid Tangible Bits Multitouch 2D Tags [Liang et al. UIST’12 ] [Liang et al. CHI’13 ] Display Hardware Token+Surface Constructive Assembly TUI Design Space of Portable Displays

  22. Magnets naturally attract together

  23. Magnets naturally attract together

  24. Challenge on Sensing The distribution of magnetic field may differ from the shape of magnetic sculpture Magnet Resulting Magnetic Field Distribution Analog Hall-Sensor Grid

  25. Challenge on Sensing The distribution of magnetic field may differ from the shape of magnetic sculpture Analog Hall-Sensor Grid Magnet attracting each other also counteract each other

  26. Challenge on Sensing The distribution of magnetic field may differ from the shape of magnetic sculpture 4 Analog Hall-Sensor Grid Magnet attracting each other also counteract each other

  27. Challenge The distribution of magnetic field may differ from the shape of magnetic sculpture 4 Analog Hall-Sensor Grid Magnet attracting each other also counteract each other

  28. Shaping the Magnetic Fields for Sensing Keep the construction’s magnetic field in the same polarity Firm Case Analog Hall-Sensor Grid

  29. Shaping the Magnetic Fields for Sensing Keep the construction’s magnetic field in the same polarity Firm Case Analog Hall-Sensor Grid

  30. Valid magnetic-field distribution for deriving the geometry of a magnetic construction

  31. 3 Types of GaussBricks 3 Types of GaussBricks > Sensing Algorithm > 3 Basic Utilities > 3 Advanced Extensions

  32. 1. Construction Bricks: for additive construction

  33. 1. Construction Bricks for addictive construction

  34. 2. Supporting Bricks: for stabilizing structures (1x1 construction bricks)

  35. gear-shaped male connector gear-shaped female connector 3. Locking Bricks: reduce unwanted DOFs by locking joints

  36. 3. Locking Bricks rigidifying parts to reduce unwanted DOFs

  37. Simple , Stable , and Transparent in use.

  38. Geometry Skeleton Sensing Algorithm 3 Types of GaussBricks > Sensing Algorithm > 3 Basic Utilities > 3 Advanced Extensions

  39. Geometry 1. contour extraction

  40. Geometry 2. segmentation not stacked stacked overhanging

  42. locking brick supporting brick supporting bricks non-magnetic brick only supporting bricks + locking bricks overhanging conditions 0 50 100 150 (Unit: gauss) levels 3 2 3 1 2 3 Resolves 3D structures in maximum 3 levels of stacking The uses of locking bricks do not affect sensing.

  43. Skeleton

  44. Skeleton 1. spine extraction Using Constrained Delaunay Triangulation

  45. Skeleton 2. trimming and merging

  46. Skeleton 3. simplifying

  47. Skeleton 4. trimming Result

  49. 1 2 3 Basic Utilities of the Magnetic Building Blocks 3 Types of GaussBricks > Sensing Algorithm > 3 Basic Utilities > 3 Advanced Extensions

  50. 1. Interactive Form Construction and Manipulation

  51. 1. Interactive Form Construction and Manipulation

  52. 2. Constructing Elastic Physical Structures by utilizing repulsions and attractions

  53. 2. Constructing Elastic Physical Structures by utilizing repulsions and attractions

  54. GaussBits Magnetic Tangible Bits [Liang et al. CHI’13 ] 3. Constructing Controllers for Near-Surface Interactions

  55. 3. Constructing Controllers for Near-Surface Interactions

  56. Actuation brick Touch brick Optic brick 1 2 3 Extending GaussBricks for More Interactivity 3 Types of GaussBricks > Sensing Algorithm > 3 Basic Utilities > 3 Advanced Extensions

  57. gear-shaped male connector gear-shaped female connector servo motor top bottom 1. Actuation Bricks enable Shape Changing

  58. 1. Actuation Bricks enable Shape Changing

  59. 1. Actuation Bricks enable Shape Changing

  60. conductive coating top bottom 2. Touch Bricks enable Multitouch Inputs

  61. 2. Touch Bricks enable Multitouch Inputs

  62. 2. Touch Bricks enable Multitouch Inputs

  63. fiber optics bundle 3. Optic Bricks enhance Display Capability

  64. 3. Optic Bricks enable Display Capability

  65. Conclusion Near-Surface GaussSense GaussBits 3D Capacitive Attachable Magnetic Capacitance Hall-Sensor Grid Tangible Bits Multitouch 2D Tags [Liang et al. UIST’12 ] [Liang et al. CHI’13 ] Display Hardware Token+Surface Constructive Assembly TUI Design Space of Portable Displays

  66. Magnetic Building Blocks for Supporting Constructive Tangible Interactions on Portable Displays CapStones Near-Surface [Chan et. al. CHI’12 ] GaussSense GaussBits GaussBricks 3D Capacitive Magnetic Attachable Magnetic Capacitance Hall-Sensor Grid Tangible Bits Building Blocks Multitouch 2D Tags [Liang et al. UIST’12 ] [Liang et al. CHI’13 ] Display Hardware Token+Surface Constructive Assembly TUI Design Space of Portable Displays

Recommend

More recommend