AirCode: Unobtrusive Physical Tags for Digital Fabrication Dingzeyu Li Avinash S. Nair Shree K. Nayar Changxi Zheng 1
Tags are everywhere. metadata hyperlink interaction luggage tags boarding passes product barcodes Tags alter appearance. mailing labels Dingzeyu Li Oct 24, 2017 2
Compromises on Aesthetics Dingzeyu Li Oct 24, 2017 3
Unobtrusive Tagging for Fabrication Dingzeyu Li Oct 24, 2017 4
Related Work InfraStructs - Terahertz Acoustic Barcodes Affordance++ - Stimulating [Willis et al., SIGGRAPH 2013] [Harrison et al., UIST 2012] [Lopes et al., CHI 2015] Dingzeyu Li Oct 24, 2017 5
Light Transport Dingzeyu Li Oct 24, 2017 6
Light Transport light camera direct Dingzeyu Li Oct 24, 2017 7
Light Transport light camera global subsurface scattering Dingzeyu Li Oct 24, 2017 8
Combined light camera direct global Dingzeyu Li Oct 24, 2017 9
Combined light camera direct global Dingzeyu Li Oct 24, 2017 10
Visual Appearance light camera direct global idea: embed unobtrusive tags in the global component 1. How to guarantee the tags are invisible? 2. How to detect the global component? Dingzeyu Li Oct 24, 2017 11
Separate Global Component [Nayar et al., SIGGRAPH 2006] projector camera Dingzeyu Li Oct 24, 2017 12
Separate Global Component projector [Nayar et al., SIGGRAPH 2006] camera direct global Dingzeyu Li Oct 24, 2017 13
Air Pockets projector camera direct air Dingzeyu Li Oct 24, 2017 14
Air Pockets projector camera global subsurface scattering Dingzeyu Li Oct 24, 2017 15
Air Pockets direct global intensity position subsurface scattering Dingzeyu Li Oct 24, 2017 16
Air Pockets direct direct global intensity 1 1 0 position subsurface scattering Dingzeyu Li Oct 24, 2017 17
AirCode Layout Markers 1 0 1 Data Bits Calibration Bits Dingzeyu Li Oct 24, 2017 18
AirCode Benefits - during fabrication - invisible - camera/projector setup Dingzeyu Li Oct 24, 2017 19
Invisibility: Contrast Threshold Contrast threshold is the minimal contrast required to see the target reliably. Dingzeyu Li Oct 24, 2017 20
Invisibility: Contrast Threshold Contrast threshold is the minimal contrast required to see the target reliably. 0.1% - 10% intensity pattern contrast = L max − L min ¯ L [Campbell and Robson, Journal of Physiology 1968] [Bijl et al., Vision Research 1989] Dingzeyu Li Oct 24, 2017 21
Layered Scattering Model R ( d ) , T Reflection profile Transmission profile ) , T ( d ) d d • multi-layer reflection profile [Donner and Jensen, SIGGRAPH 2005] Dingzeyu Li Oct 24, 2017 22
Multi-Layer Profile R ( d ) = R 1 + T 1 R 2 T 1 + T 1 R 2 R 1 R 2 T 1 + · · · R 1 ( d ) , T 1 ( d ) 0-bounce 1-bounce 2-bounce = R 1 + T 1 R 2 T 1 (1 + R 1 R 2 + ( R 1 R 2 ) 2 + · · · ) = R 1 + T 1 R 2 T 1 R 2 ( d ) , T 2 ( d ) [Donner and Jensen, SIGGRAPH 2005] 1 − R 1 R 2 Efficient computation for layered material Dingzeyu Li Oct 24, 2017 23
Putting it together + R ( d ) = R 1 + T 1 R 2 T 1 + T 1 R 2 R 1 R 2 T 1 + · · · 0.1% - 10% 0-bounce 1-bounce 2-bounce Details in the paper Dingzeyu Li Oct 24, 2017 24
Applications metadata embedding robotic grasping paper watermarking
Metadata Embedding Dingzeyu Li Oct 24, 2017 26
Metadata Embedding Dingzeyu Li Oct 24, 2017 27
Metadata Embedding direct global “visibility” Dingzeyu Li Oct 24, 2017 28
Physical Hyperlink Dingzeyu Li Oct 24, 2017 29
Physical Hyperlink Dingzeyu Li Oct 24, 2017 30
Robotic Grasping recognition - pose estimation - gasping location Dingzeyu Li Oct 24, 2017 31
Dingzeyu Li Oct 24, 2017 32
Cup • Dingzeyu Li Oct 24, 2017 33
Beyond 3D Printing Materials Dingzeyu Li Oct 24, 2017 34
Paper Watermarking Dingzeyu Li Oct 24, 2017 35 35
Paper Watermarking global component Dingzeyu Li Oct 24, 2017 36
Air Pockets in Paper Dingzeyu Li Oct 24, 2017 37
Separation Results direct global Dingzeyu Li Oct 24, 2017 38
Separation Results mask global Dingzeyu Li Oct 24, 2017 39
Separation Results mask filtered global Dingzeyu Li Oct 24, 2017 40
Conclusion AirCode to Tag Physical Objects embedded during fabrication unobtrusive robust decoding with camera/projector non-opaque material Limitations and Future Work capture time non-smooth surface long-term preservation changeability matterhackers.com different humidities Dingzeyu Li Oct 24, 2017 41
Acknowledgement Arthur Autz, Daniel Miau, Brian A. Smith, Henrique Teles Maia, Yonghao Yue, Shuang Zhao, Klint Qinami, Anne Fleming, Daniel Sims, Jason Hollaway Thingiverse.com users: Filar3D, mbeyerle116, gravityisweak, Tinyeyes, National Science Foundation (CAREER-1453101) Adobe PhD Research Fellowship Dingzeyu Li Oct 24, 2017 42
AirCode: Unobtrusive Physical Tags for Digital Fabrication http://ding.fyi/aircode Dingzeyu Li Avinash S. Nair Shree K. Nayar Changxi Zheng
Recommend
More recommend