aircode unobtrusive physical tags for digital fabrication
play

AirCode: Unobtrusive Physical Tags for Digital Fabrication Dingzeyu - PowerPoint PPT Presentation

AirCode: Unobtrusive Physical Tags for Digital Fabrication Dingzeyu Li Avinash S. Nair Shree K. Nayar Changxi Zheng 1 Tags are everywhere. metadata hyperlink interaction luggage tags boarding passes product barcodes Tags alter


  1. AirCode: Unobtrusive Physical Tags for Digital Fabrication Dingzeyu Li Avinash S. Nair Shree K. Nayar Changxi Zheng 1

  2. Tags are everywhere. metadata hyperlink interaction luggage tags boarding passes product barcodes Tags alter appearance. mailing labels Dingzeyu Li Oct 24, 2017 2

  3. Compromises on Aesthetics Dingzeyu Li Oct 24, 2017 3

  4. Unobtrusive Tagging for Fabrication Dingzeyu Li Oct 24, 2017 4

  5. Related Work InfraStructs - Terahertz Acoustic Barcodes Affordance++ - Stimulating [Willis et al., SIGGRAPH 2013] [Harrison et al., UIST 2012] [Lopes et al., CHI 2015] Dingzeyu Li Oct 24, 2017 5

  6. Light Transport Dingzeyu Li Oct 24, 2017 6

  7. Light Transport light camera direct Dingzeyu Li Oct 24, 2017 7

  8. Light Transport light camera global subsurface scattering Dingzeyu Li Oct 24, 2017 8

  9. Combined light camera direct global Dingzeyu Li Oct 24, 2017 9

  10. Combined light camera direct global Dingzeyu Li Oct 24, 2017 10

  11. Visual Appearance light camera direct global idea: embed unobtrusive tags in the global component 1. How to guarantee the tags are invisible? 2. How to detect the global component? Dingzeyu Li Oct 24, 2017 11

  12. Separate Global Component [Nayar et al., SIGGRAPH 2006] projector camera Dingzeyu Li Oct 24, 2017 12

  13. Separate Global Component projector [Nayar et al., SIGGRAPH 2006] camera direct global Dingzeyu Li Oct 24, 2017 13

  14. Air Pockets projector camera direct air Dingzeyu Li Oct 24, 2017 14

  15. Air Pockets projector camera global subsurface scattering Dingzeyu Li Oct 24, 2017 15

  16. Air Pockets direct global intensity position subsurface scattering Dingzeyu Li Oct 24, 2017 16

  17. Air Pockets direct direct global intensity 1 1 0 position subsurface scattering Dingzeyu Li Oct 24, 2017 17

  18. AirCode Layout Markers 1 0 1 Data Bits Calibration Bits Dingzeyu Li Oct 24, 2017 18

  19. AirCode Benefits - during fabrication - invisible - camera/projector setup Dingzeyu Li Oct 24, 2017 19

  20. Invisibility: Contrast Threshold Contrast threshold is the minimal contrast required to see the target reliably. Dingzeyu Li Oct 24, 2017 20

  21. Invisibility: Contrast Threshold Contrast threshold is the minimal contrast required to see the target reliably. 0.1% - 10% intensity pattern contrast = L max − L min ¯ L [Campbell and Robson, Journal of Physiology 1968] [Bijl et al., Vision Research 1989] Dingzeyu Li Oct 24, 2017 21

  22. Layered Scattering Model R ( d ) , T Reflection profile Transmission profile ) , T ( d ) d d • multi-layer reflection profile [Donner and Jensen, SIGGRAPH 2005] Dingzeyu Li Oct 24, 2017 22

  23. Multi-Layer Profile R ( d ) = R 1 + T 1 R 2 T 1 + T 1 R 2 R 1 R 2 T 1 + · · · R 1 ( d ) , T 1 ( d ) 0-bounce 1-bounce 2-bounce = R 1 + T 1 R 2 T 1 (1 + R 1 R 2 + ( R 1 R 2 ) 2 + · · · ) = R 1 + T 1 R 2 T 1 R 2 ( d ) , T 2 ( d ) [Donner and Jensen, SIGGRAPH 2005] 1 − R 1 R 2 Efficient computation for layered material Dingzeyu Li Oct 24, 2017 23

  24. Putting it together + R ( d ) = R 1 + T 1 R 2 T 1 + T 1 R 2 R 1 R 2 T 1 + · · · 0.1% - 10% 0-bounce 1-bounce 2-bounce Details in the paper Dingzeyu Li Oct 24, 2017 24

  25. Applications metadata embedding robotic grasping paper watermarking

  26. Metadata Embedding Dingzeyu Li Oct 24, 2017 26

  27. Metadata Embedding Dingzeyu Li Oct 24, 2017 27

  28. Metadata Embedding direct global “visibility” Dingzeyu Li Oct 24, 2017 28

  29. Physical Hyperlink Dingzeyu Li Oct 24, 2017 29

  30. Physical Hyperlink Dingzeyu Li Oct 24, 2017 30

  31. Robotic Grasping recognition - pose estimation - gasping location Dingzeyu Li Oct 24, 2017 31

  32. Dingzeyu Li Oct 24, 2017 32

  33. Cup • Dingzeyu Li Oct 24, 2017 33

  34. Beyond 3D Printing Materials Dingzeyu Li Oct 24, 2017 34

  35. Paper Watermarking Dingzeyu Li Oct 24, 2017 35 35

  36. Paper Watermarking global component Dingzeyu Li Oct 24, 2017 36

  37. Air Pockets in Paper Dingzeyu Li Oct 24, 2017 37

  38. Separation Results direct global Dingzeyu Li Oct 24, 2017 38

  39. Separation Results mask global Dingzeyu Li Oct 24, 2017 39

  40. Separation Results mask filtered global Dingzeyu Li Oct 24, 2017 40

  41. Conclusion AirCode to Tag Physical Objects embedded during fabrication unobtrusive robust decoding with camera/projector non-opaque material Limitations and Future Work capture time non-smooth surface long-term preservation changeability matterhackers.com different humidities Dingzeyu Li Oct 24, 2017 41

  42. Acknowledgement Arthur Autz, Daniel Miau, Brian A. Smith, Henrique Teles Maia, Yonghao Yue, Shuang Zhao, Klint Qinami, Anne Fleming, Daniel Sims, Jason Hollaway Thingiverse.com users: Filar3D, mbeyerle116, gravityisweak, Tinyeyes, National Science Foundation (CAREER-1453101) Adobe PhD Research Fellowship Dingzeyu Li Oct 24, 2017 42

  43. AirCode: Unobtrusive Physical Tags for Digital Fabrication http://ding.fyi/aircode Dingzeyu Li Avinash S. Nair Shree K. Nayar Changxi Zheng

Recommend


More recommend