Phase Messaging Method for Time-of-flight Cameras Wenjia Yuan - PowerPoint PPT Presentation

Oct 04, 2022 •136 likes •357 views

Phase Messaging Method for Time-of-flight Cameras Wenjia Yuan Richard Howard Kristin Dana Ramesh Raskar Ashwin Ashok Marco Gruteser Narayan Mandayam Rutgers University Massachusetts Institute of Technology

Phase Messaging Method for Time-of-flight Cameras Wenjia Yuan † Richard Howard † Kristin Dana † Ramesh Raskar ‡ Ashwin Ashok † Marco Gruteser † Narayan Mandayam † † Rutgers University ‡ Massachusetts Institute of Technology CNS-1065463
Cameras Displays Camera-Display Communication 5/3/2014 2
Related work: QR codes [1] Kamijo et al. ICIP. 2008. 5/3/2014 3
Related work: Visual MIMO [1] Ashok et al. MobiCom. 2010. [2] Yuan et al. WACV. 2012. [3] Yuan et al. GlobalSip.2013 5/3/2014 4
Other related work [1] Schmid et al. MobiHoc. 2013. [2] Perli et al. MobiCom. 2010. [3] Mondal et al. APCC. 2012. 5/3/2014 5
Our work Phase Messaging Time-of-flight Array (PMA) Cameras 5/3/2014 6
Time-of-Flight Cameras ToF camera sensor PMD CamBoard Nano SoftKinetic DS311 Swiss Ranger SR4050 5/3/2014 7
Time-of-Flight Cameras ToF camera sensor Infrared LEDs PMD CamBoard Nano SoftKinetic DS311 Swiss Ranger SR4050 5/3/2014 8
Time-of-Flight Cameras delay 𝜐 SoftKinetic DS311 phase difference depth 5/3/2014 9
5/3/2014 10
System Overview Message Extracted Stream Message Stream FIFO Depth Data Image Format Receiver Transmitter Converter ToF Camera PMA Sensor of A 0 Depth Shift the ToF LED Multiplexer Recovery Register p 0 p n-1 A m-1 camera Data Processing …… Synchronized Photo Phase p LEDs of the ToF camera Amplifier Detector Shifting Light Detection Phase Modulation 5/3/2014 11
Phase Messaging Array (PMA) LED Modulation Phase Data Processing Light Detection 5/3/2014 12
Modulation LED Phase Data Processing Intuitive Solution Light Detection Time-of-flight LED Camera 5/3/2014 13
Modulation LED Phase Data Processing Our Solution Light Detection Photo Detector LED 5/3/2014 14
Modulation LED Phase Data Processing Phase Modulation Light Detection • Phase Shifting 185 o 250 o 280 o 320 o 5/3/2014 15
Modulation LED Phase Data Processing Phase Modulation Light Detection • Messaging and Signal Selection 5/3/2014 16
Modulation LED Phase Data Processing Phase Modulation Light Detection • Message Recovery p2 p1 p0 p3 p2 p1 p0 p3 p1 10 01 00 11 10 01 00 11 01 5/3/2014 17
Experiments SoftKinetic PMA DS311 Five independent experiments 8000 random bits/experiment Average accuracy 97.8% 5/3/2014 18
Experiments • Data rate analysis – 9 LEDs • One for synchronization indicator • Another 8 for messaging – 4 candidate phases => 2 bits/LED – ToF camera • 60 fps => 8x2x60 = 960bps 5/3/2014 19
Applications • Dual use of cameras – Imaging (original use) – Communication (added channel) • Applications – Object recognition: ID beacon – Navigation: path marker – Robotics: line of sight communication 5/3/2014 20
Conclusions • Propose a camera-display communication methodology based on a low-cost continuous- wave ToF camera • Implement Phase Messaging Array (PMA) • Demonstrate high messaging accuracy in experiments 5/3/2014 21
5/3/2014 22

Recommend

Robust and Practical Depth Map Fusion for Time-of-Flight Cameras Markus Ylimki 1 , Juho Kannala

Robust and Practical Depth Map Fusion for Time-of-Flight Cameras Markus Ylimki 1 , Juho Kannala 2 , Janne Heikkil 1 1 Center for Machine Vision Research, University of Oulu, Oulu, Finland 2 Department of Computer Science, Aalto University,

701 views • 18 slides

THE SOFTWARE Custom camera control software allows extra cameras to be added as needed allowing

Time Slice systems - - also known as bullet time, stop time, or time freeze implement a camera array that ranges anywhere from 24 to 150+ cameras to create an effect of stopped time or extremely slowed time. Although the process was pioneered

197 views • 5 slides

Time of Flight Detectors at RHIC Time of Flight Measurements at RHIC ! TOF detector as a

Time of Flight Detectors at RHIC Time of Flight Measurements at RHIC ! TOF detector as a PID devices ! PHENIX-TOF and BRAHMS-TOF PHENIX Time-of-Flight Detector ! Mechanical design and PID capability ! Detector performance in

278 views • 16 slides

Range gated cameras technology and its applications Friday, October 10, 14 Range gated cameras

Range gated cameras technology and its applications Friday, October 10, 14 Range gated cameras can have several names * Time resolved cameras * Range gated cameras * Laser tomography * Grindad laserkamera / avbildning ( SV) All systems

647 views • 25 slides

A posteriori error estimates for space-time domain decomposition method for two-phase flow

A posteriori error estimates for space-time domain decomposition method for two-phase flow problem Sarah Ali Hassan, Elyes Ahmed, Caroline Japhet, Michel Kern, Martin Vohralk INRIA Paris & ENPC (project-team SERENA), University Paris 13

728 views • 71 slides

https://swisimmigration.com/ Map of Sweden Flight travel time to Sweden Flight travel time from

https://swisimmigration.com/ Map of Sweden Flight travel time to Sweden Flight travel time from Delhi to Stockholm is approximately 7 hours 30 Mins About Sweden Swedish is the official language of Sweden. The Swedish Krona (SEK) is

897 views • 37 slides

L L 2 = + 0 1 t v v Detector 1 0 THE VESUVIO SPECTOMETER The Filter Difference Method

Time of Flight Measurement Principle ( ) = 2 2 h 1 m v v L 0 0 1 2 ( ) = + 2 2 2 2 q m v v 2 v v cos 0 1 0 1 2 M q = L 1 y Moderator Sample q

641 views • 17 slides

Depth Camera for Mobile Devices Instructor - Simon Lucey 16-423 - Designing Computer Vision Apps

Depth Camera for Mobile Devices Instructor - Simon Lucey 16-423 - Designing Computer Vision Apps Today Stereo Cameras Structured Light Cameras Time of Flight (ToF) Camera Inferring 3D Points Given we have prior knowledge of

513 views • 47 slides

Prospects for achieving < 100 ps FWHM coincidence resolving time in time-of-flight PET Dennis

Prospects for achieving < 100 ps FWHM coincidence resolving time in time-of-flight PET Dennis R. Schaart, 28-Feb-2012, ICTR-PHE, Geneva, Switzerland Dennis R. Schaart 1 Delft University of Technology Time-of-flight PET 114 kg; BMI = 32.2

475 views • 30 slides

Secure Messaging Lecture 23 Messaging Alice Bob Secure Messaging Corruption model

Secure Messaging Lecture 23 Messaging Alice Bob Secure Messaging Corruption model Server/network is adversarial (but trusted identity registration needed) Windows of compromise when a party is under adversarial control (or readable

933 views • 14 slides

Body Worn Cameras and Transparency Increase in use of cameras Expectation of

10/10/2016 Body Cameras: The Intersection of Public Records and Law Enforcement Frayda Bluestein, Jeff Welty, Tom Carruthers Body Worn Cameras and Transparency Increase in use of cameras Expectation of accountability and transparency

348 views • 9 slides

two-phase commit / network FSes 1 last time remote procedure calls imitate function/method call

two-phase commit / network FSes 1 last time remote procedure calls imitate function/method call interface extra setup: where is server interface description language to specify interface extra concerns: portability (language + machine),

1.54k views • 127 slides

The boundary element method discretised with the space-time method for the heat equation in 2D 1

The boundary element method discretised with the space-time method for the heat equation in 2D 1 Kazuki Niino, Olaf Steinbach TU Graz 2 Background Space-time method for a BEM Flexible mesh Stability Large coefficient matrix

286 views • 27 slides

Numerical Simulation of Drosophila Flight Based on Arbitrary Lagrangian Eulerian (ALE) Method

ITU/FAA Faculty of Aeronautics and Astronautics Numerical Simulation of Drosophila Flight Based on Arbitrary Lagrangian Eulerian (ALE) Method Belkis ERZINCANLI & Mehmet SAHIN 65th Annual Meeting

543 views • 35 slides

Using CORBA Asynchronous Messaging, Pluggable Protocols and the Real-Time Event Service in a

Using CORBA Asynchronous Messaging, Pluggable Protocols and the Real-Time Event Service in a Real-Time Embedded System Bruce Trask Contact Systems 50 Miry Brook Rd Danbury, CT 06810 btrask@contactsystems.com mature one that is currently

309 views • 9 slides

Order One 46 Classrooms Cameras only: $56,108.00 Order Two 8 Classrooms Cameras

S WEARING I N N EW 2020-2021 B OARD OF E DUCATION S TUDENT R EPRESENTATIVE Order One 46 Classrooms Cameras only: $56,108.00 Order Two 8 Classrooms Cameras and Other Equipment (Touchboard, etc.): $32,160.00 To Cover All Staff

654 views • 30 slides

Cameras Cameras Good cameras need focusing, cheap ones dont Good cameras need focusing,

Cameras 1 Cameras 2 Observations about Cameras Observations about Cameras They record a scene on an image sensor They record a scene on an image sensor Cameras Cameras Good cameras need focusing, cheap ones dont Good cameras need

484 views • 4 slides

Recap: Cameras, lenses, and 6.891 calibration Computer Vision and Applications Last time:

Recap: Cameras, lenses, and 6.891 calibration Computer Vision and Applications Last time: Camera models Prof. Trevor. Darrell Projection equations Calibration methods Lecture 2: Linear Filters and Convolution (review)

803 views • 18 slides

Energetically Optimal Flapping Flight via a Fully Discrete Adjoint Method with Explicit Treatment

Energetically Optimal Flapping Flight via a Fully Discrete Adjoint Method with Explicit Treatment of Flapping Frequency Jingyi Wang, Matthew J. Zahr , and Per-Olof Persson CFD-36, Optimization Techniques for CFD AIAA Aviation Sheraton

360 views • 34 slides

YOUR MESSAGING ISNT ABOUT YOU 7 Steps to Messaging that Connects Who am I? Why am I

YOUR MESSAGING ISNT ABOUT YOU 7 Steps to Messaging that Connects Who am I? Why am I here? Hundreds of product launches. Dozens of corporate launches. One top-funded Kickstarter campaign The Tool: The Message Map

655 views • 22 slides

Goals: Devise space-time DG-method for the wave equation : u tt u xx = f in Q := ] 0 , T

Goals: Devise space-time DG-method for the wave equation : u tt u xx = f in Q := ] 0 , T [ Implement method and test it Investigate stabilty of method Weak formulation: M = { K } is a mesh that covers the space-time domain Q

261 views • 4 slides

Flight Forward Flight Forward Personal Weather Stations Flight Forward Hill AFB 26mi KSLC

Flight Forward Flight Forward Personal Weather Stations Flight Forward Hill AFB 26mi KSLC Almost 1,000ft elevation change from SLC 7mi Flight Forward Flight Forward Flight TAKEAWAYS Forward FAA ASOS/AWOS too sparse for UAS

281 views • 10 slides

Phase 2 1 cmarinas@uni-bonn.de Phase 2 Phase 2: BEAST and partial Belle II Phase 3: Full

Phase 2 1 cmarinas@uni-bonn.de Phase 2 Phase 2: BEAST and partial Belle II Phase 3: Full Belle II detector Phase 2 (BEAST II) The SuperKEKB accelerator will be operating, for the first time, with QCS magnets First operation with

597 views • 56 slides

Cameras Cameras photographs, you should: photographs, you should: increase the diameter of the

Cameras 1 Cameras 2 Introductory Question Introductory Question If you want to alter a cameras lens so that a If you want to alter a cameras lens so that a distant object appears larger in the distant object appears larger in the

308 views • 5 slides