Integration of Sensing & Processing Doug Cochran, Fulton School - PowerPoint PPT Presentation

Integration of Sensing & Processing Doug Cochran, Fulton School of Engineering 30 January 2006 ASU, 30 January 2006

Outline 1. Introduction Introduction 1. • Traditional sensing system design and operation Traditional sensing system design and operation • The integrated sensing & processing vision The integrated sensing & processing vision 2. Closing the sensing loop Closing the sensing loop 2. • Issues and approaches Issues and approaches • Experiment sequence for target classification Experiment sequence for target classification • Waveform scheduling Waveform scheduling • Coded-aperture sensors Coded-aperture sensors 3. Processing on the physical layer Processing on the physical layer 3. • Analogue-to-Information conversion Analogue-to-Information conversion • Optical reference structure devices Optical reference structure devices • Combined analog-digital signal processing Combined analog-digital signal processing ASU, 30 January 2006

Outline 1. Introduction Introduction 1. • Traditional sensing system design and operation Traditional sensing system design and operation • The integrated sensing & processing vision The integrated sensing & processing vision 2. Closing the sensing loop Closing the sensing loop 2. • Issues and approaches Issues and approaches • Experiment sequence for target classification Experiment sequence for target classification • Waveform scheduling Waveform scheduling • Coded-aperture sensors Coded-aperture sensors 3. Processing on the physical layer Processing on the physical layer 3. • Analogue-to-Information conversion Analogue-to-Information conversion • Optical reference structure devices Optical reference structure devices • Combined analog-digital signal processing Combined analog-digital signal processing ASU, 30 January 2006

Traditional Sensing Physical Physical Phenomenology Phenomenology ASU, 30 January 2006

Traditional Sensing 1011000101110101010001010111101010010100101001101010100 1011000101110101010001010111101010010100101001101010100 1010101110000101100100010101010111010100101001001000101 1010101110000101100100010101010111010100101001001000101 0010101010010100101010100101010010101010101010101110101 0010101010010100101010100101010010101010101010101110101 0000110100100010010111110010100001001010101010010110010 0000110100100010010111110010100001001010101010010110010 1011000101110101010001010111101010010100101001101010100 1011000101110101010001010111101010010100101001101010100 1010101110000101100100010101010111010100101001001000101 1010101110000101100100010101010111010100101001001000101 0010101010010100101010100101010010101010101010101110101 0010101010010100101010100101010010101010101010101110101 Digital PHYSICAL 0000110100100010010111110010100001001010101010010110010 0000110100100010010111110010100001001010101010010110010 Representation LAYER 1011000101110101010001010111101010010100101001101010100 1011000101110101010001010111101010010100101001101010100 finite-precision 1010101110000101100100010101010111010100101001001000101 1010101110000101100100010101010111010100101001001000101 finite-dimensional 0010101010010100101010100101010010101010101010101110101 0010101010010100101010100101010010101010101010101110101 0000110100100010010111110010100001001010101010010110010 0000110100100010010111110010100001001010101010010110010 1011000101110101010001010111101010010100101001101010100 1011000101110101010001010111101010010100101001101010100 …101100010111010100… 101100010111010100… … 1011000101110101010001010111101010010100101001101010100 1011000101110101010001010111101010010100101001101010100 1010101110000101100100010101010111010100101001001000101 1010101110000101100100010101010111010100101001001000101 1010101110000101100100010101010111010100101001001000101 1010101110000101100100010101010111010100101001001000101 0010101010010100101010100101010010101010101010101110101 0010101010010100101010100101010010101010101010101110101 0010101010010100101010100101010010101010101010101110101 0010101010010100101010100101010010101010101010101110101 0000110100100010010111110010100001001010101010010110010 0000110100100010010111110010100001001010101010010110010 0000110100100010010111110010100001001010101010010110010 0000110100100010010111110010100001001010101010010110010 ASU, 30 January 2006

Traditional Sensing PHYSICAL PROCESSING Transformed LAYER Digital LAYER Representation 10110001011101010100010 10110001011101010100010 0111 0111 10101011100001011001000 10101011100001011001000 0101 0101 00101010100101001010101 00101010100101001010101 00001101001000100101111 00001101001000100101111 ASU, 30 January 2006

Traditional Sensing EXPLOITATION PHYSICAL PROCESSING LAYER LAYER LAYER 0111 Symbolic 0111 H 1 H   0101 1 0101 Output ASU, 30 January 2006

Outline 1. Introduction Introduction 1. • Traditional sensing system design and operation Traditional sensing system design and operation • The integrated sensing & processing vision The integrated sensing & processing vision 2. Closing the sensing loop Closing the sensing loop 2. • Issues and approaches Issues and approaches • Experiment sequence for target classification Experiment sequence for target classification • Waveform scheduling Waveform scheduling • Coded-aperture sensors Coded-aperture sensors 3. Processing on the physical layer Processing on the physical layer 3. • Analogue-to-Information conversion Analogue-to-Information conversion • Optical reference structure devices Optical reference structure devices • Combined analog-digital signal processing Combined analog-digital signal processing ASU, 30 January 2006

Integrated Sensing & Processing Vision Agile sensing opportunities Agile sensing opportunities • Optical: e.g., high-speed spatial light e.g., high-speed spatial light Optical: modulators, femtosecond pulse-shaped lasers modulators, femtosecond pulse-shaped lasers • RF: e.g., software-driven transmitters & e.g., software-driven transmitters & RF: receivers receivers • Acoustic: e.g., steerable & waveform-agile e.g., steerable & waveform-agile Acoustic: sources sources • Configurable networks: Configurable networks: e.g., deployable motes, e.g., deployable motes, unmanned vehicles unmanned vehicles • Tunable materials: Tunable materials: e.g., e.g., electrically tunable electrically tunable materials, photonic materials, photonic band-gap materials band-gap materials • Chemical: Chemical: e.g., e.g., artificial dogs’ noses artificial dogs’ noses ASU, 30 January 2006

Integrated Sensing & Processing Vision Hsiao Zhua-Zi Hsiao Zhua-Zi “Beast” Beast” “ 1984-2004 1984-2004 ASU, 30 January 2006

Integrated Sensing & Processing Vision Develop holistic approaches to sensor system design and operation to enable optimal end- to-end performance 1) Supplant currently prevalent feed-forward operational  Allow back-end exploitation concepts with feedback ideas requirements (e.g., target ID) to task front-end sensor elements!! PROCESSING PHYSICAL EXPLOITATION LAYER LAYER LAYER ASU, 30 January 2006

Integrated Sensing & Processing Vision INTEGRATED INTEGRATED PHYSICAL PROCESSING EXPLOITATION LAYER LAYER LAYER SENSOR/PROCESSOR SENSOR/PROCESSOR Develop holistic approaches to sensor system design and operation to enable optimal end- to-end performance 1) Replace independent optimization of sensor system  Integrate components with end-to-end system optimization processing and sensing functionality; e.g., “processing on the physical layer” ASU, 30 January 2006

DARPA ISP Program Defense and national security sensing systems supporting next- generation reconnaissance, surveillance, and weapon capabilities face dramatically increased demands:  Complexity and volume of raw measurements  Increased operational tempo  Concepts of operation with immediate information sharing  More flexible (tunable, mode/waveform ISP is developing critical enabling methodology selectable, for the next generation of sensor/exploitation configurable, etc.) networks sensor elements ASU, 30 January 2006

Outline 1. Introduction Introduction 1. • Traditional sensing system design and operation Traditional sensing system design and operation • The integrated sensing & processing vision The integrated sensing & processing vision 2. Closing the sensing loop Closing the sensing loop 2. • Issues and approaches Issues and approaches • Experiment sequence for target classification Experiment sequence for target classification • Waveform scheduling Waveform scheduling • Coded-aperture sensors Coded-aperture sensors 3. Processing on the physical layer Processing on the physical layer 3. • Analogue-to-Information conversion Analogue-to-Information conversion • Optical reference structure devices Optical reference structure devices • Combined analog-digital signal processing Combined analog-digital signal processing ASU, 30 January 2006