Hyperspectral Camera Design Project D3 Engineering definition - PowerPoint PPT Presentation

Hyperspectral Camera Design Project D3 Engineering definition • design • development

Team Members • Will Shaffer – Electrical Engineering • Sponsored by: • Jeff Sidoni D3 Engineering – Electrical Engineering 222 Andrews Street • Dan Scorse Rochester, NY 14604 – Mechanical Engineering • Jordan Gartenhaus – Mechanical Engineering D3 Engineering definition • design • development

Hyperspectral Overview • Imaging system capable of capturing several tens to several hundreds of narrow, contiguous bands of the electromagnetic spectrum. • Covers visible spectrum, extends from NIR to long wave IR. • Data sets are large, but allow for the detection of subtle differences overlooked by traditional and multispectral systems. D3 Engineering definition • design • development

Spectral Reflectance • Defined as the ratio of reflected energy to incident energy as a function of 70 Asphalt wavelength Dry Grass 60 Granite Grass 50 • Materials have a unique Dark Soil 40 spectral signature that is % Reflectance 30 used for identification after a 20 data set is acquired. 10 0 -10 0 5 10 15 Wavelength λ ( μ m) D3 Engineering definition • design • development

Data Acquisition • Hyperspectral images are obtained using an imaging spectrometer; a device used to measure various properties of light over the spectrum. • Typically contains an optical system, a dispersing element, possibly in the form or a prism or grating and an array of detectors. D3 Engineering definition • design • development

Linear Array Spectrometer • Uses a single row of detectors. Allows for the spectrum of a given point in a target to be acquired. • Scanning mirror adds a dimension to capture an entire row of the target. • Second dimension is typically accomplished by the movement of a plane or satellite. D3 Engineering definition • design • development

2D Sensor Method • Using a two dimensional sensor, an entire row can be captured in a single frame. • Scanning mirror adds second dimension. • In remote sensing applications where the camera is in a plane, data sets can be captured without the need of a scanning mirror. D3 Engineering definition • design • development

Data Organization • Hyperspectral data sets, by nature, are very large • Usually consist of several hundred bands of the spectrum. • Organized in a cube where two of the axes are spatial and one is spectral. D3 Engineering definition • design • development

Identification of Materials • Unique spectral signature for materials • Many libraries available containing hundreds or thousands of signatures for natural and man-made materials • Research and evaluation of algorithms to improve classification and identification D3 Engineering definition • design • development

Applications • Remote Sensing Applications • Close Range Applications – Military – Medical • Terrain Mapping • Early cancer detection • Target Detection – Food Industry • Bacteria detection and – Agricultural illness prevention • Crop Yield Prediction • Soil Quality Evaluation – Counterfeit Currency – Mineral Exploration – Environmental Research D3 Engineering definition • design • development

Defense Applications • Used for target identification in combat areas • Target below is a camouflaged tank, hidden to traditional and even multispectral imaging systems. D3 Engineering definition • design • development

Project Outline • Purpose is to design and build a functional hyperspectral camera system for use by D3 Engineering’s design staff. D3 Engineering definition • design • development

Project Requirements • Prototype a Hyperspectral Camera that – Uses a single CMOS or CCD imager – Captures spectra from ~400 to ~850nm (Visible Light) – Has spectral resolution of 25-50nm – Develop back end software to acquire and process a hyperspectral data set and extract basic information such as material identification – Utilizes hardware already developed and tested by D3 Engineering for the image acquisition and motor control for the scanning mirror D3 Engineering definition • design • development

System Block Diagram Motion Board Communication Motion Control Processing Board FLASH USB 5VDC SDRAM Imager Board r o r r i Video M DSP Image Sensor Data I2C Serial Communications Target D3 Engineering definition • design • development

Project Timeline ID Task Name Duration Start Finish Dec '05 Jan '06 Feb '06 Mar '06 Apr '06 May '06 Jun '06 4 11 18 25 1 8 15 22 29 5 12 19 26 5 12 19 26 2 9 16 23 30 7 14 21 28 4 11 Hyperspectral Camera Design 124 days Mon 12/5/05 Thu 5/25/06 1 2 Requirements Generation 2 w ks Mon 12/5/05 Fri 12/16/05 3 Design Documentation 2 w ks Mon 12/19/05 Fri 12/30/05 4 Initial Prototyping w / CDK 2 w ks Mon 12/19/05 Fri 12/30/05 1/2 5 Working Camera 2 w ks Mon 1/2/06 Fri 1/13/06 6 Preliminary Design R eview 1 day Fri 2/24/06 Fri 2/24/06 CDK 61 days Mon 1/2/06 Mon 3/27/06 7 8 Camera Softw are D evelopment 9.2 w ks Mon 1/2/06 Mon 3/6/06 9 1Mpixel 1 w k Tue 3/7/06 Mon 3/13/06 10 Frequency registration 2 w ks Tue 3/14/06 Mon 3/27/06 11 Optical Subsystem 40 days Mon 2/27/06 Fri 4/21/06 12 Use Spectrograph Optics 7 w ks Mon 2/27/06 Fri 4/14/06 13 Optical Design 2 w ks Mon 2/27/06 Fri 3/10/06 14 Lightpath Diagram 2 w ks Mon 3/13/06 Fri 3/24/06 15 Simulation 2 w ks Mon 3/27/06 Fri 4/7/06 16 Testing 2 w ks Mon 4/10/06 Fri 4/21/06 Scanning Mirror 20 days Mon 2/27/06 Fri 3/24/06 17 18 Linear stepper motor 4 w ks Mon 2/27/06 Fri 3/24/06 19 Mechanical Structure 4 w ks Mon 2/27/06 Fri 3/24/06 Software 45 days Mon 2/27/06 Fri 4/28/06 20 21 Raw Data Dow nlaod 1 w k Mon 2/27/06 Fri 3/3/06 22 Conversion to Matlab 2 w ks Mon 3/6/06 Fri 3/17/06 23 Frequency Resolution 3 w ks Mon 3/20/06 Fri 4/7/06 24 Create data Cube 3 w ks Mon 4/10/06 Fri 4/28/06 Mechanical 50 days Mon 2/27/06 Fri 5/5/06 25 26 Mirror 2 w ks Mon 2/27/06 Fri 3/10/06 27 Enclosure 4 w ks Mon 3/13/06 Fri 4/7/06 28 Optical Mounts 4 w ks Mon 4/10/06 Fri 5/5/06 Intergration 20 days Mon 4/24/06 Fri 5/19/06 29 30 Testing 3 w ks Mon 4/24/06 Fri 5/12/06 31 Verify vs Requirements 1 w k Mon 5/15/06 Fri 5/19/06 32 Final Report 1 w k Fri 5/19/06 Thu 5/25/06 D3 Engineering definition • design • development

Task Partitioning • Four main design areas – Optics System • Development of custom optics system • Evaluation of ImSpector Optics System – Image System / Algorithm Development • Interfacing image capture to MATLAB • Algorithms to normalize capture data and identification – Scanning Mirror Motor Control • Precise movement of scanning mirror – Mechanical Components • Enclosure and mounting system for optics D3 Engineering definition • design • development

D3 Engineering Optical Design definition • design • development

Background • As a part-time employee at ITT Space Systems Division basic knowledge in optics is benificial • Took on optical design as a learning experience D3 Engineering definition • design • development

Requirements • Initially minimal • Achieve a wavelength of 400-700nm • Resolution 25-50nm D3 Engineering definition • design • development

Initial Research • Initial inquiries made at ITT about optical design • Dr. Conrad Wells assisted with providing relevant books and guidance to understanding calculations • Dr. Wells also provided initial design paths as possibilities D3 Engineering definition • design • development

Initial Optical Path BAFFLE MIRROR PRISM PLACE ENCLOSUR LENS TARGE (3) S T E D3 Engineering definition • design • development

D3 Engineering Alternate Path M PRIS E ENCLOSUR definition • design • development BAFFLE PLACES (3) LENS T TARGE MIRROR

Relevant Work • Upon looking into existing companies who make hyperspectral camera’s, Specim, a company in Finland was brought to attention by Scott Reardon • On the website, the dispersion element, prism-grating-prism (PGP) was discussed • Searching PGP turned up Mauri Aikio’s dissertation on hyperspectral imaging and his invention of the PGP D3 Engineering definition • design • development

Work Continued • Calculations for optimization of focal length while optimizing a prism size were preformed. • Focal length results were in the range of one meter which was unacceptable for making a compact design. • Alternate dispersion elements looked at. D3 Engineering definition • design • development

Lambda vs. Height lamda vs. h 30 20 10 h (mm) 0 Series1 4 5 5 5 6 5 7 5 8 5 9 5 1 5 . 4 . 5 . 6 . 7 . 8 . 9 0 0 0 0 0 0 0 . . . . . . . 0 0 0 0 0 0 1 -10 -20 -30 lamda (nm) D3 Engineering definition • design • development

Wavelength vs. Optimized Refracted Angle 0.03 0.02 Theta_t2-theta_not (deg) 0.01 0 Series1 0.4 0.45 0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.95 1 1.05 -0.01 -0.02 -0.03 Lamda (nm) D3 Engineering definition • design • development