Imaging Sensor Systems Key Technology for Innovative and - PDF document

Dies ist eine Überschrift, zentral September 11-15, 2017, University of Stuttgart Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems Arno Ruckelshausen University of Applied Sciences Osnabrück, Germany / Faculty of Engineering and Computer Science COALA - Competence Center of Applied Agricultural Engineering Source: “Semiconductor Devices: Basic Principles“, J.Singh, John Wily & Sons, 2001 Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 1 Agriculture 2017+ 2011: 7,0 Billion people 2050: 9,3 Billion people Too many people making too many problems. Genesis, Land of Confusion, 1986 Global Relevance : Challenges :  Food  Increase of production  Energy  Reduction of environmental burdons  Ressources  Saving of ressources  Landscape preservation  Optimization of logistics  Social aspects Sources: United Nations Development Programme / Sustainable Development Goals, 2015 Sources: UN World Population Prospects, May 2011; : http://www.aces.edu/pubs/ systemsview.wordpress.com , MSClipArt (2011) Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 2 1

Overview Technology meets Nature Image-based Sensors in Agriculture Modeling Environment Alternative (Technological) Concepts for Agriculture Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 3 Overview Technology meets Nature Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 4 2

Technology meets nature … Sources: University of Applied Sciences Osnabrück , agrarheute.com Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 5 Plant production Question: How does a plant grow ? Answer: It depends on … Source: H.Poorter et al. , Journal of Expoerimental Botany, Vol. 61, No.8, pp.2043-2055, 2010 Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 6 3

Crop sensors (examples) … Sensor data Saving Instructions (€/ha) Knowledge Sources: Claas, Agricon, FarmFacts Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 7 1D-Moisture Sensor (NIR) for Maize (harvest) Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 8 4

1D-Moisture Sensor (NIR) for Maize (harvest) Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 9 Sensor systems: fertilization, crop protection (examples) Non-image-based sensors Image-based sensors Sources: Garford, AgriCon, Claas Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 10 5

Out in the field …   Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 11 Agritechnica 2015: Imaging goes Agriculture Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 12 6

Overview Image-based Sensors in Agriculture Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 13 Imaging Image-based technologies:  Color and grey scale imaging (1D, 2D)  Shadow imaging Imaging concepts:  Highspeed imaging  Image processing (robustness)  3D-imaging (laser, stereo, time-of-flight, ,,,)  Sensor and data fusion  Multispectral imaging  Smart sensors  Hyperspectral imaging  Simulation technologies  Thermal/UV imaging  Human machine interface  Others (x-ray, THz, ultrasonic, NMR,…)  Remote imaging  Low cost Imaging Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 14 7

Shadow Imaging (1) Light curtains, laser-line sensors  “1-bit-imaging“ Lab Field Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 15 Shadow Imaging (2) Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 16 8

Shadow Imaging (3) Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 17 Shadow Imaging (4) Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 18 9

Shadow Imaging (5) Source: Ivana Kovacheva, University of Applied Sciences Osnabrück, Master Thesis (2013), CBA-Workshop (2014) Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 19 Shadow Imaging (6) Rough shape information (low resolution light curtain) Stalk and ears of corn (high resolution light curtain) Stalk, ears and awns (ultra-high resolution laser line sensor) 20 Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 20 10

Shadow Imaging (7) Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 21 Shadow Imaging (8) Source: Dominik Nieberg, Master Thesis (2015), Osnabrück; The Plant Accelerator, University of Adelaide Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 22 11

Hyper/multi-spectral imaging (1) Technological solutions for image-based spectroscopy Full Frame Line-based system Filter wheel Programmable filter Image-based spectrometer Multi-chip camera Filter matrix Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 23 Hyper/multi-spectral imaging (2) Miniature spectrometer “1 pixel“ Soil (non selective) Intensity Plant Wavelength Spectral Imaging n pixel (selective) ... Intensity n Wavelength Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 24 12

Hyper/multi-spectral imaging (3) Spectral Imaging Spectral Cube Moisture parameter (Technology) (Data) (Algorithms) Soruce: Marius Thiel, Hochschule Osnabrück, PhD (in preparation, University Hanover) Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 25 Hyper/multi-spectral imaging (4) Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 26 13

Hyper/multi-spectral imaging (5) Example: Detection of potatoes and impurities (harvest) Harvest machine Pointwise spectral analysis and image processing (online) Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 27 „Multiwavelength Laser Line Profile Sensing - MWLP“ (1) Combination of 3D and spectral imaging in one sensor Source: Strothmann, W., Ruckelshausen, A., Hertzberg, J., Scholz, C., & Langsenkamp, F. (2017). Plant classification with In-Field-Labeling for crop/weed discrimination using spectral features and 3D surface features from a multi-wavelength laser line profile system. Computers and Electronics in Agriculture , 134 , 79-93. Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 28 14

„Multiwavelength Laser Line Profile Sensing - MWLP“ (2) Source: Wolfram Strothmann ; Arno Ruckelshausen and Joachim Hertzberg: "Multiwavelength laser line profile sensing for agricultural crop characterization ", Proc. SPIE 9141, Optical Sensing and Detection, 2014, http://dx.doi.org/10.1117/12.2052009 Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 29 „Multiwavelength Laser Line Profile Sensing - MWLP“ (3) Movie Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 30 15

„Multiwavelength Laser Line Profile Sensing - MWLP“ (4) Movie Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 31 „Multiwavelength Laser Line Profile Sensing - MWLP“ (5) 3D-NDVI-Imaging Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 32 16

„Multiwavelength Laser Line Profile Sensing - MWLP“ (6) 3D / NDVI – Vegetation Index Process integration of MWLP-system Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 33 „Multiwavelength Laser Line Profile Sensing - MWLP“ (7) Scattering example: apples dropped from 60 cm height MWLP system, MWLP system, Photo of scene, Photo of scene, distance map, scattering feature 14 hours after immediately after of NIR laser @ immediately after dropping / dropping / 850 nm, drop damaging the damaging the immediately after apples apples drop Imaging Sensor Systems – Key Technology for Innovative and Sustainable Agricultural Systems (Arno Ruckelshausen ) 34 17