The 16 th U.S.-Korea Forum on Nanotechnology: Nanosensors Related to Human Cognition and Brain Research & Nanomedicine Focusing on Single Cell Level W EARABLE H UMAN E MOTION M ONITORING S YSTEMS 23 September 2019 Young-Ho Cho Nano Sentuating Systems Laboratory Bio&Brain Engineering Department Cell bench Research Center KAIST
Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 2
Mental Health and Human Emotion Domestic Depressive Disorder (persons) OECD Suicide Rate (persons) Per 100, 000 persons 2015 년 601,152 30 28.7 25 2014 년 588,155 20 OECD Ave. 12.0 15 18.7 2013 년 15.8 591,148 15.3 10 13.6 12.3 12.0 11.3 10.8 10.8 10.5 5 7.5 2012 년 6.3 2.6 591,276 0 Japan Fin. Pol. Austria Swed Swiss Nor Den Ger Neth Spain Italy Turkey 2011 년 534,854 [Health Insurance, 2015] [OECD.STAT, Health Status Data, Statistics and Indicators for 34 Countries, 2012*,2013] Domestic Mental illness and Socio-economic Loss Domestic Accidental Crime Ratio (Youth Puberty/Misconduct, (over total crime, %) 42.5 Elderly/Menopause Climacteric, etc.) 35.3 29.8 28.1 27.2 16.8 Mental Illness Socio-economic Loss 1.4 Experience [ 삼성경제연구소 , 2013] [ 보건복지부 2012 년 ] Violence Assault Homicide Theft Rape Robbery Fraud 1 out of 4 (27.6 %) 20.066 Trillion Won [Police, 2015] Monitoring of the Physiological Signs of Human Mental Health and Emotional Status Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 3
Human Status Human Status - Physical (Body) Brain Mind - Mental (Mind) Output (Reason, Emotion : (Results) Experience, Memory, etc.) Functions & Input Mechanisms Body (Cause) Input-Output Process Sensory and Causality Analysis (5 Senses) Environmental Signs & Symptoms Situation Output Monitoring and and Assessment Conditions (Physiological Signs of Psychological Symptoms) Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 4
Human Emotion Monitoring Patches Non-invasive and Active Monitoring of Human Mental Health and Emotional Status based on the Physiological Signs on Human Skin Emotion Bands Environmental (Multi-Emotions) Situations and Conditions Emotions Skin Physiological signs - Temp. Sweat, Pulsewave, etc.) Emotion Patches (Mono-Emotion) Emotion Evaluator Non-invasive Active Devices Sensors Actuators Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 5
Skin Patches for Human Mental Health & Emotion Monitoring (Physiological Signs on Human Skin) Device Issues: Stability (Reliable Detection) Comfort (Conformal Contact, Skin Trouble) I. Thermal Comfort II. Emotional Touch III. Physiological Stress Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 6
I. Thermal Comfort 19 ° C (66.2 ° F)? Environment Human Monitoring Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 7
Sweat Rate: Reference A Skin Sign of Human Thermal Status ◈ What is “Sweat rate”? Quantitative change of human sweat amount = Sweat mass generation / skin area / time [ g/m 2 h ] ◈ Physiological Meaning Linear with human core temperature [5] Key indicator for human thermoregulatory response [4] Sweat rate Human thermal status (Core temperature) [4] K. Wilike, et. al. , Int. J. Cosmet. Sci. (2007) [5] Samual N. C., et. al. , J. Appl. Physiol. (2009) ☞ Sweat rate indicates human thermoregulatory status objectively and quantitatively. Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 8
Ventilated Sweat Rate Measurement Reference Type Forced Ventilation Natural Ventilation Device Structure [reference] Skin Present (2015) [Pietro S. et. al (2010)] [Toshio O. et. al (1998)] [Robert I. et. al (2009)] RH ventilation Forced ventilation Forced ventilation Natural ventilation Natural ventilation method by pump by ice condenser (Manual) (Automatic) Detection RH* difference RH difference RH rising rate RH rising rate principle at two points at two points Portable N/A ~ 1 kg 150 g 63 g (Weight) (Pump) (Condenser) Stable △ △ ○ ○ (Continuous (Periodic ice removal) (Manual initiation) measurement) Measurement N/A N/A 2~3 min 3 min period Sweat rate ~ 600 ~ 250 ~ 200 > 135 range (g/m 2 h) *RH: Relative Humidity (%) Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 9
Sweat Rate Monitoring Watch Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 10
Portable Sweat Rate Monitoring integrated with thermo-pneumatic actuators for automatic ventilation Previous Problems Present Solutions Forced ventilation devices Portable size Bulky size (~ 1 kg) (33 g) Natural ventilation Manual Automatic devices ventilation ventilation Unstable to Stable to motion and motion and external wind external wind (< 0.5 m/s*) (~1.5 m/s**) * Environmental microclimate ** Human walking speed Cognitive Air-conditioning, Human thermoregulatory status monitoring wrest watches, etc. Integrated Sweat Sensors for sweat rates, humidity, pH and ions. Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 11
Skin Hardness Patches Problems • Conventional physiological signs: Physiological sign - Skin temperature and conductance measurement Low accuracy: R 2 < 0.7 Solution • New physiological sign: Skin hardness Normal Cold Error: 23.5% Accuracy: 17.4% Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 12
II. Human Emotional Touch Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 13
Piloerection (Goose Bumps) Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 14
Goose Bump Goose bumps Width ~2 mm Detection Height ~200 μ m Height Density >10/cm 2 Patches Shape Circular Width Mosquito Repellent coils (2 cm X 2 cm) A’ A Surface Deformation Capacitance decrease Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 15
Goose Bump Monitoring Patch Attachable and Detachable Skin Patch (2 cm X 2 cm) - Conformal skin contact (Van der Waals force) - Easy removal (peeling off) Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 16
Reference Goose Bump Monitoring Two successive piloerection measurement Subject 1 (male, age : 28) Condition Grabbing ice cubes Piloerection Piloerection 1 2 -6.2fF -9.2fF Intensity (~145 μ m) (~194 μ m) Duration 3.5s 3.5s - Quantitative piloerection monitoring was demonstrated Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 17
Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 18
III. Human Physiological Stress Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 19
Human Physiological Stress Negative influences of stress Stressor Stress Out • Social problems Physiological Response Occur [1] Acute stimulation Decrease Suicide work efficiency [3] Accidental Crime [2] • Healthcare problems Chronic stimulation Youth Puberty Misconduct Elderly Menopause Climacteric Depressive Cardiovascular Disorder [2] Illness [4] Stress monitoring (Mental heath management) in daily life [1] Carlson, N., Foundation of Physiological Psychology, Pearson Education Asia, 2008. [ 3] Macan, T., et al., Journal of Educational psychology , 1990. [2] Mann, J., et al., European Psychia try, 2010. [4] Pickering, T., et al., Current hypertension reports , 2001. Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 20
Reference Stress Measurement Methods Self report - Not objective, Self report [5] - Not quantitative, - Survey about subject’s emotional state - Not continuous - No consistency Self report - Body fluid analysis [6] Not objective, - Not quantitative, - Measure cortisol concentration in saliva or blood - Not continuous - No continuous monitoring Self report Physiological data analysis from multiple sensors [7] - Not objective, - Measure fight-or-flight response of sympathetic - Not quantitative, nervous system - Not continuous - Objective, Quantitative, and continuous monitoring [5] Horowitz, M., et al., Psychosomatic medicine , 1979. [6] Lee, J., et al., Medical Hypotheses , 2012. [7] Healey, J., et al., IEEE TRANSACTIONS ON INTEK|LLIGENT TRANSPORTATION SYSTEMS , 2005. Wearable Human Emotion Monit oring Systems < U.S.-Korea Nano Forum, San Diego, 23&24 Sept. 2019> Young-Ho CHO 21
Recommend
More recommend