Thomas A. Stoffregen Affordance Perception-Action Laboratory (APAL) - PowerPoint PPT Presentation

Motion sickness in physical and virtual systems Thomas A. Stoffregen Affordance Perception-Action Laboratory (APAL) School of Kinesiology University of Minnesota DSC Antibes September 11, 2020

Across platforms  Motion sickness is widely known in VR: Experienced by millions of consumers  Motion sickness is very common in driving simulators: Among new drivers, and in re-training older drivers  Motion sickness will be common in autonomous vehicles  This conference acknowledges that motion sickness occurs across platforms  Physical and virtual motion  For this reason, this conference offers a unique opportunity to compare and contrast

It’s all motion sickness  Motion sickness in physical vehicles has been known for thousands of years  Motion sickness in virtual vehicles (a type of VIMS) is recent, but rapidly increasing  Some scholars consider these to be separate maladies  There are characteristic differences in symptom profiles  I consider them to be the same malady: Motion sickness

Risk Factors  Some risk factors are related to aspects of the technology  IPD, closed-loop processing delays, field of view restrictions  In the VR community, most of the attention goes to these  Most of these do not apply to autonomous vehicles  Other risk factors are related to behavioral issues  The “Driver - Passenger effect” Passengers are more likely to get sick than drivers  In physical vehicles: Drivers < Passengers  In virtual vehicles: Drivers < Passengers  In autonomous vehicles, everyone is a passenger  That is, we must assume motion sickness will be more common in autonomous vehicles Chang, C.-H., Pan, W.-W., Tseng, L.-Y., & Stoffregen, T. A. (2012). Postural activity and motion sickness during video game play in children and adults. Experimental Brain Research , 217 , 299-309. Chen, Y.-C., Dong, X., Chen, F.-C., & Stoffregen, T. A. (2012). Control of a virtual avatar influences postural activity and motion sickness. Ecological Psychology , 24 , 279-299. Dong, X., Yoshida, K., & Stoffregen, T. A. (2011). Control of a virtual vehicle influences postural activity and motion sickness. Journal of Experimental Psychology: Applied , 17 , 128-138. Draper, M. H., Viirre, E. S., Furness, T. A., & Gawron, V. J. (2001). Effects of image scale and system time delay on simulator sickness with head-coupled virtual environments. Human Factors, 43, 129-146 Stoffregen, T. A., Chen, Y.-C., & Koslucher, F. C. (2014). Motion control, motion sickness, and the postural dynamics of mobile devices. Experimental Brain Research , 232 , 1389-1397. Stoffregen, T. A., Hettinger, L. J., Haas, M. W., Roe, M., & Smart, L. J. (2000). Postural instability and motion sickness in a fixed-base flight simulator. Human Factors , 42 , 458-469. Stoffregen, T. A., Faugloire, E., Yoshida, K., Flanagan, M., & Merhi, O. (2008). Motion sickness and postural sway in console video games. Human Factors , 50 , 322-331.

Sex differences  One major risk factor is sex  In general, women > men  In seasickness the sex difference is 2:1  In virtual environments, it can be as high as 4:1  Research must address this problem  It may be related to virtual locomotion  It may interact with the “driver - passenger effect” Curry, C., Li, R., Peterson, N. A., & Stoffregen, T. A. (2020). Cybersickness in virtual reality head-mounted displays: Examining the influence of sex differences and vehicle control. International Journal of Human-Computer Interaction, 36, 1161-1167. https://doi.org/10.1080/10447318.2020.1726108 Koslucher, F. C., Haaland, E., Malsch, A., Webeler, J., & Stoffregen, T. A. (2015). Sex differences in the incidence of motion sickness induced by linear visual oscillation. Aerospace Medicine and Human Performance , 86 , 787-793. Munafo, J., Diedrick, M., & Stoffregen, T. A. (2017). The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects. Experimental Brain Research , 235 , 889 – 901. DOI 10.1007/s00221-016-4846-7

Theoretical issues  Commonly, motion sickness is understood through the Sensory Conflict Theory  The Sensory Conflict Theory motivates specific types of experimental manipulations, and specific types of design interventions  Our work is motivated by a different theory  The Postural Instability Theory motivates different experimental manipulations, and different types of design interventions  A central claim of the Postural Instability Theory is that there should exist postural precursors of motion sickness  Postural activity (standing, or seated) should differ between individuals who become motion sick and those who do not, and those differences should exist before any subjective symptoms of motion sickness Oman C. M. (1982). A heuristic mathematical model for the dynamics of sensory conflict and motion sickness. Acta Oto-Laryngol Suppl 392:44. Reason J. T. (1978). Motion sickness adaptation: A neural mismatch model. J Royal Soc Med 71:819 – 829. Riccio, G. E., & Stoffregen, T. A. (1991). An ecological theory of motion sickness and postural instability. Ecological Psychology, 3, 195-240. Stoffregen, T. A., & Riccio, G. E. (1991). An ecological critique of the sensory conflict theory of motion sickness. Ecological Psychology, 3, 159-194.

Postural precursors are widespread  Postural precursors of motion sickness have been identified in many situations  Postural precursors have been identified in postural activity before subjects were exposed to any motion stimuli  Physical vehicles (seasickness)  Fixed base flight simulators  Console video games ( Xbox ); driving games  Head mounted displays ( Oculus Rift ); driving games  Standing, but also seated Bonnet, C. T., Faugloire, E. M., Riley, M. A., Bardy, B. G., & Stoffregen, T. A. (2006). Motion sickness preceded by unstable displacements of the center of pressure. Human Movement Science , 25 , 800-820. Chen, Y.-C., Dong, X., Chen, F.-C., & Stoffregen, T. A. (2012). Control of a virtual avatar influences postural activity and motion sickness. Ecological Psychology , 24 , 279-299. Dong, X., Yoshida, K., & Stoffregen, T. A. (2011). Control of a virtual vehicle influences postural activity and motion sickness. Journal of Experimental Psychology: Applied , 17 , 128-138. Munafo, J., Diedrick, M., & Stoffregen, T. A. (2017). The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects. Experimental Brain Research , 235 , 889 – 901. Stoffregen, T. A., Chen, Y.-C., & Koslucher, F. C. (2014). Motion control, motion sickness, and the postural dynamics of mobile devices. Experimental Brain Research , 232 , 1389-1397. Stoffregen, T. A., Hettinger, L. J., Haas, M. W., Roe, M., & Smart, L. J. (2000). Postural instability and motion sickness in a fixed-base flight simulator. Human Factors , 42 , 458-469. Stoffregen, T. A., Faugloire, E., Yoshida, K., Flanagan, M., & Merhi, O. (2008). Motion sickness and postural sway in console video games. Human Factors , 50 , 322-331. Stoffregen, T. A., & Smart, L. J. (1998). Postural instability precedes motion sickness. Brain Research Bulletin, 47 , 437-448.

Sample data: Postural sway Raw data from  10-minute trials Six subjects  Before anyone  experienced any subjective symptoms Top: Well  Bottom: Sick  (later) Bonnet, C. T., Faugloire, E. M., Riley, M. A., Bardy, B. G., & Stoffregen, T. A. (2006). Motion sickness preceded by unstable displacements of the center of pressure. Human Movement Science , 25 , 800-820.

Postural precursors of seasickness  On ships at sea, almost everyone is a passenger  We measured sway 24 hours before a sea voyage  Sway differed as a function of the incidence and severity of (later) seasickness  The effect was related to looking at the horizon Nachum, Z., Shupak, A., Letichevsky, V., Ben-David, J., Tal, D., Tamir, A., Talmon, Y, Gordon, C. R., Luntz, M. (2004). Mal de debarquement and posture: Reduced reliance on vestibular and visual cues. The Lyaryngoscope , 114 , 581-586. Stoffregen, T. A., Chen, F.-C., Varlet, M., Alcantara, C., & Bardy, B. G. (2013). Getting your sea legs. PLOS ONE , 8(6), e66949. Varlet, M., Bardy, B. G., Chen, F.-C., Alcantara, C., & Stoffregen, T. A. (2015). Coupling of postural activity with motion of a ship at sea. Experimental Brain Research , 233 , 1607-1616.

Sex differences Women  Motion sickness is more common among women than men  Physical vehicles  Virtual vehicles  For biomechanical reasons, women and men sway differently  Women and men have different Men postural precursors of motion sickness  Sex differences in postural precursors of motion sickness are qualitative Curry, C., Peterson, N., Li, R., & Stoffregen, T. A. (2020). Postural precursors of motion sickness in head-mounted displays: Drivers and passengers, women and men. Ergonomics, in press. Koslucher, F. C., Munafo, J., & Stoffregen, T. A. (2016). Postural sway in men and women during nauseogenic motion of the illuminated environment. Experimental Brain Research , 234 , 2709-2720. Munafo, J., Diedrick, M., & Stoffregen, T. A. (2017). The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects. Experimental Brain Research , 235 , 889 – 901.