HUMANWIN.AI FROM TEKNOLOG.IO TURNING ON “ ACCESSIBLE MODE” FOR USERS WITH MOTOR IMP AIRMENTS W3C Workshop on Web Games 27 June 2019 Redmond, WA USA
LUIS D. RODRIGUEZ PRESENTER ARTIFICIAL INTELLIGENCE PRODUCT DESIGNER AI, ML and IoT Experience USER EXPERIENCE AND USER RESEARCHER CO-FOUNDER Teknolog IO, LLC & humanwin.ai H U M A N W I N . A I
DISABILITY PSYCHOLOGICAL IMPACT More than 13 percent of non institutionalized adults have some sor t of physical disability. The most common physical disabilities are trouble hearing, moving around or doing day-to-day tasks like getting dressed. About 70 percent of non institutionalized adults with physical disabilities are over age 60. Another type of disability is learning disability, a term used to describe a range of academic difficulties. Dyslexia, a reading disability, is one example. While some interventions focus on teaching stress management and other coping skills, others focus on the disability itself. H U M A N W I N . A I https://www.apa.org/topics/disability
MAKE WEB GAMES USABLE BY AS MANY PEOPLE AS POSSIBLE GOAL H U M A N W I N . A I
“ Accessible” Mode Making sure all views, interactions are clickable / tappable by keyboard, ability switches or voice enabled… provide alternate to gestures H U M A N W I N . A I
Photo credit: https://www.etsy.com/shop/Hobknobhill
Photo credits: https://www.enablemart.com/, https://www.xbox.com
Photo credits: https://www.enablemart.com/, https://www.xbox.com
ABILITY SWITCHES REQUIRE ONL Y THE SLIGHTEST TOUCH FOR ACTIV ATION, EASIL Y WITHSTAND BODY MOVEMENTS OR SEVERE BLOWS. H U M A N W I N . A I H U M A N W I N . A I
VOICE ENABLED UL TRA-SENSITIVE AND PERSONALIZED: RESPOND TO WHISPERS OR LOUD CLAPS AND SET THE SOUND SENSITIVITY TO RESPOND. H U M A N W I N . A I H U M A N W I N . A I
Motor Impairments CEREBRAL P ALSY NEURAL TUBE MUSCLE AND JOINT HEAD AND SPINE DEFECTS CONDITIONS TRAUMA A congenital disorder of Bir th defects of the brain, Discomfor t, pain or Injuries or accidents to the movement, muscle tone, or spine, or spinal cord. inflammation from cartilage, brain and/or spinal cord such as posture. Due to abnormal brain bone, ligaments, tendons or concussions, blood clots and development, often before Includes: upper body weakness muscles. Most commonly refers fractures. bir th. and trouble breathing and to arthritis or arthralgia. swallowing, not being able to Includes: confusion, loss of Includes: exaggerated reflexes, move legs, torso, or arms, also Includes: pain that can be mild, consciousness, nausea, loss of floppy or rigid limbs, and might include learning causing soreness or it can be movement or sensation, trouble involuntary motions. disabilities. severe, making even limited with balance or walking, pain or movement extremely painful. pressure in the back, neck or head. H U M A N W I N . A I
Anxiety Being Watched Working Entering a Room Where Failure People Are Seated Being Criticized Losing Control Making Mistakes Presentations are communication tools Presentations are communication tools that can be used as demonstrations, that can be used as demonstrations, Speaking in Public Feeling Rejected “Looking-Staring” lectures, speeches, reports, and more. lectures, speeches, reports, and more. H U M A N W I N . A I
Stress Disruptive Behavior Social Norms Functional Limitations Adaptive Limitations Coordination Communication Presentations are communication tools Presentations are communication tools that can be used as demonstrations, that can be used as demonstrations, Chronic Health Relatives & Caretakers Seek Independence lectures, speeches, reports, and more. lectures, speeches, reports, and more. H U M A N W I N . A I
Coping Strategies Information Seeking Wish-Fulfilling Medical Information Mobile Apps & Internet Other Sources Plan of Action Presentations are communication tools Presentations are communication tools that can be used as demonstrations, that can be used as demonstrations, Cognitive Efforts Escapism Adjustment lectures, speeches, reports, and more. lectures, speeches, reports, and more. H U M A N W I N . A I
HTTPS://DRIVE.GOOGLE.COM/FILE/D/120MD9PMK8S3TIQJMDEGAUSLBMJGAPZZU/VIEW
HTTPS://DRIVE.GOOGLE.COM/FILE/D/1L2MIXRNTWK5MAKPVYZDJULPQDC-GAV6Q/VIEW
HTTPS://DRIVE.GOOGLE.COM/FILE/D/1OF-AL-QEOYGP3CGNQSJAKCUAY4BIYYA6/VIEW
HTTPS://DRIVE.GOOGLE.COM/FILE/D/1PZOTNG8_KQNOFLIVKKM_MTAMK88N6WGZ/VIEW
HTTPS://DRIVE.GOOGLE.COM/FILE/D/1Z1FZZRLV2S5YXYN1CP0XPUA6F3B2CBR5/VIEW
HTTPS://DRIVE.GOOGLE.COM/FILE/D/19IODAZYSVA2D4S5RAGL30PDJPE-WMSW2/VIEW
HTTPS://DRIVE.GOOGLE.COM/FILE/D/1DUAD0OJK_LSCPD2F4YG4G3BAXJKWVMBR/VIEW
OPPORTUNITY “IN THE ZONE” FOCUS DETERMINA TION CONCENTRA TION H U M A N W I N . A I
RETHINK INPUTS AND OUTPUTS TURN OFF: Specific targets with Specific key presses Exact touch targets mouse pointer H U M A N W I N . A I H U M A N W I N . A I
DEVICE WEIGHT HANDHELD Don’t require holding devices such as mobile phone for too long to interact with web game Presentations are communication tools that can be used as demonstrations, lectures, speeches, reports, and more. Presentations are communication tools that can be used as demonstrations, lectures, speeches, reports, and more. H U M A N W I N . A I
RETHINK MOVEMENTS WIDEN Mouse areas Touch targets UI controls H U M A N W I N . A I H U M A N W I N . A I
RETHINK MOVEMENTS CONT’D ELIMINATE Small precise movements Selecting text Right clicking text H U M A N W I N . A I H U M A N W I N . A I
RETHINK FEEDBACK REEV ALUATE Requiring time based Requiring movement Other mechanisms? interactions H U M A N W I N . A I H U M A N W I N . A I
RETHINK ENGAGEMENT ACCESSIBILITY FROM THE START Interaction Task H U M A N W I N . A I H U M A N W I N . A I
RETHINK IMP ACT FOR DESIGNERS AND DEVELOPERS Testing Statement Standards Limitations H U M A N W I N . A I H U M A N W I N . A I
Building Voice Capability Into Web Games Ceases fine-motor control interactions with hands and opens new opportunities. H U M A N W I N . A I
Voice UX Ecosystem Trend? Or Worth the Costs? Additional Opportunities Common Appliances Hardware Digital Signal Processing (DSP) New Services for Voice Interaction Presentations are communication tools Presentations are communication tools that can be used as demonstrations, that can be used as demonstrations, Micro-Electrical Legal Ramifications Branding and Marketing lectures, speeches, reports, and more. lectures, speeches, reports, and more. Mechanical Systems H U M A N W I N . A I
OPPORTUNITIES BENEFITS FAR OUTWEIGH THE RISKS FOR ACCESSIBILITY LOCALIZA TION AND MUL TI-DEVICE MIC USAGE WIN OVER NEW PERSONALIZA TION SESSION DISCOVERY USERS TERRITORY Adapting to a specific Experience across Leads to engagement More access than just And many, many more locale or market many devices one channel H U M A N W I N . A I
COSTS, BENEFITS, RISKS AND OPPORTUNITIES BUILDING THE CASE FOR VOICE UX Should you design a VUI and experience to your web game or as a capability? Presentations are communication tools that can be used as demonstrations, lectures, speeches, reports, and more. Presentations are communication tools that can be used as demonstrations, lectures, speeches, reports, and more. H U M A N W I N . A I
KEEP IT SIMPLE Will people want to talk to your web game? YES OR NO? H U M A N W I N . A I
YES! PEOPLE WILL W ANT TO ENGAGE RELA TIONSHIP V ALUE POTENTIAL Form a connection or bond They'll look for you in the future. Leverage all the interesting and with your company or organization. sophisticated things of VUI. Manage the flow of information just like websites or apps. H U M A N W I N . A I
SPEECH ANAL YTICS TOOLS A NEW SET OF CUSTOMER METRICS FOR SUCCESS Speech analytics tools that can spot spoken keywords or phrases, either as real-time alerts on live audio or as a post-processing step on recorded speech. H U M A N W I N . A I
VOICE UX ANAL YTICS CREA TES OPPORTUNITIES ITERA TIONS Based on usage, data emphasizes which features were more popular INTERRUPTIONS Detect where in the voice interactions users get stuck and give up PERFORMANCE Adjust server limits in real time as usage spikes happen H U M A N W I N . A I
Do Y ou Use Voice Commands T o Accomplish Tasks in Daily Life? EMPATHY H U M A N W I N . A I
Remember that adding a voice capability work best in a specific context only and when we break this rule or not prepare to adapt for additional contexts the experience fails tremendously. H U M A N W I N . A I
TRADITIONAL ACCESSIBLE SOLUTION PROGRAMMERS UNDERSTAND WHAT THEY ARE DOING Understand accessibility tasks Code libraries with Formulate Explicit solution useful behaviors H U M A N W I N . A I H U M A N W I N . A I
AI FINDS ACCESSIBLE SOLUTION OFFLOADING COGNITIVE LABOR Accessibility criterion Heuristics, Accessible Discovery methods & web game Solution Structures H U M A N W I N . A I H U M A N W I N . A I
TURNING ON “ ACCESSIBLE MODE” FOR USERS WITH MOTOR IMP AIRMENTS H U M A N W I N . A I
Recommend
More recommend
