A3 - First Iteration Contents Product Description Scenarios of - PowerPoint PPT Presentation

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson A3 - First Iteration Contents Product Description Scenarios of Use: Synopses Scenario 1: Remote Deaf-to-deaf Communication Scenario 2: Local Deaf-to-hearing Communication Functionality Diagram Form Sketches

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Product Description YoG: Oral + Manual Communication Device for the Deaf • Oralist: • YoG supports following methods: Those who communicate by written - Video English and lipreading have used - Text (IM) outdated and complicated services such - Drawing as TTY or replay services, which could be - Voice (optional) improved with wireless+IM technologies. • YoG can aid remote deaf-to-deaf • Manualist: conversations via ASL or via instant For many deaf people their first language messaging and integrates with current is ASL (American Sign Language). products including TTYs, WyndTel, and Some deaf individuals would prefer to phone relay services. communicate via their native language of ASL. • YoG also assists local deaf-to-hearing communication though the use of • YoG attempts to provide universal Mini-YoG. Mini-YoG is a simple detachable accessibility by supporting whatever device for notetaking and drawings that communication channels is most natural can also perform speech recognition. given the users’ context.

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Scenarios of Use Remote Deaf-to-deaf Local Deaf-to-hearing Synopsis Synopsis - Susan, a deaf mom talks to her college - On a street, Tina asks a hearing person for student daughter Tina using both sign the direction to Giant Eagle. and text. Demonstrated Features Demonstrated Features - Text-to-speech by main YoG - Gesture recognition (command, numbers) - Speech-to-text by Mini-YoG - Switching from IM mode to video mode - Mini-YoG as a digital napkin/paper - ASLcommunication via video - Memo during a phone call

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Remote Deaf-to-deaf Scenario 1. Mom gets YoG’s attention by 2. Mom gestures “Call” touching YoG (accelorometer) YoG gives feedback YoG gives feedback (ready to receive speed dial) Browse phone book Speed dial Gesture is one-handed

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Remote Deaf-to-deaf Scenario 3. Mom signs “T-I-N-A” 4. In the meantime... YoG gives feedback that the Tina’s default screen correct number is being dialed Tina is in IM mode Mom’s Mom’s Tina is in video mode Letter-by-letter ASL recignition Tina’s Tina’s

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Remote Deaf-to-deaf Scenario 5. Incoming call from Mom 6. Tina answers by pressing - baloon blinks a shortcut for an automated - vibration text message. Text fields appear - incoming call mode on both YoG’s and the message (IM/Video/Voice) is displayed. Tina chooses - caller ID to ignore Tina chooses to answer: automatic Mom’s Mom’s Tina chooses to answer: type in Tina’s Tina’s Tina’s Tina’s

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Remote Deaf-to-deaf Scenario 7. Tina slides out her keyboard 8. Tina sees herself on a and set up video. thumbnail. As soon as she is Mom is still waiting for Tina. certain on her position, Tina gestures “Now show me to Mom.” Mom’s Mom’s Tina’s Tina’s

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Remote Deaf-to-deaf Scenario 9. Finally they see each other. 10. Mom wants to send They talk using ASL. Uncle Bob’s phone number to Tina. Mom gestures YoG “Recognize my ASL.” Both YoG’s display text fields and are ready to receive. Mom’s Mom’s Tina’s Tina’s

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Remote Deaf-to-deaf Scenario 11. Mom signs “412-355-6789.” 12. Mom gestures Mom gestures “clear” one digit “Stop recognizing.” during the process to correct it. The phone number is saved to both YoGs’ memo. Mom’s Mom’s Tina’s Tina’s

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Remote Deaf-to-deaf Scenario 13. They exchange “bye.” 14. Tina gestures “hang up.” Mom gestures “hang up.” From the call summary, Tina Her YoG displays call summary. jumps to the Memo. Mom disappears from Tina’s screen. Mom’s Tina’s Tina’s

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Local Deaf-to-hearing Communication Main + Mini-YoG Mini-YoG Features About Mini-YoG - A small satellite device which detaches 1. Pull out of Main YoG Stylus from the main unit. It may be used in any Mini-YoG 2. Unscroll local situation where sign language based Main-YoG < communication is not possible. Speaker/Microphone - Designed simple for walk-up-and-use like a simple notepad and stylus Stylus Touch-sensitive screen - When someone is done writing the hearing Write on the screen can show or hand back the Mini-YoG to the deaf user. - If the deaf user needs to ask follow up questions they can use the keyboard on their main YoG device (translated into an Clear Button Text field audio form by choice). Dictated English The drawing and text on the Mini-YoG isn’t - When the deaf persons question has been erased unless the clear button is pressed. appears on the answered they can take the Mini-YoG back bottom of the screen When the clear button is pressed and held Scroll arrows appears the screen and dictation is cleared and the and re-connect it to their main device. text, "Please speak or write" is placed in the as needed dictation area.

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Local Deaf-to-hearing Scenario 1. Tina enters her question 2. Tina approaches a hearing passer-by in advance: “How do I get to and gets their attention Giant Eagle?” If the technology exist, do ASL > English translation

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Local Deaf-to-hearing Scenario 3. Tina extracts the Mini-YoG from the 4. Main-YoG speaks the main unit pre-entered message Stylus Mini-YoG Main-YoG Please write or speak Clear Screen

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Local Deaf-to-hearing Scenario 5. Tina hands over her Mini-YoG 6. The hearing is instructed on how to to the hearing person answer using Mini-YoG - Mini-YoG displays “Please write or speak” - Pad-looking device and stylus are self-explanatory - Main-YoG speaks (optional) Please write or speak Clear Screen

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Local Deaf-to-hearing Scenario 7. Tina uses her Main-YoG keyboard to ask 8. The hearing returns Mini-YoG a follow-up question; to Tina The hearing nods; Tina’s Main-YoG says (or Tina shows) “Thank you” to the hearing

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Local Deaf-to-hearing Scenario 7. The hearing takes Min-YoG, 8. Tina can see him drawing a map and writes and speaks directions she can also read what he says at the same time Tina watches him giving directions

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Form Sketches - 1

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Form Sketches - 2

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Form Sketches - 3

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Form Sketches - 4

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Form Sketches - 5

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Form Sketches - 6

1 1 /13/2001 - First Iteration Micah Alpern, Keywon Chung, Erika Persson Form Sketches - 7