No Hands Landline Answering System By Vidit Talati, Gokul Krishnan, and Mahendra Reddy (Group 15)
Client Need Client seeks solution for patient, RB: A quadriplegic due to multiple sclerosis Can speak, has normal cognitive function, and minimal use of right hand Cannot move any major limbs or use fingers to press with force to depress buttons There is a need for the ability to use a landline telephone specifically, answering incoming calls and placing calls Need for no physical exertion
Project Scope Deliver a system that will enable a quadriplegic patient to answer landline phone calls using only voice commands and/or head movements Software component: must allow for answering of phone calls, as well as disconnecting from calls should save contacts into a “phonebook” on the app should enable patient to dial at least ten digit numbers by inputting each digit individually through voice commands Hardware component: should enable to patient to attend calls away from the system, such as while in bed should maintain a sense of privacy
Software GUI simplicity Train in 30 minutes or less Design Specifications Calling interface Allow digit-by-digit calling of 10 or more digits Memory Store a “phonebook” of at least 30 names Design Specific Design Metric Category Requirement Run speed App processing and action should take no more than 10 Hardware Speaker frequency 100 Hz-23.5 kHz seconds after voice command (speakers, landline phone) Accuracy Maximum of 0 wrong numbers allowed; a restart Speaker volume 70-80 dB button must be created in Speaker weight less than 0.38 kg (see case of voice misinterpretation explanation right below). Portability Landline system weight No more than 2 kg Speaker-to-landline at least 10 m Cost N/A less than $1000 range Privacy N/A Person farther than 3 feet Speaker casing size no more than 65 mm x 65 mm away cannot hear phone x 40 mm conversation Landline phone Detect voices/voice commands sensitivity as quiet as 45 dB Battery life N/A All pieces should last at least 12 hours Spatial speaker Can rotate from 0 to 80 orientation degrees Safety Injuries from hardware 0 injuries allowed from any of the hardware components. Speaker distance from No less than 10 cm from ears client
Major Hardware Components Jackco ZT51000 Bluetooth Speakers HS-422 Servo with Spline Arm 4th generation iPad Raspberry Pi (Model B, CanaKit WiFi Adapter Revision 2.0)
Raspberry Pi/Servo Circuitry Design Circuit Schematic PCB Layout
Casing and Mounting Designs Right Side Motor Mount Circuit Casing/Left Mount Lid Right Side Speaker Platform Left Side Speaker Platform
Design Feasibility - Hardware Calculations When using a 6 V (or higher) power supply, the servo can produce a torque of 4.1 kg*cm Maximum mass movable by servo:
Battery Life Servo motors draw 8.8 mA when still and 180 mA when “in motion” batteries will only last The Raspberry Pi Minicomputer draws a peak current of 515 mA Raspberry Pi can be powered for a minimum of
Software Considerations Twilio was chosen and is more feasible due to usability of its API Raspberry Pi was chosen over Arduino Voice Recognition Platforms (NSSpeechRecognizer, Siri, OpenEars) OpenEars = very integrable API, end user usability
Software Design
Software Design cont.
Software Design cont. Incoming calls - Answering phone call solution: Initial problems - listening for voices while answering calls Solution Incoming Call is immediately rejected Phone number of caller shows up on app screen User says “Accept” to call person back End calls by saying “Stop”
Software Design cont. Contact Book Press “Add a Contact” UIButton to add names NOT hands free UISwitch toggle switches added for nurse’s convenience Moving speakers inactivating voice recognition Reset Button closes app
Parts, Materials, and Manufacturing Quantity Product ID/Model Part Number Website/Store Obtained from Cost 2 Servo motor - HiTec 422 (Standard Size) HS-422 17 SparkFun Electronics $9.95 x 2 = $19.95 17 2 Standard Spline Arm 56361 1 ServoCity $5.99 x 2 = $11.98 1 VELCRO - Industrial Strength Low Profile - 10' x 1" Tape - Black 1 91100 37 VELCRO brand (from Amazon.com) $10.62 37 Jackco Black and Red Portable Bluetooth 1 Speaker ZT51000 20 Jackco (from Amazon.com) $36.99 20 Eveready (from batteryjunction.com), but obtained Eveready Super Heavy Duty Zinc Carbon from Widder’s Lab 2 9V Battery 1222SW 12 $2.49 x 2 = 4.98 12 Digi-Key Electronics, but obtained 2 9 Volt Battery Snap-I Style-3" Wire Leads BS3I 8 from Widder’s lab $0.63 x 2 = $1.26 8 RASPBRRY- Raspberry Pi (from Amazon.com), 1 Raspberry Pi Model B, revision 2.0 PCBA512 32 but obtained from Widder’s lab $30.00 32 adafruit.com/products/1140 Raspberry Pi Model B, revision 2.0 Case Adafruit Product originally, but obtained from 1 (Discontinued by Adafruit) ID: 1140 27 Widder’s lab $10.00 27
Parts, Materials, and Manufacturing Micro Center (87 Brentwood Promenade Ct, CanaKit Raspberry Pi WiFi Adapter CKXW1000 33 Brentwood, MO 63144) $9.99 33 Wal Mart (1900 Maplewood Commons Dr, Gorilla Glue Single-Use Tubes, 4- Maplewood, MO 63143) Pack 5000502 16 $4.75 16 Printable Circuit Board for our http://fab.fritzing.org/ For 1-4, $17.15 each; for 5-9, $12.24 each; Circuit N/A fritzing-fab13 for 10 or more, $9.79 each 13 Aukey 12000 mAh Portable Power Bank Charger PB-N28 6 Amazon.com $14.99 6 Photive 12000mAh Dual USB Portable Battery Charger PH-PB12B 26 Amazon.com $34.99 26 Apple iPad 4 with Retina Display - 16GB, Wi-Fi, Black, with iOS 8.3 IPAD 4 16B BLK CR 5 Apple (on Amazon.com) $314.99 5 Fing - Network Scanner Version 3.2.0 14 Apple App Store Free 14
Hardware Assembly After circuit was made, it was housed in a casing and mounted mounted and lid attached using Velcro straps Servos mounted onto case (left) and right side motor mount (right)
Hardware Assembly cont. Speakers placed on platforms and mounted on HS-422 spline arms using Velcro Issue: not sturdy, platforms wobble SAFETY: Edges of platform were covered in felt-like material *Motors are already mounted
Finished Hardware
Software Development Integrated OpenEars platform into app Data flow within a Model-View-Controller System
Software/Hardware Integration Canakit WiFi adapter allows for wireless communication between Raspberry Pi and iPad app NSStream from app to Raspberry Pi’s IP address routes messages to Pi’s Linux terminal
Conclusions Specific Design Requirement Metric Was the Design Spec Met? If Not, Why? Speaker frequency 100 Hz-23.5 kHz No , but very close. iPads, which relays audio to the Jackco speakers are able to produce sound across 20-20k Hz. Speaker volume 70-80 dB Yes , the Jackco speakers can be set to this volume Speaker weight less than 0.38 kg (see explanation Yes , the Jackco speakers weigh 8.5 ounces, right below). or 0.241 kg With the platforms, they weigh 0.271 kg. Speaker-to-landline range at least 10 m Yes , the speakers-landline range can be extended to 10m using a long auxiliary cable or purchasing an aux-bluetooth adapter. Landline phone sensitivity Detect voices/voice commands as No , iPad cannot detect voice commands this quiet as 45 dB quiet. However, client can buy an iPad microphone Spatial speaker orientation Can rotate from 0 to 80 degrees Yes, the HS-422 motors can rotate 180 degrees. Speaker distance from client No less than 10 cm from ears Yes , 10.3cm away
Conclusions GUI simplicity Can be trained to use in 30 minutes or less Yes , the app is simple enough to be taught in about 10 minutes. Calling Allow digit-by-digit calling of 10 or more digits Yes interface Memory Store a “phonebook” of at least 30 names Yes , the amount of names the app can store is limited only by the storage space on the ipad, which is far more than 30 names. Run speed App processing and performing action should take no Yes , voice command processing takes a maximum of four more than 10 seconds after client says voice command seconds. Accuracy A maximum of 0 wrong numbers allowed; a restart Yes button must be created in case the software misinterprets a voice command
Conclusions Cost less than $1000 Yes , the summed cost of all items in Table 2 is $505.49. Privacy Person farther than 3 feet away cannot Yes , this was concluded from observations. hear phone conversation Battery life Any piece of system not connected to No, the batteries that run the motors will drain in outlet needs to last at least 12 hours 2.22 hours in the design’s current state. Injuries from hardware 0 scrapes, cuts, bruises or ear damage This is dependent on how careful the user and allowed from any of the hardware other people walking past the system are. components.
Issues with Prototype Bluetooth automatically disconnected after connection was made on Twilio went for auxiliary cable instead to extend range and save battery Mounting system is not transferrable to bed Nurse can transfer speakers to bed, but privacy will decrease Servos are constantly twitching
Future Directions Stop servos from twitching Develop a more universal mounting system for use in wheelchair and in bed Create a way for Raspberry Pi’s IP Address to remain static Expand from single word commands to phrases
Recommend
More recommend
