device i
play

Device I \ : ___ _ -.;:--r \..) ' i : 108b B- (Telephone) - PDF document

106~ ~r ~ ~ 16 -~ 12/~ -~-:~-~:.~:~_: (~ ~-r>r\, ~ 1~b 111111 1111111111111111111111111111111111111111111111111111111111111 US008681951Bl c12) United States Patent US 8,681,951 B1 (10) Patent No.: *Mar. 25, 2014 Lavian et al.


  1. US 8,681,951 B1 Page 3 (56) References Cited 7,286,990 B1 10/2007 Edmonds et a!. 7,289,608 B2 10/2007 Kumhyr 7,289,904 B2 10/2007 Uyeki U.S. PATENT DOCUMENTS 7,299,405 B1 1112007 Lee eta!. 7,303,121 B2 12/2007 Martinez 6,636,835 B2 10/2003 Ragsdale et al. 7,319,477 B2 112008 Katz 6,653,930 B1 1112003 Bonomo eta!. 7,324,947 B2 112008 Jordan eta!. 6,658,389 B1 12/2003 Alpdemir 7,328,239 B1 2/2008 Berberian et a!. 6,705,869 B2 3/2004 Schwartz 7,330,890 B1 2/2008 Partovi et al. 6,714,519 B2 3/2004 Luzzatti et a!. 7,353,016 B2 4/2008 Roundtree et a!. 6,731,625 B1 5/2004 Eastep eta!. 7,392,193 B2 6/2008 Mault 6,754,181 B1 6/2004 Elliott et a!. 7,398,215 B2 7/2008 Mesbah eta!. 6,788,770 B1 9/2004 Cooket a!. 7,406,413 B2 7/2008 Geppert et al. 6,791,583 B2 9/2004 Tang eta!. 7,412,533 B1 8/2008 Johnson et al. 6,816,580 B2 1112004 Timmins 7,433,452 B2 10/2008 Taylor et al. 6,820,037 B2 1112004 Simon 7,440,898 B1 10/2008 Eberle eta!. 6,820,062 B1 1112004 Gupta eta!. 7,450,112 B2 1112008 Shneidman 6,826,194 B1 1112004 Vered eta!. 7,466,803 B2 12/2008 Burget al. 6,829,368 B2 12/2004 Meyer eta!. 7,492,883 B2 212009 Kumhyr 6,856,673 B1 2/2005 Banks eta!. 7,539,484 B2 5/2009 Roundtree 6,862,713 B1 3/2005 Kraft eta!. 7,546,143 B2 6/2009 Nelson eta!. 6,865,268 B1 3/2005 Matthews et a!. 7,584,249 B2 9/2009 Mununick et a!. 6,885,737 B1 4/2005 Gao eta!. 7,606,741 B2 10/2009 King eta!. 6,889,195 B2 5/2005 Strandberg 7,646,858 B2 112010 Salafia et a!. 6,920,205 B2 7/2005 Hahn eta!. 7,693,720 B2 4/2010 Kennewick et a!. 6,920,425 B1 7/2005 Willet al. 7,720,091 B2 5/2010 Faber eta!. 6,920,431 B2 7/2005 Showghi et a!. 7,729,490 B2 6/2010 Hemmetal. 6,937,705 B1 8/2005 Godfrey et a!. 7,757,173 B2 712010 Beaman 6,968,506 B2 1112005 Yacovone eta!. 7,809,376 B2 10/2010 Letourneau et a!. 6,990,455 B2 112006 Vozick 7,813,485 B2 10/2010 Yin et al. 7,020,609 B2 3/2006 Thrift eta!. 7,843,899 B2 1112010 Burritt 7,027,990 B2 4/2006 Sussman 7,864,944 B2 112011 Khouri eta!. 7,036,128 B1 4/2006 Julia et al. 7,908,381 B2 3/2011 Koch eta!. 7,039,589 B2 5/2006 Whitham 7,966,188 B2 6/2011 Ativanichayaphong et a!. 7,047,196 B2 5/2006 Calderone et a!. 7,996,251 B2 * 8/2011 Karman eta!. ............... 705/7.13 7,065,188 B1 6/2006 Mei eta!. 8,000,454 B1 8/2011 Or-Bach eta!. 7,068,643 B1 6/2006 Hammond 8,023,624 B2 9/2011 Kargman et a!. 7,092,738 B2 8/2006 Creamer et a!. 8,054,952 B1 1112011 Or-Bach eta!. 7,100,118 B1 8/2006 Klask 8,155,280 B1 4/2012 Or-Bach eta!. 7,130,391 B2 10/2006 J anakiraman et a!. 8,160,215 B2 4/2012 Or-Bach eta!. 7,136,480 B2 1112006 Mason 2002/0055844 A1 5/2002 L'Esperance et al. 7,139,591 B2 1112006 Callaghan et al. 2002/0147986 A1 10/2002 Michael et al. 7,145,902 B2 12/2006 Schindler eta!. 2003/0005126 A1 112003 Schwartz et a!. 7,146,321 B2 12/2006 Cyr et al. 2003/0007625 A1 112003 Pines et al. 7,149,549 B1 12/2006 Ortiz eta!. 2003/0033382 A1 2/2003 Bogolea eta!. 7,159,008 B1 112007 Wies eta!. 2003/0074198 A1 * 4/2003 Sussman .................... 704/270.1 7,177,814 B2 2/2007 Gong et al. 2003/0112931 A1 6/2003 Brown eta!. 7,180,889 B1 2/2007 Kung eta!. 2004/0034561 A1 2/2004 Smith 7,180,985 B2 2/2007 Colson eta!. 2004/0122941 A1 6/2004 Creamer et a!. 7,181,401 B2 2/2007 Johnson et a!. 2004/0198316 A1 10/2004 Johnson 7,181,502 B2 2/2007 Incertis 2004/0204116 A1 10/2004 Ben Efraim et a!. 7,188,352 B2 3/2007 Nathan eta!. 2005/0004977 A1 112005 Roberts et a!. 7,203,517 B2 4/2007 Shimoda et a!. 2005/0055310 A1 3/2005 Drewett et a!. 7,206,745 B2 4/2007 Surukkai et a!. 2006/0203977 A1 9/2006 Erhart et al. 7,206,809 B2 4/2007 Ludwig eta!. 2006/0239422 A1 10/2006 Rinaldo et a!. 7,209,124 B2 4/2007 Hunt eta!. 2006/0259424 A1 1112006 Turcotte et a!. 7,213,061 B1 5/2007 Hite eta! 2006/0262921 A1 1112006 Eppel eta!. 7,215,743 B2 5/2007 Creamer et a!. 2006/0285662 A1 12/2006 Yin et al. 7,216,348 B1 5/2007 deCarmo 2007/0026852 A1 2/2007 Logan eta!. 7,225,409 B1 5/2007 Schnarel et a!. 2007/0032247 A1 2/2007 Shaffer et a!. 7,225,455 B2 5/2007 Bennington et a!. 2007/0038513 A1 2/2007 Flax et al. 7,228,492 B1 6/2007 Graham 2007/0094109 A1 4/2007 Perry 7,231,636 B1 6/2007 Evans 2007/0123223 A1 5/2007 Letourneau et a!. 7,231,656 B1 6/2007 Nathan 2007/0239537 A1 10/2007 Protheroe et a!. 7,240,006 B1 7/2007 Brocious et a!. 2007/0243887 A1 10/2007 Bandhole eta!. 7,240,289 B2 7/2007 Naughton eta!. 2007/0298776 A1 12/2007 Arlene 7,246,063 B2 7/2007 James eta!. 2008/0055394 A1 * 3/2008 Shiue ......................... 348/14.01 7,248,885 B2 7/2007 Benco et al. 2008/0066015 A1 3/2008 Blankenhorn 7,250,939 B2 7/2007 Lira 2008/0095330 A1 4/2008 Jin eta!. 7,254,227 B2 8/2007 Mumicketal. 2008/0139223 A1 * 6/2008 Stone ......................... 455/456.3 7,265,861 B1 9/2007 Ranalli et a!. 2008/0226042 A1 9/2008 Singh 7,266,185 B2 9/2007 Trandaletal. 2008/0250334 A1 10/2008 Price 7,266,186 B1 9/2007 Henderson 7,266,499 B2 9/2007 Surace eta!. 2009/0041215 A1 212009 Schmitt et a!. 2009/0116414 A1 5/2009 Or et al. 7,272,222 B2 9/2007 Joseph eta!. 7,272,497 B2 9/2007 Koshiji et al. 2009/0136014 A1 5/2009 Bigue eta!. 2009/0154666 A1 * 7,277,854 B2 10/2007 Bennett et a!. 6/2009 Rios et al . .................. 379/88.18 7,280,097 B2 10/2007 Chen eta!. 2009/0202050 A1 8/2009 Berger et al. 7,280,646 B2 10/2007 Urban eta!. 2009/0207980 A1 8/2009 Berger et al. 7,280,651 B2 10/2007 Anderson 2009/0207996 A1 8/2009 Berger et al.

  2. US 8,681,951 B1 Page 4 (56) References Cited OTHER PUBLICATIONS U.S. PATENT DOCUMENTS Darnhuis, M., et a!., "A Multimodal Consumer Information Server with IVR Menu," 2nd IEEE Workshop on Interactive Voice Technol- 2009/0225788 Al 9/2009 Kephart et a!. ogy for Telecommunications Applications (IVTTA94): pp. 73-76, 2009/0228908 Al 9/2009 Margis eta!. Kyoto, Japan (Sep. 1994). 2009/0276441 Al 1112009 Malik Shah, S.AA., eta!., "Interactive Voice Response with Pattern Recog- 2009/0276708 Al 1112009 Smith eta!. nition Based on Artificial Neural Network Approach," International 2009/0280863 Al 1112009 Shin eta!. Conference on Emerging Technologies: pp. 249-252, (Nov. 2007). 2009/0285380 Al 1112009 Chen eta!. Trihandoyo, A., eta!., "A real-time speech recognition architecture 2010/0007028 AI 112010 Fachmann et a!. for a multi-channel interactive voice response system," International 2010/0021030 Al 112010 Collins eta!. Conference on Acoustics, Speech, and Signal Processing vol. 4: pp. 2010/0049654 AI 2/2010 Pilo eta!. 2010/0087175 Al 4/2010 Roundtree 2687-2690,(1995). 2010/0100377 Al 4/2010 Madhavapeddietal. Hattori, S., et al., "A multimedia intelligent message communication 2010/0166158 Al 7/2010 Costello et al. system for distributed coordination environments," Electronics & 2010/0172481 Al 7/2010 Canu eta!. Communications in Japan, Part !-Communications, vol. 76, No. 1, 2010/0189250 Al 7/2010 Williams et a!. pp. 11-23 ( 1993). 201110009096 AI 112011 Rotsztein et a!. Patent abstracts of Japan, vol. 097, No. 001, Jan. 31, 1997 & JP 08 201110014952 Al 112011 Minton 242307 A (Canon Inc), Sep. 17, 1996. 201110060683 AI 3/2011 Salmon Rock et a!. Kalva, H., et al., "Delivering Object-Based Audio-Visual Services," 201110091021 Al 4/2011 Adkar eta!. IEEE Transactions on Consumer Electronics, vol. 45, No. 4, pp. 201110099116 Al 4/2011 Gabel 1108-1111, (1999). 201110276408 Al 1112011 Toole Schmandt, "Phoneshell: the telephone as computer terminal," Pro- 2012/0063574 Al 3/2012 Or-Bach et al. ceedings offirstACM International Conference on Multimedia, Ana- heim, CA, US, pp. 373-381, (1993). FOREIGN PATENT DOCUMENTS Himberg, J., eta!., "Time Series Segmentation for Context Recogni- tion in Mobile Devices", IEEE, 203-210, (2001). EP 1351477 Al 10/2003 Chris Schmandt and Stephen Casner, "Phonetool: Integrating Tele- EP 1120954 A3 6/2005 phones and Workstations," IEEE Communication Society, Nov. EP 1545101 A3 12/2005 27-30, pp. 0970-0974, (1989). EP 774853 Bl 5/2006 Basinger, R. G., eta!., "Calling Card Service-Overall Description EP 1874018 Al 1/2008 and Operational Characteristics", The Bell System Technical Jour- JP 2004274425 A 9/2004 wo nal, (1982). 9819259 Al 5/1998 wo Cadiz et a!. "Designing and Deploying an Information Awareness 9840826 A3 12/1998 wo interface" CSCW'02, Nov. 2002, ACM, pp. 314-323. 9856158 A3 3/1999 wo Corcoran eta!. disclose "User interface technologies for home appli- 9848551 A3 4/1999 wo 0131497 Al 5/2001 ances and networks", IEEE Trans. Consumer Elect; pp. 679-685, wo 0157851 Al 8/2001 (1998). wo 0165871 Al 9/2001 Nancy Friedrich, "Graphical-User-Interface Module Eases Integra- wo 9820409 AS 1112001 tion," Wireless Systems Design, Oct. 2004, 1 page. wo 0217604 Al 212002 Balachandran, R., eta!., "Dialog System for Mixed Initiative One- wo 2004049306 Al 6/2004 Turn Address entry and Error Recovery," Proceedings of SIGDIAL wo 2004064299 A3 7/2005 2009, the lOth Annual Meeting of the Special Interest Group in wo 2007012831 AI 2/2007 wo Discourse and Dialogue, pp. 152-155, Queen Mary University of 2007081929 A3 1/2008 wo London, Association of Computational Logistics, (2009). 2008086320 Al 7/2008 wo 2009006173 A3 3/2009 wo * 2009100477 Al 8/2009 cited by examiner

  3. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 1 of 110 co c ...0 (.) co co co co 0 0 0 0 ..- ...- ...- ..- c c c c 0 0 0 0 :;:::; :;:::; :;:::; :;:::; co co co co •• • c c c c :;:::; :;:::; :;:::; :;:::; en en en en a> a> a> a> 0 0 0 0 z 1- ({) a... <.9 u.. .- a> a> -.:t c a> c 0 0 (.) 0 ,.- .c. ·-.c. a. >a. <D a> ::J en 0- ~ -- 5 co N 0 ..- '- <D co ()

  4. ~ ~ ~Ul ~ ~ ~ ~ ~ 00 • = 116 Network 108a Gateway Destination 112 ~ :-: N 108b N Destination .... 0 .j;o. Device (Computer+ VOIP) rFJ PSTN =- ('D 108c ..... Caller Visuphone ('D Destination N 104b J 0 ..... .... .... 106 • 0 102b • 110 • 108n d Destination rJl 00 0.., 00 FIG.18 """"' \c u. = """"' """"'

  5. ~ ~Ul ~ ~ ~ ~ ~ ~ 00 • = 116 Network Gateway 108a Destination 112 ~ :-: N 108b Device N .... Destination 0 (Smartphone) .j;o. Caller Visuphone rFJ PSTN =- 1047 ('D 108c ..... ('D 106 Destination (.H 102c 0 ..... .... .... • 0 • • Cellular Network f 108n 111 Destination d rJl 00 0.., 00 FIG.1C """"' \c u. = """"' """"'

  6. Destination Board v202a 108a j Press 3 Press 2 for Press 0 for Order 204a./ Pizza Order 206af main menu Status /\ 220al ;210a •, 212a Press 2 for Press 1 for Press 1 to talk to J Non-Veg j 208a Veg the Executive v218a I Press 1 for I Press 2 for 216a I I f Home Take I I 214a f I Delivery Away ' I ' I ' ' FIG. 2A

  7. B~ ~-)'- Device 108a ----------------------------------------------------------------: I I I Destination I I number 1 102b 206b Pizza Order Order Status PSTN 204b 2 3 110 210b I I 212b: Talk to Non-Veg Veg Executive 208b 1 2 116 1 Home Take 216b Delivery Away 214b 1 2 I 222b FIG. 28

  8. Device 108a Destination 202c Board number 1 102b 206c Pizza Order rder Statu PSTN 2 0 204c 3 110 Talk to .f 212c: Veg Executive : tJ'1 208c • 1 116 4Q Home Take 216c Delivery Away .f Q- 2 214c 1 if· /\ ___________ j( ___________________________________________________ , 222c FIG. 2C

  9. -~-· Device ---------------------------------------------------------------------, 102b Welcome to our Pizza place. Please press 1 to check your order status I or press 2 to make a new order 222: 206c 204c rder Statu t)1 226 Please press 1 for vegetarian order or press 2 for non-vegetarian pizza order 210c V 208c \. Veg Non-Veg 224 #1 ':t):2 I I I 222c FIG. 20

  10. ~ ~ ~ ~ 11 PST Device 0 N (Computer/Smartphone) )302 v312 Radio Display 326 Gateway f Interface .. t-y- _[__ 304 314 Central Processing Unit Network Network ' L ' Interface / 324 j 112 v316 102a j ) 306 v318 f---7 Memory Memory Card Visuphone Input/Output 320 a H I 104 I interface - Keyboard Visual Menu Database 320 b H Mouse 308 '-- H Other Applications 2 '-- 1;-32 USB 310 FIG. 3A

  11. ~ ~ ~Ul ~ ~ ~ ~ ~ ~ 00 -...f'Y' • 110 PST Device N (ComputerfSmartphone) ~ = ) 312 !302 Radio Gateway ) 324 Display ' / ' / Interface -h- f ~ :-: 324 ) 314 Central Processing Unit N / - 304 Network N ,. Network ' , / .... ' 0 Interface .j;o. Memory 112 ) 316 ./ rFJ 102a VOIP Application ) 318 =- - f-0 Memory ('D 340 ..... ('D Card \0 0 320 ..... .... Visuphone Input/Output H .... ' I L_ I 104 / ' interface Keyboard 0 ( 322 - H USB Visual Menu Database 308 306 .-' '-- H Mouse Other Applications I 310 4t FIG. 38

  12. -~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 10 of 110 0 N C"0 ------------------------------------------------- ---------- ---------- ' ' ' ! []][]] co ' N ' ' 0 0 ' ' ""'" ""'" GG BEJI 0 (j) aJ 1"- GGl 1 co I.!) 1 GG! ""'" I C"0 N '' ' '' ' '' ' '' ' .lBGl ' ' ' ' lGGl ' ' ' ' ' ' ' ' .......................................................................................................................................................................................................................... • ....................................................... ..! (..) N 0 .,....

  13. ~ ~ v51~ ~Ga~wayB (" 110 116 Display 512 j 112 II\ I Device • '_!526 (Computer) 102b v ![ ;514 Display Interface ..... Network 502; --"' Interface 518 H Mouse Central Processing Unit L_ 1'- 504} 520 r-- H Memory Keyboard Input/ Output 522 --"' r-- 4 Speaker Visuphone interface 104 I I v524 Visual Menu Database L ' Camera " "" 308 506} 5 23 Other Applications d Microphone V '-- ~ rJl 510 00 0.., 00 """"' \c u. FIG. 5 = """"' """"'

  14. ,~-~-~-~-~- r:r:~ ~ ~ ~ ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 12 of 110 ,....--.. 0 !G G G G [I] (j) : CX) : 1'- : ~ !BGGG I J l N i ~ !G G B EJ []] \ L_-------------------------------------------T--------------- \ \ 0 N 0 <0 <0 (!) (J > (!) 0 >. .0 N 0 <0 0~ O....cu ...... a.. u E ::J 0 "'Ou 0 '-N Q..>- ~x z " .0 C\1 0

  15. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 13 of 110 ....... (.) 1'-- CD ..... CD c CD CD Q) c <.9 (.) (f) ctl ·s: 0 a. $ () .0 LL CD 0 ..... CD s 0 0) " c.o 0 I'-- ~ 0 I'-- " N 0 I'-- .0 N 0 ..-

  16. ~8 ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 14 of 110 «::t CD N CX) 0 0 0 0 CX) CX) CX) CX) " " " "" (f) c 0 :.;::::; ro -~ a. 0. <( .... Q) ..c ........ 0 E ..... Q) (f) .... Q) CX) >. .... (f) ro (f) Q) <.9 0) > -o .... c ·c :.;::::; ro u.. 0 ro .... I Q) 0. 0 Q) c 0 ..c 0. :::J (f) > " CX) «::t 0 ...-

  17. ~ ~ ~ ~ ~ ~ ~ ~Ul 00 • VisuPhone r902 ~ = Detection Module I r904 Search Module I :-: r906 N Display Module I N .... 0 r908 .j;o. Connection Module I rFJ 104 =- r910 ('D ..... ('D .... Voice Module I Ul 0 ..... .... r912 .... 0 Advertisement Module I r914 Update Module I d r916 rJl 00 Customization Module 0.., I 00 """"' \c FIG. 9 u. = """"' """"'

  18. ~ ~Ul ~ :-: Remote Server 1002 N •• Destination N Destination .... 0 .j;o. Device 108a rFJ =- 1006 ('D Computer ..... ('D .... Visual Menu Network Database 0\ 0 ..... 308 .... .... 0 102 1008 \__ PSTN Gateway d rJl 00 0.., 1010 00 """"' \c u. FIG. 10 = """"' """"'

  19. ~· ~ ~ ~ ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 17 of 110 co .0 co co 0 0 ....- ....- qgo ~ ol pJeMJo.::l ·G c c 0 0 "¢ :;::; :;::; co co c c 0 ....- :;::; :;::; ....- (J) (J) CD CD 0 0 t .§ co co ....... 0 ....- -;£J ·'SQ g-..;;:. 0 ....... T""" ..... T""" u ((j p CD <.9 N c c 0 vJ> ....- LL 0 ....- 0 <.0 '?" ..g ....- 0 ....- () ....- § ""' (j CD c 0 "¢1 "5_o ::::1...-- (J) > N 0 ....-

  20. ~ ~ ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 18 of 110 N ..... N ..... CD 0 N E Q) "'0 0 (9 LL >. co ..X: ,__ z 0 f- Q) ....... (f) co Q) 0... 0 z C) N N ..,... c:o ..- N ..-

  21. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 19 of 110 <.0 0 C") .......

  22. ~ ~ f? .. . Add-On ~(; 1 .. j\.,.l 1410 1402 1404 FIG. 14A 1414 Add-onD 1420 1412 FIG. 148 1430 Add-On 1424 FIG. 14C

  23. ~ Zig Bee Add-On 1410 1438 1402 1404 Gateway 1436 FIG. 140 1414 1420 1422 1440 J > FIG. 14E

  24. ~-«-~JC-1-42_2~> 1414 Add-anD ,; 1420 1440 FIG. 14F 1414 Add-on D ,; 1420 WiMAX > FIG. 14G

  25. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 23 of 110 ( __ s--;-tart __ ) Detect phone number of a destination dialed from a device 1504 Search for IVR information in visual menu database on the device Yes in visual menu database? 1518 1522 Update the visual menu database from remote repository 1508 Display the visual menu and associated information 1510 Detect input from caller on the visual menu FIG. 15A

  26. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 24 of 110 1512 Connect to the destination based on inputs from the caller 1516 \_.----------X.--------, Maintain the connection till caller or destination disconnects Stop FIG. 158

  27. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 25 of 110 Any menu selection detected on the device? 1526 Provide the dialed number as a destination to remote repository 1528 Update the remote repository Stop FIG. 15C

  28. ~ f 1620a Device Destination Memory 1620b Database Construction Destination System 1606 • 1604 • 1620n Records Database 1608 Destination 1616 Processor 1610 Network Interface 1612;- L_ __________________ 1602 FIG. 16

  29. ~ ~ ~ ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 27 of 110 co 0 0 C'\1 0 ,...... ,...... T"" ,...... T"" T"" T"" " " " E Cl) ...... ....... (/) c >. Cl) (j) Cl) 0> <( c <( ::I !Q 0 c I'- '"0 :;::; 0 ::I 0 (.) . :;::; '"0 ::I (.) 0 c ....... !.. ::I <.9 (/) 0 ....... !.. c :;::; (/) '"0 ro LL 0 c ro (,) .t:! 0 0 (,) ro c Cl) s: c (/) Cl) ro 0 0 (/) ..0 ro 0 ro ...... ..0 Cl) ro ro ...... 0... 0 ro 0

  30. ~ ~ '-~ L~ ~ Database Construction Agent 1722 Targets List Module ,., ' I ;;o I CD "0 0 IVR Tracking Module (/) ;::;: 0 ..... 1726 IVR Logic Module '< I () 0 Records :J 1720 ~ L ' 1728 :J / Database Tree storage Module (!) / ' () ....... ( 6" 1730 :J :s:: Dialog Module ' ...._ / 1608 0 a. c 1732 "'\._ Speech Recognition CD Module 1734 ~ Response Module I 1738 1736 VOIP Connection Module I ~1724 ' ' \II ' ' ' ' v 1740 ' ' VOIP Application ' ' ' .... Destination ' , ' ' ' ' ' ' ' ' ' FIG. 178

  31. ~ ~ ~ ~ ~ Database Construction Agent , __ 1722 Targets List Module r ' :::0 I (1) '"0 0 IVR Tracking Module C/) ;:;: 0 .... 1726 IVR Logic Module '< I 0 0 Records 1720 :::l L_ 1728 :::l ' / Database Tree storage Module (1) - / ' ' / (") ! 5' 1730 :::l __., Dialog Module :5:: -.... 1608 0 0. c 1732 \__ Speech Recognition (1) Module 1734 ~ Response Module I 1738 1737 IVR Connection Module I "'\ 1724 ! l! Destination FIG. 17C

  32. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 30 of 110 Start I Dial, a phone number of a destination, by a 1802a ""\... computer system \I 1804a "\.... Record voice options of a voice menu of the dialed destination \ 1806a ""\_ Analyze the voice menu I 1808a "'\... Enter multiple entries of the voice menu into a database \I 1810a \._ Generate a visual menu for different entries of the voice menu \I Repeat the process for all entries at each level 1812a ""\... of the voice menu \ Stop FIG. 18A

  33. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 31 of 110 Start 1802b \_ Connect to a destination Analyze a first level of the audible IVR 1804b menu 1806b Store the information regarding the audible IVR menu in a database No 1810b \-. Analyze the sub-menus 1812b Store the information regarding the sub-menus in the database Yes Stop FIG. 188

  34. ~ ~ Category A r---7 Dial Tone Selection / 1904 Category B Starting Questions .... and 1906 Dial Tone Selection IVR - Categories Category C Personal Information \ .... ,.. and 1908 Dial Tone Selection 1902 Dial Tone Selection Category D and/or y / Natural Language Selection 1910 FIG. 19

  35. ~ R_e_c_o_rd_D_a_t_a-.-ba_s_e_c_o_n_t_e_nt_~] ~ ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 33 of 110 __ 2002 _;{~ 'W Please enter invoice number 2004a J Please enter the payment amount 2006a J Please choose your payment card: 2008a __/ Press 1 for VISA or 2 for MasterCard Please say or enter your 2010a __/ Credit Card number \'I Please enter your Credit Card 2012a _f expiry date FIG.20A

  36. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 34 of 110 Payment Form for ABC 2014 r------------------------------------------------- 1 I : Please enter invoice number: : I I I 2004b ;: : : '------------------------------------------------ ,------------------------------------------------ : Please enter the payment amount I 2006b .1! I '------------------------------------------------ ~-~ I I i Please choose your payment card: i 2008b J1 ~ VISA 0 MasterCard : L------------------------------------------------J ,------------------------------------------------- 1 I Please enter your Credit Card number : I I I I 2010b /! : ________________________________________________ J ;: I 2012b I I I l ________________________________________________ J 2016 FIG.20B

  37. ~ ~ ~Ul ~ ~ ~ ~ ~ ~ 00 • Device 2102c 2102a = _f Destination Destination Property 1 Property 1 Property 2 Property 2 :-: Property 3 Property 3 • • N • • N Property n Property n .... 0 .j;o. • _f 102 • rFJ =- • ('D ..... ('D 2102b _f (.H Ul 0 ..... Destination .... _r2102n .... Property 1 0 Property 1 Property 2 Property 2 Property 3 • Property 3 • • • Property n d Property n rJl 00 0.., 00 """"' \c u. FIG. 21 = """"' """"'

  38. ~M ,:~ ~-j(- Device ---------------------, ------------------------------------------ : : : : Board : I I I number I 1 2208 Pizza Order Order status 2 2206 • 3 2212 102a Talk to Veg Executive "\... 2214 !J1 :2210 I I ' 1 Home Take \___ 2218 i ) Delivery Away Q 12216 1 2 2202 FIG.22

  39. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 37 of 110 Start \It 2302a\.. Identify phone number of a destination dialed from a device \I 2304a \.. Determine a location code associated with current location of the device \I Compare the dialed phone number with one or more 2306a\... destination phone numbers stored in a database Display at least one property associated with one or more 2308a \.. destination phone numbers based on the comparison \/ Stop FIG. 23A

  40. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 38 of 110 2302b Identify phone number of a destination dialed from a device 2304b Determine a location code associated with current location of the device Determine a business category associated with dialed 2306b'-- phone number Search for destination phone numbers matching the 2308b business category of the dialed phone number stored on a database Are one or more destination phone numbers available? Yes Search for at least one destination phone number from the 2312b destination phone numbers based on location code FIG. 238

  41. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 39 of 110 2328b 2330b'- Receive updates from the server Store updates in the database 2332b on the device FIG. 23C

  42. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 40 of 110 2314b Is at least one No 2326b Display a visual IVR menu of the dialed destination phone number Display the at least one destination 2316b phone number and associated properties 2318b Select a destination phone number , Display a visual IVR menu of the 232Gb selected destination 2322 Select an option from the visual IVR menu 2324b Connect to the selected option of the destination Stop FIG. 230

  43. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 41 of 110 Start 2402 Identify a number of destination dialed by a caller of the device 2404 Search for an advertisement associated with the number in a database 2406 Display the advertisement on the device 2408 Is a selection of No advertisement by the caller detected? 2410 Yes Dial a telephone number corresponding to the advertisement (_sto_p ) FIG. 24

  44. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 42 of 110 ..... c ,.... "'0 ..... (I) 0 c 0 3: 0 c u f/) 0> f/) co (I) 0 a.. ,.... f/) co <( ,.... (I) --------- ..c l{) (I) +""' co c C'\1 +""' c +""' co (I) <.9 (I) 0 (I) (I) f/) LL co "'0 ,.... f/) co (I) 0 (I) (.) 0.. (I) 0.. 0::: T N Cil Cil 0 o:::t <D 1..() 0 0 N 1..() 1..() N N

  45. -~- -~- ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 43 of 110 0 ..- I.() N - - 0 >. ........ :.;::::; >< c ...... "'0 '"-- ()) 0 a:l E s 1.. "'0 l.() J2 .0 en c N :J en E (/) co 0) <.9 0 1.. Q.. 0 LL ( u. '"-- '"-- ()) ()) ...... ........ c c c co ()) C) ()) 0 0 ()) 1.() ()) en N ..J CJ) co co ()) ()) a.. a.. .0 .0 ..q- <0 0 0 1.() 1.() N N

  46. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 44 of 110 Start 2602a Dial, at a device, a phone number of a destination \ Compare, the dialed phone number with one or more 2604a\.. phone numbers of destinations stored in the device \I Display, at the device, a form including one or more data request fields based on the comparison \ Stop FIG. 26A

  47. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 45 of 110 Start \ 2602b Dial a phone number of a destination \ il Display a visual IVR menu corresponding to the dialed 2604b \__ number on caller device il 2606b Select an option from the displayed visual IVR menu \I Display a form indicating the information required by the 2608b \.._ IVR of the destination \ 2610b \.._ Fill the information in the displayed form \V 2612b \.._ Establish a connection between the destination and the caller device \I Stop FIG. 268

  48. ~ ~ -~ Device 2704 I Board number 1 2708 Pizza Order rder Statu e 3 2 v-2702 270 2714 102 Talk to Executive 271 ' 1 .£2720 Home Take Away 1 2718 Scheduling ? 271ef Delivery 2 Mode .J Q : 1 : 2700 ______________________________________________________________________________ _ FIG.27

  49. -~ Device 2804 Board number 1 2806 2808 NRI Banking I I 3 lf2802 2826 Accounts Money Investment Deposits 2810 2 2 1 Transfer 1 102 2824 2812 Saving A/C CreditA/C Talk to 1 2 Executive 9 2828 2720 Check Talk to Report lost Scheduling Balance 1 executive 2 card 1 Mode 2818 2820 2822 ------------------------------------------------------------------------------ I FIG.28

  50. Device r 2904 Q Q March 2011 Mon Tue Thu Wed Fri Sat Sun 2 3 4 1 10 7 8 9 11 5 6 .f 2902 13 14 16 17 12 15 18 25 22 21 23 24 19 20 102 31 28 29 26 27 30 r 2906 Time ss v HH V AM V MM {!. / 2900 FIG.29

  51. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 49 of 110 Start 3002a ""'- Dial, from a device, a phone number of a destination based on predefined calling information 3004a ""'- Receiving information from the dialed destination based on the predefined calling information 3006a Display the received information at the device \It Stop FIG. 30A

  52. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 50 of 110 Start 3002b Dial a phone number of a destination from a device Display a scheduling mode option and a visual Interactive 3004b Voice Response (IVR) menu associated with the dialed destination 3006b Switch the device to a scheduling mode 3008b Save a selection information including one or more options of the visual IVR menu 3010b Save a call schedule including a date and time information 3012b schedule's date and time " 3014b FIG. 308

  53. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 51 of 110 A I; 3016b Dial the phone number of the destination \II 3018b Request information from the destination based \.. on the selection information \II 3020b Receive the information at the device \V 3022b Save the received information at the device \V 3024b Display the received information at the device \V Stop FIG. 30C

  54. ~0 U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 52 of 110 ro 00 0 ..- ('f) z 1- (/) 0.. -- ro N 0 (]) ....- c 0 (]) ....- C'0 c (]) 0 (.)..c ro C'0 0 ..c ·- 0.. > (]) ""'" Q. 0 ....- (])_ ::J o:o (/) C'0 5 0 ~ _. <.0 0 ..- .... ('f) (]) ro 0

  55. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 53 of 110 c 0 :;:; m (..) .0 co c Q) 0 ::::J ...- c Q) E (..) 0 ("') E"> .c a. 0 Q) oo ::::J .0 (/) 5 -.:t "0 c 0 ...- 0 ("') (..) Q) (/) z 1- (/) 0.. 0 ...- ...- ("') - m C'\1 0 Q) '0 ...- c 0 ...- ("') Q) 0 m (..).c ("') -.:t ·- 0.. > Q) 0 ...- Q)_ o:o ("') ~ -- 0 <.0 0 ...- .... ("') Q) m 0

  56. 3114 Network Gateway 3108b 3102b 3106 Second Communication Device Device (Computer+ VOIP) PSTN Caller Visuphone Visuphone 3104b 7 3104a 7 3110 J 3100 FIG. 31C

  57. ~ ~Ul f 3114 Network Gateway 3108b ~ :-: N Second Communication N Device .... 0 Device (Smartphone) .j;o. Caller Visuphone Visuphone rFJ =- PSTN 3104b.! ('D ..... ('D 3104aj 3106) Ul Ul 0 ..... .... .... 0 3110 Cellular Network \ 3100 FIG. 31 D

  58. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 56 of 110 ---, I I N 0 N (")

  59. Packet Version Traffic Class Flow Label 3302 3304 3306 Next Header Hop Limit Payload Length 3310 3312 3308 Source Address 3314 Destination Address 3316 ; 3202a FIG.33

  60. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 58 of 110 Start \It Send, by a first communication device, a first 3402a'-- section of a data packet to a second communication device \ Receive, at the first communication device, an 3404a '-- acknowledgement message from the second communication device Send, by the first communication device, a second 3406a\.. section of the data packet to the second communication device \ Stop FIG. 34A

  61. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 59 of 110 Start \! Dial, by a device, a phone number of a second 3402b\._ communication device \I 3404b Detect a data network at the device Send a first section of a data packet to the second 3406b\.. communication device when the data network is detected \I Stop FIG. 348

  62. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 60 of 110 Start 3402c Search, at a first communication device, for a data network a first section of a packet to the second communication device as Dual-Tone Multi- frequency signals 3408c Send a first section of the packet comprising first information to the second communication device 3410c Is Visuphone available at second communication device? FIG. 34C

  63. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 61 of 110 Receive an acknowledgement message based 3412c on the first section from the second communication device Send a second section of the packet comprising 3414c second information based on the acknowledgement message to the second communication device Stop FIG. 340

  64. ~ ~Ul 3508a \ First party device 3508b ~ :-: First party N 3502a device N .... 0 3506 Device .j;o. (Mobile Phone) 3508c PSTN Caller rFJ =- First party Visuphone ('D ('D ...... device 3504 7 0\ N • 0 ..... .... .... • 3510 _! 0 • 3508n First party / device 3500 FIG. 35A

  65. ~ ~Ul 3512 3508a f 3514 Network Gateway rE------41 First party device 3508b ~ :-: \ N First party 3502b N .... 0 device \ .j;o. 3506 Device {Computer+VOIP) 3508c PSTN rFJ =- Caller ('D ..... First party ('D Visuphone device 0\ (.H 3504_) 0 ..... .... • .... • 0 • 3508n First party ! device 3500 FIG. 358

  66. ~ ~ ~ ~Ul ~ ~ ~ ~ 00 • 3512 3508a \ = Network Gateway First party device 3508b ~ :-: N First party N device .... 0 3506 .j;o. Device (Smartphone) 3508c PSTN rFJ =- Caller ('D First party ..... ('D Visuphone device 0\ .j;o. 3504J 0 ..... .... • .... • 0 3508n • Cellular First party Network ! d device rJl 00 3500 0.., 00 """"' \c u. FIG. 35C = """"' """"'

  67. 3508a 3602 \ First party Third party device device 3508b First party 3502a device 3506 Device 3508c (Mobile Phone) PSTN Caller First party Visuphone device 35047 • • 3508n • First party ! device 3500 FIG. 36

  68. Device ---------------------------------------------------------------------------------, 3704 Board number 1 3708 ;3720a Communication rder Statu Option 8 3 v31o2 ;3720b 3714 Communication 3712 3502 Option Talk to Veg • Executive #1 3710 • ' 1 • f 3720n Communication Option Home Take Away f 3718 3716 / Delivery t 2 Q1 /j I I L-------------------------------------------------------------------------------- FIG. 37

  69. -~i~-~-~- ._-:>'~ f 3804 Board number 1 3806 3808 ;3720a NRI Banking Communication 3 Option 3826 ) 3720b Investment Accounts Money Deposits Communication 2 Transfer 1 2 381 0 1 _, Option 3812 3824 • Saving A/C Credit A/C Talk to 1 2 • Executive 9 3828 • ) 3720n Communication Talk to Report lost Option Balance 1 executive 2 card 1 3818 3820 3822 --------------------------------------------------------------------------------------------- FIG. 38

  70. ~0 ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 68 of 110 ..... 0 (j) ("') E Q) -o 0 C.9 LL co CX) 0 L() ("') >. t::: ..::.::: Q) ..... co u z 0 0.. ·- > ...... Q) Q) u:: z 0 ..- L() ("')

  71. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 69 of 110 Start 4002 \... Receive, at a device, a call from a phone number of a first party device Compare the phone number of the first party 4004 \.. device with the phone numbers stored in the device 4006 Display the visual IVR menu 4008 Display one or more communication options 4010 Enable a user to select a communication option \I 4012 \.__ Establish a communication session based on the selection \1 Stop FIG. 40

  72. U.S. Patent US 8,681,951 B1 Mar. 25, 2014 Sheet 70 of 110 co co co co ()) e • e E ~ E u E ~ E ~ w·- w·- w·- w·- ...... > ...... > ...... > ...... > >< ()) >< ()) >< ()) >< ()) wo wo wo wo ()) ..0 co t: 0 a..

  73. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 71 of 110 ... ... .. , . . , .. .. ,.: .. ••• . .. , , . , II., • •:•' -.::1" 0 N -.::1" N 0 N -.::1"

  74. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 72 of 110 /' \I a. 0 ...... a. (1J ...J

  75. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 73 of 110 o:

  76. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 74 of 110 \ N 0 LO -.;:j"

  77. ~ ~ ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 75 of 110 o: I\ \I r <D E u.. ...... ::I (.) a:

  78. D~\ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 76 of 110 II' \I c 0 <D ,_ <D (..) 0 (/) (j) 0.. (9 0

  79. ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 77 of 110 o: I >. co 0.. (f) i5 \V .... 0 ........ (.) Q) ·o .... n.. \

  80. ~ 1-~ ~ ~ ~ ~E.- ·-~-· ~0 ~0 ~ ~ ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 78 of 110 co ~ 0 0') \ ..0 ~ 0 0') I (/) ...... ::::l - ....... Q) co ...... 0 .:::: .::£8..- (/)(") .... / CD "E w c 0 Q) .... Q) .... u "0 CD ._..a (/) >. co 0') N CD ::::l c 0 0.. 0') .!:2 ~ eN .... "0 0 z CD Q) "E .... 0) co ON ....J co N N a: 0') <D..- > I I

  81. ~ ~ ~ ~ ~ ~ ~ ~ 00 • Portable Device 5012 5002 ~ = Radio PSTN Display Interface :-: Processor N Ul Connection Manager N 5008 .... 0 .j;o. 5004 4102 rFJ =- Network ('D ..... ('D Interface 5006 -....l \0 0 ..... .... Memory .... 5018 0 Operating System 1010 FIG. 50

  82. Portable Device 5002 Radio Display Interface Processor Connection Manager 5008 5004 4102 Network Interface 5106 Memory Operating System 5010 FIG. 51

  83. ~g ~ U.S. Patent US 8,681,951 B1 Mar. 25, 2014 Sheet 81 of 110 c cu .0 (.) <0 <0 <0 <0 0 0 0 0 N N N C\1 1.() 1.() 1.() 1.() cu cu cu ••• cu <]) <]) <]) <]) E u E u E u E u <])"- <])"- <])"- <])"- ....... > ....... > ....... > ....... > X <D X <D X <]) X <]) UJO UJO UJO UJO N l.() <]) (.) (.9 ·;;: <]) LL 0 <]) .0 cu N t: 0 0 N Q.. 1.() N 1.() <]) ...... """ <]) > 0 N (/) <]) 1.() ::JO

  84. '-~ ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 82 of 110 ro u c ..0 CD CD CD CD 0 0 0 0 N N N N l.{) l.{) l.{) l.{) ro <ll ro <ll ro <ll ro <ll c u c u c u c u .... ·- .... ·- ,_ ·- .... ·- tijo ••• <ll > <ll > <ll > <ll > ........ <1) ...... <1) ....... <1) ...... <1) ><o ><o ><o LU LU LU C'0 L{) <ll N u (9 0 ·:; <ll N c <ll LL l.{) 0 0 001 .r::o <ll O..N ..0 :::ll.{) ro (/) t 5 0 0.. -.::t 0 ,_ ..::t:. N 0 <ll·- l.{) (/) > =>c3 <ll z

  85. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 83 of 110 ••• iitiliilli ••• ••• ••• ••• ••• ••• N 0 N """

  86. ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 84 of 110 ('\J 0 0) 0) ('\J L!) ..0 (.) ro ·- t oo 0.. >- ro 1.() 0.. (/) 1.() 0 (!) LL 1..... 0 t5 ·e- Q) o.. ('\J 0 l.{) l.{)

  87. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 85 of 110 CD CD .0 (.) co ·- t:: iD oo a.. (0 L!) <.9 LL

  88. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 86 of 110 Q) Q) .0 (_) ro ·- ...... > .... Q) oo 0.. N 0 -.::::t L()

  89. ~ ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 87 of 110 DDODD Q)Q) .0 (.) co ·- ( ' D D D D a:o t:: ~ r-- DODD') N 0 -.:t N I 0 N co I.() (.9 u.. a. ..... 0 a. co ...J

  90. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 88 of 110 Q) Q) .0 () cu ·- t: a; oo (l_ N 0 0) N l() l() (j) 1.() <.9 LL. Q) E cu .... Ll. .... Q) ...... ::J () 0:

  91. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 89 of 110 ooooo (!) (!) ..0 (..) ro ·- ........ > / ' 0 0 0 0 0 0 0 0 \_ / .... (!) oo r--- a.. "\ N 0 N """ II\ I.!) 0 N I.!) 0 <.0 (9 LL \I c 0 (!) .... (!) (..) 0 en U) a.. (.9 0

  92. ·-~-· ~ ~ ~: ~N ~ ~ ~E.- U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 90 of 110 (\1 """ 0 ....... CD '"' N 0 (!) N ..0 Q I!) ro ·- ' --.. iD \...., t CD oo 0 ..... 0.. <0 1\ ..0 """ 0 ..- CD I I I I f/) ::J ....... co ....... (/)"" .... / (!) c "E (!) (!) 0 ..... Q ,_ (/) >. ""0 (!) ro '-..0 0. rn co f/) ::::l N c 0 0 ..... .... (!) CD ,_ rn 0 (!) z " ro "E ...J ON ro N N a:: rn (!)...- > 1---------------------------------------------

  93. ~ ~ g~ "'-~ ~ ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 91 of 110 N ..-- .::t:. .... N 0 <.0 $: +-' (]) z 1\ \ ,::t:.(]) .... u o ro $:'t: +-'(]) (])....., z.s N <.0 - N - <.0 " l <.9 (]) u .;t ·::; ..-- LL (]) N 0 <.0 (]) .0 .... ro t:::: (]) 0> 0 E ro a.. (]) c ...... .... ro (/) >. 0 U) rol (/) 0 co <.01 .;t (/) 0)0 E 0 (]) u eN N (]) :;::::;<.0 u .... 0 <.0 '\ (]) a.. " c (]) c N 0.. 0 0 0 N () <.0 " N 0 N 1.!)

  94. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 92 of 110 Start 6302 Search, at a portable device, for an external device No 6306 Connect to the detected external device 6308 Display contents of display of the portable device on a screen of the external device Stop FIG. 63

  95. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 93 of 110 Start 6402 Search, at a portable device, for a user device No 6406 Establish a connection between the portable device and the detected user device 6408 Search, at the portable device, for an external device No FIG. 64A

  96. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 94 of 110 A \V 6412 \.. Establish a connection between the portable device and the detected external device / 6414 \.. Display contents of display of the user device on a screen of the external device 'It Stop FIG. 648

  97. ~ U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 95 of 110 Q) Q) ..0 {.) ro ·- N t Q. 0 oo .9 N 0.... Q. L!) ro ....J L() (0 (9 LL

  98. U.S. Patent US 8,681,951 B1 Mar.25,2014 Sheet 96 of 110 0.. .8 0.. co ....I <.0 <.0 (.9 LL

Recommend


More recommend