Speech Technology in Mobile Phones Part II : Voice based - PowerPoint PPT Presentation

Speech Technology in Mobile Phones Part II : Voice based Agriculture Information Systems Rajesh M. Hegde rhegde@iitk.ac.in Associate Professor Dept. of EE Indian Institute of Technology Kanpur Several pictures used in this presentation have been collected from various sources available on the web and have been acknowledged in the slides.

Topics Covered • A personalized voice based service on mobile phones in several Indian Languages : Digital Mandi for the Indian Kisan • A Hindi speech recognition based system on the mobile phone for accessing agro- commodity prices for the Farmer.

Value Added Services (VAS) in the Agriculture Sector in India • Computing is becoming human centered, and multi modal PSTN • Information is available in Web/Database Server various sources and various forms • Personalized or Service based Asterisk Server Information delivery systems are order of the day Network • Important in Indian Context with SMS Gateway huge population and cheap access to cell phone services • Agricultural Information systems assume great significance

Multi modal Personalized VAS The use of Images, Video, Text, Audio, Voice and Natural dialogue will help use seemingly sophisticated technology in simple and efficient ways to provide information to the Indian Kisan

Cell Phone based Agriculture Information Systems Digital Mandi for the Indian Kisan Source : Digital Mandi for the Indian Kisan

Architecture Digital Mandi for the Indian •Supports Multi modal Query and Retrieval Kisan

Digital Mandi : Stake Holders

Digital Mandi for the Indian Kisan • Cell phone based service for the Indian farmer. • Provides easy access to the prices of desired crops in the mandis in which a farmer is interested. • The service can run on low-end, GPRS enabled cell phones. • Can be accessed in more than one way, the simplest being a one time registration process. • The one time registration can be done directly from the phone.

Digital Mandi for the Indian Kisan • A farmer can choose to listen or/and read the price. Both will be delivered in his/her native language. • A farmer can also choose the frequency with which the prices be delivered to his/her phone. • The registration process is made simpler by using features like auto-state detection. • The service can be accessed even without registration. • 15000 Farmers in Haryana and 23000 Farmers in Odisha currently using the System.

FARMER REGISTRATION AT APMC / VIA MOBILE PHONE SMS and Voice calls Access via directly placed to GPRS PHONE The Farmers Mobile Phone System Deployment •For both Savvy And the Common Farmer Overview

REGISTRATION - HINDI

FARMER PROFILE

Version for GPRS MODE •Fusion of multi modal methods with Farmer Registration Profile in Hindi Users Hindi Version

GPRS MODE Version for •Fusion of multi modal methods with Farmer Registration Profile in English Users English Version

SMS/Voice Call Mode Sample SMS and Voice Call in Hindi

SMS/Voice Sample SMS and Voice Call in Odiya Call Mode

Live Demo of Digital Mandi GPRS version • Switch to Cell phone Screen at this point Available at http://digitalmandi.iitk.ac.in

Speech Recognition Based Access of Agrocommodity Prices in Hindi for Uttar Pradesh Sponsored by DieTY Govt. Of India

Speech Based Access of Agrocommodity Prices in Hindi Sponsored by TDIL, DieTY Govt. Of India Getting data from agmarknet.nic.in Web Server Agmarknet (PC Debian GNU/Linux) Make a call and Get Mandi Price and follow instructions Store Call information Asterisk PBX Database Server (PC Debian GNU/Linux) (PC Debian GNU/Linux) Get PNR Status via SMS and Voice Call SMS Gateway

System Call Flow 1. Dial the tel no. +512-391-5353. Welcome message will play. 2. Prompt for district name. 3. Speak district name from the list. 4. Prompt for haan ya nahin. 5. Speak haan if recognized or nahin if failed. In case you say nahin you will be asked to repeat the district name. If you say haan, then you will be asked to speak the commodity name. 6. Prompt for commodity name. 7. Speak commodity name from the list. 8. Speak haan if recognized or nahin if failed. In case you say nahin you will be asked to repeat the commodity name. 9. If you say haan, then the price of commodity will be played out. 10. Prompt for repeat the process. If you want to try the system again say haan else say nahin. 11. If you say haan you can try the overall system again. 12. If you say nahin the system will hangup after thank you prompt.

Live Demo • Switch to Cell Phone Screen Now • Dial +91-512-391-5353/ +91-512-671-1453

Questions rhegde@iitk.ac.in URL : http://202.3.77.107/mips/ ?