A General Architecture for Self-Adaptive AmI Components Applied in - PowerPoint PPT Presentation

AG Softwarearchitecture Softwarearchitecture AG A General Architecture for Self-Adaptive AmI Components Applied in Speech Recognition Holger Klus ICSE 21.05.2006 21.05.2006 AG Softwarearchitektur 1

Outline Outline • Outline – Application Scenario – Our three types of adaptation – Integration of speech recognition into our AmI- scenario as one type of adaptation – Outlook 21.05.2006 AG Softwarearchitektur 2

Motivation Example Example – – Assisted Assisted Motivation Training (1) Training (1) • Training group of (racing) cyclists • Given track profile Track Section Uphill Even Downhill • Cyclists have different qualities regarding the track sections • Each cyclist has a given overall physical condition and an individual training plan • Training effect depends on the speed of the group and the position of the cyclist within the group formation Main goal of the system •Optimization of the single training effect •Optimization of the group training effect 21.05.2006 AG Softwarearchitektur 3

Motivation Example Example – – Assisted Assisted Motivation Training (2) Training (2) Bluetooth / WLAN GPS AmI PDA GSM pulse sensor trainer wind sensor MICA Nodes Internet-based training database pedal power sensor 21.05.2006 AG Softwarearchitektur 4

Motivation Example Example – – Assisted Assisted Motivation Training (3) Training (3) (Currently) explored adaptation variants • Service Implementation Adaptation Self-adaptation of speech recognition service • Service Usage Adaptation show pulse and warning (text) Change from a visual UI to a speech generation UI service implementation • Service Configuration Adaptation New component containing new services plugs Headphone LCD Display into the training system and results in a Mobile Phone Display reconfiguration of the overall system from single bicycle to group bicycle training Pulse group training Group monitor pulse Control set limits Control Application Application Pulse Sensor get current pulse 21.05.2006 AG Softwarearchitektur 5

Service Implementation Implementation Adaptation Adaptation Service – Speech Speech Recognition Recognition – • Speech Recognition in the AmI-Prototype – Why » Natural communication with the system » But important: High recognition rate in changing environmental conditions such as � Different speaker (young, old, female, male) � Background noise � Mental and physical stress of the speaker – Our goal » Input of upper and lower pulse boundary using speech input » Take into account the physical stress of the user – Realization in cooperation with the BUTE (Budapest University of Technology and Economics) » Using Hungarian speech recognition engine � Task: Mapping on German speech » Take into account current stress of the speaker using German speech recordings » Feature: Speech recognizer is runnable on „small“ devices like � PDA, Handy, … 21.05.2006 AG Softwarearchitektur 6

Speech Recognition Recognition Speech Reference Model Matching Speech Signal Algorithm Recognized Phrase 21.05.2006 AG Softwarearchitektur 7

Speech Recognition Recognition under under Physical Physical Speech Stress of the the Speaker Speaker Stress of • Generic Approach – Stress Recognition » Current research topic � Automatic stress detection » In our scenario � Stress detection using the pulse value of the speaker – Compensation of stress features » Manipulation of speech-statistics at runtime � High computational power required » Switching between different speech-statistics which have been created offline 21.05.2006 AG Softwarearchitektur 8

Architecture of a of a Self Self- -Adaptive Adaptive Architecture Component Component Pulse Sensor Sensor Network Self-adaptive speech recognizer ContextProvidingInterface Stress recognition Self-adaptive AmI component and stress level Context Providing Decision of how to react on a specific Context Context stress level Adaptation Processing Switching between statistics ContextAdaptationInterface Actor Network 21.05.2006 AG Softwarearchitektur 9

Outlook Outlook • Service configuration adaptation – First version is already implemented • Description techniques for „Quality of Service“ – Especially required by » Service Usage adaptation » Service Configuration adaptation – What is the best service at the moment? – Criterion can change during runtime! 21.05.2006 AG Softwarearchitektur 10

Questions and and Discussion Discussion Questions Any Questions ? 21.05.2006 AG Softwarearchitektur 11