A synthetic aperture microphone array for the meeting room TNO TPD - PowerPoint PPT Presentation

Construction of arbitrarily positioned “virtual microphones” A synthetic aperture microphone array for the meeting room TNO TPD Synthetic aperture microphone array September 23, 2004 1

About OKTO (operation room of the near future) • Focuses on the role of information in the process • Tries to relate info from multimodal sources to the ongoing procedures and hence add semantics • Aims to support the surgical team by monitoring their actions, scanning and interpreting info, then presenting the relevant info • Heavily relies on “information mediation”, ontologies, classification methods, image processing, etc • Cooperation with the Reinier de Graaf hospital group, Egripment motion platform manufacturer, 2Cure electronic patient record system manufacturer Synthetic aperture microphone array September 23, 2004 2

Project relationships M4 and OKTO Shared Deviations • Aiming at tracking and • Very tight, prescribed tracing the ‘meeting’ protocols in the OR • Detection of clues about the • OKTO aimed at real time meeting process, the workflow support for the professional • Multimodal aspects, including • Fysiological data influence the various data sources process real time • Utterings of meeting members • Not that much speech about contain important information the current process • … • … Synthetic aperture microphone array September 23, 2004 3

Dimensions AMI (M4) Meetingroom TNO – OR of the Delft Reinier de Graaf hospital 100 2 x Rear 650 projection movable 130 board pin-up wall Anest Height: 190 120 150 Smart board Dia therm Height: 73 Light box Audio/video unit 160 PC 320 600 In s trum private/ 120 120 subteam 180 Height room: 300 table 75 8375 190 3900 7800 175 175 Height room: 293 Synthetic aperture microphone array September 23, 2004 4

Layout of an operating room in Delft Feasible array position F e a s i b l e a r r a y p o s i t i o n Synthetic aperture microphone array September 23, 2004 5

Array placement in hospital in Voorburg Synthetic aperture microphone array September 23, 2004 6

Preliminary in vivo C&C-experiments in the Delft Reinier de Graaf hospital (2003) Preliminary experiments Voice controlled application (High-res version) (High-res version) Synthetic aperture microphone array September 23, 2004 7

Geometry of our synthetic operating room Synthetic aperture microphone array September 23, 2004 8

2D finite difference acoustic impulse response Right Front Left Back time Front Back receivers Synthetic aperture microphone array September 23, 2004 9

Three array configurations explored in vitro Square; 800 mic’s Mondriaan; 2 x 800 Circle; 600 mic’s mic’s 1 A A A S S S S S S 2 3 1 The 3 different array configurations do not differ much in what they gain in SNR 15 dB suppression of unwanted sources 3 2 This is caused by all the reflections of the operation room Improved results are possible when the (acoustic) geometry of the space is included Synthetic aperture microphone array September 23, 2004 10

Two processing schemas explored in vitro L-shape; 400 mic’s Method 1 14 dB suppression 1 A 9 dB suppression S S 2 3 8 dB suppression Method 2 1 19 dB suppression 14 dB suppression 3 2 17 dB suppression Synthetic aperture microphone array September 23, 2004 11

Results of ASR (Dragon) on our synthetic examples src 1 (method 1; method 2) Esther, kun je mij een pakje steristrips geven Harris iris weergegeven. Rood & herleiden patisserie strips geven niet al src 2 (method 1; method 2) Ter plaatse van de rechter perianale regio bevindt zich een groot infiltraat. Te plaats veranderen miljard aangelegenheden bevindt zich een groot infiltraat. Ter plaatse van de rechter binnenhalen regionen bevindt zich een groot infiltraat. src 3 (method 1; method 2) Kan iemand mij dokter Stassen aan de lijn krijgen Daar Latijnse slagerij geheel ingeven bevindt zich groot infiltraat. Verlanglijst & slagerij vervaardigde zich groot infiltraat. Synthetic aperture microphone array September 23, 2004 12

Next to do: • Optimization algorithm leading to at least 25 dB S/N ratio (needed for ASR purposes) • Results for reduced number of mics • Tracking of ‘moving’ sources • ‘Real’, standardized experiments (lab, OR) Synthetic aperture microphone array September 23, 2004 13