M4 meeting Sept 2004 Steve Renals University of Edinburgh
Agenda - Thursday • 0900-0930 - Introduction • 0930 - 1030 WP2 (video) • TUM - Head Tracking • Brno - Body part tracking and facer verif. • Brno - Unrolling 360 ° video • 1030-1100 Break • 1100-1230 WP2 (Audio/video) • USFD - AV tracking using oscillators • IDIAP - Multi-object tracking (V and AV) • TNO - Microphone arrays • Brno - Speech procecessing • Discussion (WP2 demos?) • 1230 - 1400 Lunch
Agenda - Thursday • 1400-1530 WP3 • TNO - Extractive summarization • UniGe - Indexing large video collections • Brno - Automatic video editor • TUM - Meeting event recogniton • UEDIN - Meeting structuring • 1530-1600 Break • 1600 - 1730 WP3, WP4 • WP3 discussion (meeting actions) • IDIAP - Browser Evaluation Test • Discussion - final demonstrator • Bavarian evening
Agenda - Friday • 0900 - 1030 Dissemination, exploitation, etc • 2004 annual report • Technological implementation plan (TIP) • Finalizing the deliverables • Final review • 1030-1100 Any other business • 1200 - 1600 Oktoberfest • 1600 - 2300 (More Oktoberfest...)
Aims of the Meeting • Final technical meeting of the project - technical presentations • Plan the final deliverables • Try to tie up loose ends - let’s make the final state of M4 as coherent as possible • The TIP - Technological Implementation Plan • M4 demonstrations (for final review) • Experience the Oktoberfest
Deliverables • Remaining deliverables all due end Feb 2005 • D2.2 - Final report on multimodal recognizers • D3.3 - Final report on multimodal information access and integration • D4.3 - Report on final demonstrator • D5.4 - Technological Implementation Plan
Final review • Year 2 review (Martigny, June 2004) was “informal”; the outcome was very positive • Final review will almost certainly involve the same reviewers (J Foote and M Russell) and will be concurrent with the first AMI review • In addition to the browser demo, some “component demos” would be good • Want to present project outcomes as coherently as possible.
WP2 demos • TUM - head tracking • Brno - omnidirectional camera + tracking • USFD - oscillator networks • IDIAP - Multi-object tracking • Brno - Keyword spotting? • Action/gesture recognition (browser) • Mic arrays? (probab via other apps?) • Speech recognition (AMI - via browser)
M4 Annual report • Due November 2004 • Short, web based, with 5-6 “highlights”: 100-200 words per highlight, plus images • 2002: Meeting room, separation / localization / tracking • 2003: Media file server, speech processing, tracking, meeting structure/events, demonstrator, user group / promotion / awareness • What should we have in the 2004 report?
2004 Report • Dissem / Exploitation • Demonstrator + BET • Portable meeting room + EPFL camera • Multistream models • Tracking
The TIP • TIP = Technological Implementation Plan • Must be completed for the end of the project - required for all EC projects • Includes: • Overview and description • Project impact • Project results (all partners) • Dissemination and use • Contributions to EU policies / social objectives (questionnaire for statistics)
Project results • A number of results per project - agreed by the project • Each result has an owner who is responsible for it in the TIP (including exploitation plans) • Types of result: widely available (A); project partners only (B); of no exploitable use (C) • http://etip.cordis.lu
Results • Portable meeting room - Brno • Ferret browser - IDIAP • USB camera - EPFL • Multimodal indexing and retrieval - UniGe (TNO/ USFD) • Media file server - IDIAP • M4 data collection - IDIAP (Brno) • Meeting event recognition - UEDIN (TUM/IDIAP/UT) • Speech recognition/xtalk - USFD (Brno) • Localization/tracking - TUM (IDIAP/Brno/USFD/TNO • Multimodal Summarization - TNO (USFD/Brno) • Annotation tools - UT (Brno)
Recommend
More recommend