Semantic Adaptation of Multimedia Documents S ebastien Laborie - PowerPoint PPT Presentation

Semantic Adaptation of Multimedia Documents S´ ebastien Laborie Post-doc 1 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Introduction A multimedia document Composed of objects Text Image Audio Video Assembled by an author Temporal dimension Spatial dimension Hypermedia dimension 2 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Introduction Multimedia document adaptation 3 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Introduction Multimedia document adaptation Profile 1 Profile 2 Profile 3 3 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Introduction Multimedia document adaptation Adaptation Profile 1 Profile 2 Profile 3 3 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Outline Semantic adaptation 1 Spatio-temporal and hypermedia specification 2 Spatio-temporal and hypermedia adaptation 3 SMIL adaptation 4 Semantic media adaptation 5 4 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Outline Semantic adaptation 1 Spatio-temporal and hypermedia specification 2 Spatio-temporal and hypermedia adaptation 3 SMIL adaptation 4 Semantic media adaptation 5 5 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Current adaptation techniques Specification of alternatives based on target profiles Adaptation Profile Adapted document Initial document 6 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Current adaptation techniques Specification of alternatives based on target profiles based on content Stylesheet Adaptation Profile Adapted document Initial document 6 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Current adaptation techniques Specification of alternatives based on target profiles based on content both approaches Stylesheet Adaptation Profile Adapted document Initial document 6 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Current adaptation techniques Specification of alternatives based on target profiles based on content both approaches Stylesheet Adaptation Hard to predict target profiles Initial document 6 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Current adaptation techniques Specification of alternatives based on target profiles based on content both approaches Specification of transformation rules Repository of transformation rules T 1 :VideoToImages T 2 :TextToAudio . . . Adaptation Profile Adapted document Initial document 6 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Current adaptation techniques Specification of alternatives based on target profiles based on content both approaches Specification of transformation rules Specification of abstract models Data Adaptation Narrative structure present problem intro Profile before show image section 6 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Current adaptation techniques Specification of alternatives based on target profiles based on content both approaches Specification of transformation rules Specification of abstract models Requirements of an adaptation approach flexible and general - Cover all document dimensions Language independant - Transformations not explicit 6 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Adaptation quality ”The basic assumption is that content transformation activities should be provided as non-destructive operations.” (DocEng’08) ⇒ One approach is to measure the adaptation transformations Different kind of metrics: Measuring the discourse evolution Measuring the composition degradation Measuring the content transformation 7 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Adaptation quality ”The basic assumption is that content transformation activities should be provided as non-destructive operations.” (DocEng’08) ⇒ One approach is to measure the adaptation transformations Different kind of metrics: Measuring the discourse evolution Measuring the composition degradation Measuring the content transformation 7 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Semantic adaptation of multimedia documents An execution is considered as a set of objects Objects may be composed temporally e 4 Poster Bande-annonce R´ esum´ e Personnages Dates 8 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Semantic adaptation of multimedia documents An execution is considered as a set of objects Objects may be composed temporally e 2 e 4 Poster Bande-annonce Poster Bande-annonce Personnages R´ esum´ e Dates R´ esum´ e Personnages Dates 8 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Semantic adaptation of multimedia documents A document can be interpreted as a set of executions I s e 2 e 4 e 5 e 1 e 3 Dates Poster Bande-annonce Poster Bande-annonce R´ esum´ e Personnages R´ esum´ e Personnages Dates Poster Bande-annonce Poster Bande-annonce Personnages R´ esum´ e Dates R´ esum´ e Personnages Dates Poster Bande-annonce Personnages R´ esum´ e Dates 8 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Semantic adaptation of multimedia documents A document can be interpreted as a set of executions Some satisfy the author intention I s M s e 2 e 4 e 5 e 1 e 3 Dates Poster Bande-annonce Poster Bande-annonce R´ esum´ e Personnages R´ esum´ e Personnages Dates Poster Bande-annonce Poster Bande-annonce Personnages R´ esum´ e Dates R´ esum´ e Personnages Dates Poster Bande-annonce Personnages R´ esum´ e Dates 8 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Semantic adaptation of multimedia documents The target device accepts only some executions Profile: no more than 2 objects executed simultaneously I s M s e 2 M p e 4 e 5 e 1 e 3 Dates Poster Bande-annonce Poster Bande-annonce R´ esum´ e Personnages R´ esum´ e Personnages Dates Poster Bande-annonce Poster Bande-annonce Personnages R´ esum´ e Dates R´ esum´ e Personnages Dates Poster Bande-annonce Personnages R´ esum´ e Dates 8 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Semantic adaptation of multimedia documents Adapting amounts to find possible initial executions ( M s ∩ M p ) Here, no adaptation is needed I s M s e 2 M s ∩ M p M p e 4 e 5 e 1 e 3 Dates Poster Bande-annonce Poster Bande-annonce R´ esum´ e Personnages R´ esum´ e Personnages Dates Poster Bande-annonce Poster Bande-annonce Personnages R´ esum´ e Dates R´ esum´ e Personnages Dates Poster Bande-annonce Personnages R´ esum´ e Dates 8 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Semantic adaptation of multimedia documents Other profiles can be considered Profile: satisfy the presentation contiguity I s M s e 2 M p e 4 e 5 e 1 e 3 Dates Poster Bande-annonce Poster Bande-annonce R´ esum´ e Personnages R´ esum´ e Personnages Dates Poster Bande-annonce Poster Bande-annonce Personnages R´ esum´ e Dates R´ esum´ e Personnages Dates Poster Bande-annonce Personnages R´ esum´ e Dates 8 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Semantic adaptation of multimedia documents The adaptation selects some possible initial executions Refining adaptation I s M s e 2 M s ∩ M p M p e 4 e 5 e 1 e 3 Dates Poster Bande-annonce Poster Bande-annonce R´ esum´ e Personnages R´ esum´ e Personnages Dates Poster Bande-annonce Poster Bande-annonce Personnages R´ esum´ e Dates R´ esum´ e Personnages Dates Poster Bande-annonce Personnages R´ esum´ e Dates 8 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Semantic adaptation of multimedia documents In other cases, no initial execution can be possible Profile: execute one objets at a time I s M s e 2 M p e 4 e 5 e 1 e 3 Dates Poster Bande-annonce Poster Bande-annonce R´ esum´ e Personnages R´ esum´ e Personnages Dates Poster Bande-annonce Poster Bande-annonce Personnages R´ esum´ e Dates R´ esum´ e Personnages Dates Poster Bande-annonce Personnages R´ esum´ e Dates 8 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents

Semantic adaptation Semantic adaptation of multimedia documents The adaptation selects some executions close to initial ones Transgressive adaptation M s ∩ M p = ∅ I s M s e 2 M p e 4 e 5 e 1 e 3 d =? Dates Poster Bande-annonce Poster Bande-annonce R´ esum´ e Personnages R´ esum´ e Personnages Dates Poster Bande-annonce Poster Bande-annonce Personnages R´ esum´ e Dates R´ esum´ e Personnages Dates Poster Bande-annonce Personnages R´ esum´ e Dates 8 S´ ebastien Laborie Semantic Adaptation of Multimedia Documents