Social-media Storytelling Linking Hao Wu Seamus Lawless Gareth - PowerPoint PPT Presentation

Sep 21, 2023 •381 likes •651 views

Social-media Storytelling Linking Hao Wu Seamus Lawless Gareth Jones Francois Pitie The ADAPT Centre is funded under the SFI Research Centres Programme (Grant 13/RC/2106) and is co-funded under the European Regional Development Fund. Task

Social-media Storytelling Linking Hao Wu Seamus Lawless Gareth Jones Francois Pitie The ADAPT Centre is funded under the SFI Research Centres Programme (Grant 13/RC/2106) and is co-funded under the European Regional Development Fund.
• Task definition • Challenges & Solutions • Training • Searching • Result www.adaptcentre.ie
www.adaptcentre.ie
Tour France www.adaptcentre.ie
www.adaptcentre.ie
Challenges & Solutions www.adaptcentre.ie
Video can’t be concluded by Lack of training data only one sentences. Challenges www.adaptcentre.ie
Video segmentation Pre-train + Fine tuning + Length normalization Solutions www.adaptcentre.ie
Data pre-processing www.adaptcentre.ie
Images Videos Queries 32k 6.2k 60 Edinburgh Festival 66k 19k 58 Le Tour de France www.adaptcentre.ie
Video Text Shot boundary detection Word level + Sentence level (Skip-Thought) Image sets Image Resnet-152 Visual embeddings Text representation www.adaptcentre.ie
Model overview www.adaptcentre.ie
www.adaptcentre.ie
Training www.adaptcentre.ie
Snow Pre-training Playful dogs People having meal Deep time Show Target information Museum of Edinburgh Highlights of Chris Froome Examples www.adaptcentre.ie
A boy in a dark shirt is reading a book while sitting on a piano bench Pre-training Introducing Flickr30k ( High quality “image” - “text” pairs) www.adaptcentre.ie
Collecting from source domain: • Identify keywords from query file. • Match keywords with data in the source. Model E.g. Keyword: taking selfies . Collecting from search engine: • Collect labels from online image search engine (Google and Bing) using story segments + event name as query. Target information collecting www.adaptcentre.ie
Chris Froome pedaling Snow www.adaptcentre.ie
Searching www.adaptcentre.ie
Trade-off between consistency and accuracy 𝑆 𝑢 = 0.2* 𝑆 t−1 + 0.8 * 𝑁 𝑢 (M is the model raw output, R is the modified output) Search www.adaptcentre.ie
There are 5 runs submitted. The main difference is the value of λ : Conf Run1 Run2 Run3 Run4 Run5 λ 3 5 12 20 50 Source Google+ Google Google Google Google Bing λ used in penalizing long videos; L denotes number of segments; Sig() is sigmoid function. Search www.adaptcentre.ie
Results www.adaptcentre.ie
Summary Quality 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 Run1 Run2 Run3 Run4 Run5 Edfest Tourfrance www.adaptcentre.ie
Conclusion & Future Work Target specific information are crucial. Improve video representations by applying key frame selection (or building sequence model). Build a classifier to filter crawled images to make this process automatic. www.adaptcentre.ie
Thanks for listening. The ADAPT Centre is funded under the SFI Research Centres Programme (Grant 13/RC/2106) and is co-funded under the European Regional Development Fund.

Recommend

story linking TRECVID 2018 - Social-media video story-telling linking Task Goncalo Marcelino,

Graph-based social media story linking TRECVID 2018 - Social-media video story-telling linking Task Goncalo Marcelino, Joao Magalhaes NOVA LINCS - Faculdade de Cincias e Tecnologia Universidade NOVA Lisboa, Caparica, Portugal

644 views • 28 slides

STORYTELLING THROUGH SOCIAL MEDIA The Objectives The Sponsors [ I NTRODUCTION ] Connect

STORYTELLING THROUGH SOCIAL MEDIA The Objectives The Sponsors [ I NTRODUCTION ] Connect neighbours on and offline Build connections between leagues Help leagues minimize challenges on social media The Program Help leagues share

1.41k views • 102 slides

Social Seniors Social Media & Digital Storytelling for Seniors Introduction Introduction

Information for facilitators Social Seniors Social Media & Digital Storytelling for Seniors Introduction Introduction Social Seniors is a series of practical workshops that use digital stories short videos to help senior

583 views • 32 slides

. VISUAL STORYTELLING Introduction to Goddards Multimedia, Visualization, and Social Media

. VISUAL STORYTELLING Introduction to Goddards Multimedia, Visualization, and Social Media Teams Wade Sisler Executive Producer NASA HQ > Goddard Network > Affiliates NASA-TV Godda rd nasa.gov Langle y Social

429 views • 23 slides

Interactive Media Storytelling, Social Marketing & Young People Mark Grindle ISM Institute

Interactive Media Storytelling, Social Marketing & Young People Mark Grindle ISM Institute for Social Marketing Social Marketing is: concerned with the application of marketing knowledge, concepts and techniques to enhance social

271 views • 8 slides

Storytelling on social media Rachel Extance @RachelExtance #CambSMmeetup What is a story?

Storytelling on social media Rachel Extance @RachelExtance #CambSMmeetup What is a story? People - who is it about? Drama - whats happening? Resolution - how did it end? #CambSMmeetup Why tell stories? Theyre all

1.11k views • 29 slides

Getting Social What is social media? Why does social media matter? What social media

pwcom .co.uk CIOB Hertfordshire March 2012 Who am I? Getting Social What is social media? Why does social media matter? What social media tools can we apply in construction? How do we start? Paul Wilkinson

396 views • 18 slides

Presentation 1 What is social media? Get Media Smart social media 2 What is social media?

Presentation 1 What is social media? Get Media Smart social media 2 What is social media? Get Media Smart social media 3 What is social media? You will be working in groups of four with a large piece of paper and marker pens. In

168 views • 14 slides

Social Media For Conference Centers 2018 IACC AAP Evan Urbania ChatterBlast Media February,

Social Media For Conference Centers 2018 IACC AAP Evan Urbania ChatterBlast Media February, 2018 AGENDA 1. Introduction 2. Challenges 3. Social Channels: Overview 4. Social Media + Brands 5. Storytelling + Conference Centers 6. Strategic

751 views • 60 slides

Social networking platforms Social media refers to the means of interactions among people in which

4/30/2013 * a)I dont really know what Social Media means b) None (but I know what Social Media means) # c) 1 Social Media Network d) 2 Social Media Networks @Seth Bokser, MD, MPH Associate Clinical Professor, UCSF Medical School e) 3 or

578 views • 8 slides

Social Media for Mason AGENDA What is Social Media Social Media Strategy Content

Social Media for Mason AGENDA What is Social Media Social Media Strategy Content Return on Investment (ROI) Forthcoming Policy Resources and Tools What is Social Media? What is social media? Thanks, Kathy. I could have

1.12k views • 35 slides

Social Media 201: Using Social Media to Advocate for Advocacy Day and Beyond Social Media 101

Social Media 201: Using Social Media to Advocate for Advocacy Day and Beyond Social Media 101 Hangout from 2013 Google YouTube FiresteelWA to find it! Tweet us your questions! @FiresteelWA @WLIHA @Username Can be only 15 characters long!

448 views • 30 slides

Social Media donts What is social media Social media is nothing new Just an extension

Steven Anderson Digital Manager MAS 15:00 - 15:30 Social Media Do's and Don'ts Dos and Social Media donts What is social media Social media is nothing new Just an extension of something we all have a social network Its

452 views • 18 slides

Social Media Seminar for Development Educators Part 1: Social Media Basics How are these

Social Media Seminar for Development Educators Part 1: Social Media Basics How are these websites being used for social change? http://www.slideshare.net/mzkagan/what-the-fk-social-media On Road Media Is an award-winning social enterprise

1.07k views • 75 slides

Overview Introduction to myself Introduction to social media Social media and LIS

Methods of Social Media Research: Data Collection & Use in Social Media Florida State University College of Communication and Information Sanghee Oh shoh@cci.fsu.edu Overview Introduction to myself Introduction to social media

668 views • 47 slides

Social Media and NFP organisatons Emma Bennett Why are you using social media? Today

Social Media and NFP organisatons Emma Bennett Why are you using social media? Today Identifying the reason for using social media Planning Opportunities and risks for NFPs Ways to incorporate social media into your

512 views • 39 slides

Social Media Policy Example At the School, we understand that social media can be a fun and

Social Media Policy Example At the School, we understand that social media can be a fun and rewarding way to share your life and opinions with family, friends, and other staff members. However, the use of social media also presents certain risks

305 views • 3 slides

Presentation 2 Why is there advertising on social media? Get Media Smart social media 2

Presentation 2 Why is there advertising on social media? Get Media Smart social media 2 Why is there advertising on social media? Display advertising: the banners and pre-roll videos that play before you access content on sites like

713 views • 26 slides

Social Media Whats it all about? Social media is about the conversation, which only works if you

Social Media Whats it all about? Social media is about the conversation, which only works if you participate. Why should I bother? Social media allows you to: promote your research and increase its visibility communicate directly and quickly

439 views • 13 slides

SOCIAL MEDIA T H E G O O D, T H E B A D A N D T H E B I Z A R R E TODAY. What is

SOCIAL MEDIA T H E G O O D, T H E B A D A N D T H E B I Z A R R E TODAY. What is Social Media The Good The Bad The Bizarre Why Social Media is important? My top tips for Social Media Questions WHAT IS SOCIAL

187 views • 17 slides

Social Media What is Social Media? forms of electronic communication (such as Web sites) through

EDUCATE HONOR CHALLENGE Social Media What is Social Media? forms of electronic communication (such as Web sites) through which people create online communities to share information, ideas, personal messages, etc. Social Media Platforms

410 views • 14 slides

1. Social Media Outline 1.1. What is Social Media? 1.2. Opinion Retrieval 1.3. Feed

1. Social Media Outline 1.1. What is Social Media? 1.2. Opinion Retrieval 1.3. Feed Distillation 1.4. Top-Story Identification Advanced Topics in Information Retrieval / Social Media 2 1.1. What is Social Media? Content creation is

722 views • 36 slides

Social Media -- Understanding it and Making it Work Preliminary Guidance on Social Media

Social Media -- Understanding it and Making it Work Preliminary Guidance on Social Media Regional Repositories Workshop October 20, 2011 What is social media? Social media is a subset of Web 2.0, which very broadly refers to any use of

285 views • 11 slides

Digital Media Addiction Smart Phones, Social Media and Suicide Fact: Social Media is a

Digital Media Addiction Smart Phones, Social Media and Suicide Fact: Social Media is a normal part of our society and functioning today. The Isolation of Generations While Social Media has been around for years, it was the introduction of

324 views • 3 slides