Experiment presentation by Nayan Singhal Motivation Human - PowerPoint PPT Presentation

Jul 09, 2023 •377 likes •875 views

Situation Recognition: Visual Semantic Role Labelling for Image Understanding Mark Yatskar, Luke Zettlemoyer, Ali Farhadi Experiment presentation by Nayan Singhal Motivation Human understanding of image Verbs in English language.

Situation Recognition: Visual Semantic Role Labelling for Image Understanding Mark Yatskar, Luke Zettlemoyer, Ali Farhadi Experiment presentation by Nayan Singhal
Motivation ● Human understanding of image ● Verbs in English language.
Approach ● CRF with CNN CARRYING AGENT WOMAN 1024 CNN CRF ITEM JAR AGENTPART HEAD PLACE OUTDOOR ● Log linear Loss
How object plays role in image understanding?
neighboring images
Remove Cliff Removing Cliff neighboring images
Remove person neighboring images Removing Man
Remove Sky neighboring images Removing Sky
Image (2) neighboring images
Remove Person neighboring images Removing man
Remove Background neighboring images Removing Sky and Man
Conclusion Each object plays a significant role in image understanding.
Experiment 1) Analyzing Failure Cases 2) Different moods of faces
Expt 1: Analyzing Failure Cases
Object Recognition (1) Imsitu Result
Object Recognition (2) Imsitu Result
Object Recognition (3) Imsitu Result
Object Recognition (4) Imsitu Result
Object Recognition (5) Imsitu Result
Object Recognition (6) Imsitu Result
Why is it happening? Are these images difficult to categorize?
Let’s analyze these with ImageNet
Object Recognition (1) Imsitu Result
ImageNet classification
Object Recognition (2) Imsitu Result
Object Recognition (2) ImageNet classification
Object Recognition (3) Imsitu Result
Object Recognition (3) ImageNet classification
Object Recognition (4) Imsitu Result
Object Recognition (4) ImageNet classification
Object Recognition (5) Imsitu Result
Object Recognition (5) ImageNet classification
Object Recognition (6) Imsitu Result
Object Recognition (6) ImageNet classification
Object Recognition (1) Noun Slot Verb Role Noun Potential Labels A (Verb Role Noun Potential) + B (Labels) Post Processing:
Object Recognition (1) Imsitu Result
Object Recognition (1) VGG Imagenet Verb Potential Verb Role Noun Potential Labels Preprocessing
Future Work ● Add labels in preprocessing.
Exp 2: Different moods ● Laughing ● Smiling ● Frowning ● Grimacing ● Winking ● Squinting ● Shouting ● Puckering Winking Squinting Puckering Smiling Laughing Frowning
Success Case Smiling Laughing Shouting Agent place Agent place Agent place man - man - man - 0.35967 0.35777 0.37531
Success Case Frowning Grimacing Agent place Agent place man - man - 0.24378 0.21052
Failure Case Winking Puckering Agent place Agent place man - woman - 0.20954 0.21052
Test Images (25) ● Conclusion: Detect different moods of faces with slight variation.
Some Interest Categorization
Some Interest Categorization Camouflaging Camouflaging Agent owl Agent frog Hiding Item tree Hiding Item pebble Place outdoors Place -
neighboring images
neighboring images
Thank You
No Agent(2) Watering Shredding Agent Person Agent Person Tool Bucket Tool Shreder Place garden Item paper Place -

Recommend

The Role of Housing and Financial Wealth on Healthcare Expenditure Nayan Krishna Joshi

Research Topic and Motivation Theoretical Framework Data and Methodology Econometric Methodology and Preliminiary Findings Future work The Role of Housing and Financial Wealth on Healthcare Expenditure Nayan Krishna Joshi Department of

559 views • 41 slides

EXPERIMENT : FM 202 NATURE OF FLOW MOTIVATION AND OBJECTIVES MOTIVATION Majority of

CL-232 EXPERIMENT : FM 202 NATURE OF FLOW MOTIVATION AND OBJECTIVES MOTIVATION Majority of chemical-processing operations are conducted in the fluid phase. Important for efficient designing of such operations OBJECTIVES Visually

450 views • 9 slides

experiment PsyIntEC Feasability demonstration project targeting Human-Robot Interfacing and

Karlskrona, Sweden experiment PsyIntEC Feasability demonstration project targeting Human-Robot Interfacing and Safety Dr. Johan Hagelbck Project idea Joint human-robot work cell. A human co-worker collaboratively solves a reference

638 views • 40 slides

The NPDGamma Experiment at the SNS Motivation Weak Interaction between quarks Radiative capture

The NPDGamma Experiment at the SNS Motivation Weak Interaction between quarks Radiative capture of polarized cold neutrons in protons NPDGamma experiment at the SNS Status report Summary and Outlook 1 5 th International Symposium on

276 views • 25 slides

The Muon g-2 Experiment Jenny Holzbauer September 27, 2017 Overview Motivation and some

The Muon g-2 Experiment Jenny Holzbauer September 27, 2017 Overview Motivation and some history Comment on theory and its inputs Moving from BNL to Fermilab The planned measurement Experiment setup Measurement strategy

717 views • 25 slides

LIST OF ORAL PRESENTATION ROOM A NO CODE NAME TITLE 1 ABS-IGEOS Nasir Nayan Is

LIST OF ORAL PRESENTATION ROOM A NO CODE NAME TITLE 1 ABS-IGEOS Nasir Nayan Is Flood Water Safe for Consumption at Evacuation Center in UNS-19001 Kuala Krai District, Kelantan, Malaysia? 2 ABS-IGEOS AFRINIA LISDITYA Evaluation

252 views • 9 slides

Elections and Public Health Spending in South Asia Nayan Krishna Joshi, PhD Institute for

Elections and Public Health Spending in South Asia Nayan Krishna Joshi, PhD Institute for Integrated Development Studies Kathmandu University, Nepal February 18, 2017 Introduction Data and Methodology Objective Main Results Contribution

658 views • 39 slides

TOK presentation Exemplar 1 300 RLS: Stanford Prison Experiment KQ: Is experimentation a

TOK presentation Exemplar 1 300 RLS: Stanford Prison Experiment KQ: Is experimentation a good method of investigation in the human sciences? 553 RLS: Stanford Prison Experiment Milgram experiment experiment KQ: Is experimentation a

400 views • 5 slides

Chapter 6: Message Ordering and Group Communication Ajay Kshemkalyani and Mukesh Singhal

Chapter 6: Message Ordering and Group Communication Ajay Kshemkalyani and Mukesh Singhal Distributed Computing: Principles, Algorithms, and Systems Cambridge University Press A. Kshemkalyani and M. Singhal (Distributed Computing) Message

632 views • 52 slides

Chapter 1: Introduction Ajay Kshemkalyani and Mukesh Singhal Distributed Computing: Principles,

Chapter 1: Introduction Ajay Kshemkalyani and Mukesh Singhal Distributed Computing: Principles, Algorithms, and Systems Cambridge University Press A. Kshemkalyani and M. Singhal (Distributed Computing) Introduction CUP 2008 1 / 36

383 views • 36 slides

Module 2: Problem-based learning in TVET Ir. Dr. Nazrul Anuar Nayan B.Eng. (The Univ. of Tokyo),

Module 2: Problem-based learning in TVET Ir. Dr. Nazrul Anuar Nayan B.Eng. (The Univ. of Tokyo), M.Eng. , PhD.Eng. (Gifu Univ., Japan), PEng . Dept. Electrical Electronic & System, Fac. of Engineering & Built Environment, Universiti

1.35k views • 81 slides

5. Motivation Motivation: Big Questions Where does motivation come from? Can

5. Motivation Motivation: Big Questions Where does motivation come from? Can motivation be created or increased? What motivates school- age children? 5.1 Behavioral Theory 5.2 Human Needs Theory 5.3 Attribution Theory

831 views • 45 slides

Chapter 16: Authentication in Distributed System Ajay Kshemkalyani and Mukesh Singhal Distributed

Chapter 16: Authentication in Distributed System Ajay Kshemkalyani and Mukesh Singhal Distributed Computing: Principles, Algorithms, and Systems Cambridge University Press A. Kshemkalyani and M. Singhal (Distributed Computing) Authentication in

1.15k views • 54 slides

Chapter 2: A Model of Distributed Computations Ajay Kshemkalyani and Mukesh Singhal Distributed

Chapter 2: A Model of Distributed Computations Ajay Kshemkalyani and Mukesh Singhal Distributed Computing: Principles, Algorithms, and Systems Cambridge University Press A. Kshemkalyani and M. Singhal (Distributed Computing) A Model of

751 views • 31 slides

Chapter 14: Consensus and Agreement Ajay Kshemkalyani and Mukesh Singhal Distributed Computing:

Chapter 14: Consensus and Agreement Ajay Kshemkalyani and Mukesh Singhal Distributed Computing: Principles, Algorithms, and Systems Cambridge University Press A. Kshemkalyani and M. Singhal (Distributed Computing) Consensus and Agreement CUP

905 views • 55 slides

Prof. K. C. Prof. K. C. Sin Singhal hal M.D., Ph.D. (Medicine), D.Sc., F.I.A.N., F.I.P.S.,

Prof. K. C. Prof. K. C. Sin Singhal hal M.D., Ph.D. (Medicine), D.Sc., F.I.A.N., F.I.P.S., F.I.A.M.S. Consultant WHO Center for International Drug Monitoring, Uppsala, Sweden Vice - Chancellor, Vice - Chan cellor, NIMS Un NIMS

732 views • 33 slides

Chapter 3: Logical Time Ajay Kshemkalyani and Mukesh Singhal Distributed Computing: Principles,

Chapter 3: Logical Time Ajay Kshemkalyani and Mukesh Singhal Distributed Computing: Principles, Algorithms, and Systems Cambridge University Press A. Kshemkalyani and M. Singhal (Distributed Computing) Logical Time CUP 2008 1 / 67

909 views • 67 slides

Outline > Introduction and Motivation > Overview of the Experiment > Schedule > Data

Two-Photon Exchange in Electron Proton Scattering - Status of OLYMPUS Experiment at DESY PHOTON 2015 Novosibirsk Uwe Schneekloth, DESY on behalf of the OLYMPUS Collaboration Outline > Introduction and Motivation > Overview of the

496 views • 26 slides

New Observations from the MiniBooNE Experiment Motivation 1. MiniBooNE Appearance Results 2.

New Observations from the MiniBooNE Experiment Motivation 1. MiniBooNE Appearance Results 2. Geoffrey Mills Comparison of LSND and MiniBooNE 3. Los Alamos National Laboratory For the MiniBooNE Collaboration Future Possibilities 4.

818 views • 47 slides

CENTRAL ANALGESIC ACTIVITY OF Litsea polyantha Juss. BARK EXTRACT Manik Ghosh * and Barij Nayan

CENTRAL ANALGESIC ACTIVITY OF Litsea polyantha Juss. BARK EXTRACT Manik Ghosh * and Barij Nayan Sinha Department of Pharmaceutical Sciences and Technology Birla Institute of Technology, Mesra, Ranchi, Jharkhand (835215), INDIA *Corresponding

642 views • 28 slides

Affirmative Action and Human Capital Investment: Evidence from a Randomized Field Experiment Joe

Affirmative Action and Human Capital Investment: Evidence from a Randomized Field Experiment Joe Price Economics joe_price@byu.edu 801-422-5296 Areas of Interest: Family structure; Field experiments in schools; Healthy eating; Habit

576 views • 46 slides

Sangam: A Multi-component Core Cache Prefetcher Mainak Chaudhuri, Nayan Deshmukh Introduction

Sangam: A Multi-component Core Cache Prefetcher Mainak Chaudhuri, Nayan Deshmukh Introduction The word Sangam refers to a confluence of 3 rivers which corresponds to 3 core components in our prefetcher We achieve 40.3% speedup over

1.61k views • 72 slides

Probabilistic Models of Human Sentence Experiment 1: Entropy and Sentence Length 2 Processing

From Sentence to Text From Sentence to Text Experiment 1: Entropy and Sentence Length Experiment 1: Entropy and Sentence Length Experiment 2: Entropy in Context Experiment 2: Entropy in Context Experiment 3: Entropy out of Context Experiment

231 views • 7 slides

The Mu2e Experiment Tomo Miyashita Caltech On Behalf of the Mu2e Collaboration Fermilab Users

The Mu2e Experiment Tomo Miyashita Caltech On Behalf of the Mu2e Collaboration Fermilab Users Meeting Batavia, IL June 20th, 2018 Overview Motivation and Theory Experiment Overview Experiment Design Proton Beam

705 views • 42 slides