machine learning for complex event recognition
play

Machine Learning for Complex Event Recognition Nikos Katzouris 1 , - PowerPoint PPT Presentation

Oct 16, 2022 •164 likes •774 views

Machine Learning for Complex Event Recognition Nikos Katzouris 1 , Alexander Artikis 1 , Georgios Paliouras 1 http://cer.iit.demokritos.gr 1 NCSR Demokritos, Athens, Greece Team Members Tenured Researcher: Georgios Paliouras Research

  1. Machine Learning for Complex Event Recognition Nikos Katzouris 1 , Alexander Artikis 1 , Georgios Paliouras 1 http://cer.iit.demokritos.gr 1 NCSR Demokritos, Athens, Greece

  2. Team Members Tenured Researcher: ◮ Georgios Paliouras Research Associates: ◮ Elias Alevizos ◮ Alexander Artikis ◮ Nikos Katzouris ◮ Ioannis Kontopoulos ◮ Vagelis Michelioudakis ◮ Efthimis Tsilionis ◮ Christos Vlassopoulos Website: ◮ http://cer.iit.demokritos.gr

  3. Complex Event Recognition Input ◮ Recognition ◮ Output � . . . . . . . . . . . . Event Simple Events Recognition Complex Events System . . . . . . . . . . . . happensAt( active ( id 0 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 11 ) holdsAt( coord ( id 0 , 20 . 88 , 11 . 90 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 12 ) happensAt( active ( id 1 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 13 ) holdsAt( coord ( id 1 , 22 . 34 , 15 . 23 ) , 10 ) . . . Complex . . . Event Definitions

  4. Complex Event Recognition

  5. Complex Event Recognition Input ◮ Recognition ◮ Output � . . . . . . . . . . . . Event Simple Events Recognition Complex Events System . . . . . . . . . . . . happensAt( active ( id 0 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 11 ) holdsAt( coord ( id 0 , 20 . 88 , 11 . 90 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 12 ) happensAt( active ( id 1 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 13 ) holdsAt( coord ( id 1 , 22 . 34 , 15 . 23 ) , 10 ) . . . Complex . . . Event Definitions initiatedAt( meeting ( X , Y ) , T ) ← happensAt( active ( X ) , T ) , happensAt( active ( Y ) , T ) , holdsAt( close ( X , Y , 25 ) , T ) . terminatedAt( meeting ( X , Y ) , T ) ← happensAt( walking ( X ) , T ) , not holdsAt( close ( X , Y , 25 ) , T ) .

  6. Complex Event Recognition Input ◮ Recognition ◮ Output � . . . . . . . . . . . . Event Simple Events Recognition Complex Events System . . . . . . . . . . . . happensAt( active ( id 0 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 11 ) holdsAt( coord ( id 0 , 20 . 88 , 11 . 90 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 12 ) happensAt( active ( id 1 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 13 ) holdsAt( coord ( id 1 , 22 . 34 , 15 . 23 ) , 10 ) . . . Complex . . . Event Definitions initiatedAt( meeting ( X , Y ) , T ) ← happensAt( active ( X ) , T ) , happensAt( active ( Y ) , T ) , holdsAt( close ( X , Y , 25 ) , T ) . terminatedAt( meeting ( X , Y ) , T ) ← happensAt( walking ( X ) , T ) , not holdsAt( close ( X , Y , 25 ) , T ) .

  7. Complex Event Recognition Input ◮ Recognition ◮ Output � . . . . . . . . . . . . Event Simple Events Recognition Complex Events System . . . . . . . . . . . . happensAt( active ( id 0 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 11 ) holdsAt( coord ( id 0 , 20 . 88 , 11 . 90 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 12 ) happensAt( active ( id 1 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 13 ) holdsAt( coord ( id 1 , 22 . 34 , 15 . 23 ) , 10 ) . . . Complex . . . Event Definitions initiatedAt( meeting ( X , Y ) , T ) ← happensAt( active ( X ) , T ) , happensAt( active ( Y ) , T ) , holdsAt( close ( X , Y , 25 ) , T ) . terminatedAt( meeting ( X , Y ) , T ) ← happensAt( walking ( X ) , T ) , not holdsAt( close ( X , Y , 25 ) , T ) .

  8. Learning for Complex Event Recognition Input ◮ Recognition ◮ Output � . . . . . . . . . . . . Event Simple Events Complex Events Recognition System . . . . . . . . . . . . happensAt( active ( id 0 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 11 ) holdsAt( coord ( id 0 , 20 . 88 , 11 . 90 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 12 ) happensAt( active ( id 1 ) , 10 ) holdsAt( meeting ( id 0 , id 1 ) , 13 ) holdsAt( coord ( id 1 , 22 . 34 , 15 . 23 ) , 10 ) . . . Complex . . . Event Definitions initiatedAt( meeting ( X , Y ) , T ) ← happensAt( active ( X ) , T ) , happensAt( active ( Y ) , T ) , holdsAt( close ( X , Y , 25 ) , T ) . Learn this terminatedAt( meeting ( X , Y ) , T ) ← happensAt( walking ( X ) , T ) , From These not holdsAt( close ( X , Y , 25 ) , T ) .

  9. Applications City Transport Management SENSOR RESOURCE DATA NETWORK & DIGITAL MAPS IRM Demonstrator SENSOR & GEO DATA PROCESSING EVENT RECOGNITION INFORMATION EXTRACTION Driver Driver Actual Training/ Debriefing Operation Operator Operator Control Centre High-Level Data Events Low-level Communication Events

  10. Complex Event Recognition using the Event Calculus ◮ Formal, declarative semantics. ◮ Representation of complex temporal phenomena. ◮ Representation of complex atemporal phenomena. ◮ Very efficient reasoning → RTEC.

  11. Complex Event Recognition using the Event Calculus ◮ Formal, declarative semantics. ◮ Representation of complex temporal phenomena. ◮ Representation of complex atemporal phenomena. ◮ Very efficient reasoning → RTEC. ◮ Direct connections to machine learning → Inductive Logic Programming (ILP).

  12. Inductive Logic Programming ◮ Input: ◮ Positive and negative examples. ◮ Background knowledge. ◮ Language bias. ◮ Output: ◮ A logical theory that entails as many positive and as few negative examples as possible.

  13. Search Space for Rule Learning Top Rule ⊤ : initiatedAt( meet ( X , Y ) , T ) ← ... initiatedAt( meet ( X , Y ) , T ) ← initiatedAt( meet ( X , Y ) , T ) ← initiatedAt( meet ( X , Y ) , T ) ← happensAt( active ( X ) , T ) . happensAt( inactive ( Y ) , T ) . holdsAt( orientation ( X , Y , 45 ) , T ) . Rules generated by initiatedAt( meet ( X , Y ) , T ) ← initiatedAt( meet ( X , Y ) , T ) ← . . . . . . adding one condition from happensAt( active ( X ) , T ) , happensAt( active ( X ) , T ) , happensAt( inactive ( Y ) , T ) . holdsAt( close ( X , Y , 25 ) , T ) . ⊥ to the body of ⊤ initiatedAt( meet ( X , Y ) , T ) ← . . . . . . happensAt( active ( X ) , T ) , happensAt( inactive ( Y ) , T ) , holdsAt( close ( X , Y , 25 ) , T ) . . . . . . . . . . . . . . . . initiatedAt( meet ( X , Y ) , T ) ← happensAt( active ( X ) , T ) , happensAt( inactive ( Y ) , T ) , holdsAt( close ( X , Y , 25 ) , T ) , holdsAt( close ( Y , X , 25 ) , T ) , not happensAt( inactive ( X ) , T ) , not happensAt( abrupt ( X ) , T ) , Bottom Rule ⊥ : not happensAt( running ( X ) , T ) , happensAt( inactive ( Y ) , T ) , not happensAt( active ( Y ) , T ) , not happensAt( running ( Y ) , T ) , not happensAt( abrupt ( Y ) , T ) , holdsAt( orientation ( X , Y , 45 ) , T ) .

  14. Search Space for Rule Learning Top Rule ⊤ : initiatedAt( meet ( X , Y ) , T ) ← ... initiatedAt( meet ( X , Y ) , T ) ← initiatedAt( meet ( X , Y ) , T ) ← initiatedAt( meet ( X , Y ) , T ) ← happensAt( active ( X ) , T ) . happensAt( inactive ( Y ) , T ) . holdsAt( orientation ( X , Y , 45 ) , T ) . Rules generated by initiatedAt( meet ( X , Y ) , T ) ← initiatedAt( meet ( X , Y ) , T ) ← . . . . . . adding one condition from happensAt( active ( X ) , T ) , happensAt( active ( X ) , T ) , happensAt( inactive ( Y ) , T ) . holdsAt( close ( X , Y , 25 ) , T ) . ⊥ to the body of ⊤ initiatedAt( meet ( X , Y ) , T ) ← . . . . . . happensAt( active ( X ) , T ) , Ordered by θ -subsumption � : happensAt( inactive ( Y ) , T ) , holdsAt( close ( X , Y , 25 ) , T ) . If r 1 � r 2 then . . . covers( r 2 , e ) ⇒ covers( r 1 , e ) for all examples e . . . . . . . . . . . . initiatedAt( meet ( X , Y ) , T ) ← happensAt( active ( X ) , T ) , happensAt( inactive ( Y ) , T ) , holdsAt( close ( X , Y , 25 ) , T ) , holdsAt( close ( Y , X , 25 ) , T ) , not happensAt( inactive ( X ) , T ) , not happensAt( abrupt ( X ) , T ) , Bottom Rule ⊥ : not happensAt( running ( X ) , T ) , happensAt( inactive ( Y ) , T ) , not happensAt( active ( Y ) , T ) , not happensAt( running ( Y ) , T ) , not happensAt( abrupt ( Y ) , T ) , holdsAt( orientation ( X , Y , 45 ) , T ) .

  15. Learning a Rule: Search Positives Top Rule ⊤ : initiatedAt( meet ( X , Y ) , T ) ← not covered ... . . . initiatedAt( meet ( X , Y ) , T ) ← initiatedAt( meet ( X , Y ) , T ) ← happensAt( active ( X ) , T ) . happensAt( inactive ( Y ) , T ) . - - - ++ - Covered examples initiatedAt( meet ( X , Y ) , T ) ← initiatedAt( meet ( X , Y ) , T ) ← - - - happensAt( active ( X ) , T ) , happensAt( active ( X ) , T ) , + + happensAt( inactive ( Y ) , T ) . holdsAt( close ( X , Y , 25 ) , T ) . - - + + + - + + initiatedAt( meet ( X , Y ) , T ) ← + - - . . . + + happensAt( active ( X ) , T ) , + - - + + - happensAt( inactive ( Y ) , T ) , + + - + + - holdsAt( close ( X , Y , 25 ) , T ) . + . . . - + . . . . . . + + initiatedAt( meet ( X , Y ) , T ) ← happensAt( active ( X ) , T ) , happensAt( inactive ( Y ) , T ) , holdsAt( close ( X , Y , 25 ) , T ) , holdsAt( close ( Y , X , 25 ) , T ) , not happensAt( inactive ( X ) , T ) , not happensAt( abrupt ( X ) , T ) , Bottom Rule ⊥ : not happensAt( running ( X ) , T ) , happensAt( inactive ( Y ) , T ) , not happensAt( active ( Y ) , T ) , not happensAt( running ( Y ) , T ) , not happensAt( abrupt ( Y ) , T ) , holdsAt( orientation ( X , Y , 45 ) , T ) .

Recommend

Online Learning of Weighted Relational Rules for Complex Event Recognition Nikos Katzouris 1

Online Learning of Weighted Relational Rules for Complex Event Recognition Nikos Katzouris 1

Online Learning of Weighted Relational Rules for Complex Event Recognition Nikos Katzouris 1 ,Evangelos Michelioudakis 3,1 , Alexander Artikis 2,1 and Georios Paliouras 1 http://cer.iit.demokritos.gr 1 National Center for Scientific Research

803 views • 19 slides
Online Learning of Weighted Relational Rules for Complex Event Recognition Nikos Katzouris 1 ,

Online Learning of Weighted Relational Rules for Complex Event Recognition Nikos Katzouris 1 ,

Online Learning of Weighted Relational Rules for Complex Event Recognition Nikos Katzouris 1 , Alexander Artikis 2,1 and Georios Paliouras 1 http://cer.iit.demokritos.gr 1 National Center for Scientific Research Demokritos, Athens, Greece 2

158 views • 12 slides
Event Extraction Event Template for Terrorist Acts OUTPUT: filled event INPUT: document

Event Extraction Event Template for Terrorist Acts OUTPUT: filled event INPUT: document

Event Extraction Event Roles vs. Named Entity Recognition Identifying descriptions of complex events and extracting the role fillers associated with each Named Entity Recognition = identifying types of entities incident. Event Roles =

341 views • 12 slides
Big Data for Data Science Scalable Machine Learning event.cwi.nl/lsde A SHORT INTRODUCTION TO

Big Data for Data Science Scalable Machine Learning event.cwi.nl/lsde A SHORT INTRODUCTION TO

Big Data for Data Science Scalable Machine Learning event.cwi.nl/lsde A SHORT INTRODUCTION TO NEURAL NETWORKS credits: cs231n.stanford.edu; Fei-Fei Li, Justin Johnson, Serena Yeung event.cwi.nl/lsde Example: Image Recognition Input Image

1.06k views • 75 slides
Complex Event Recognition in the Big Data Era Nikos Giatrakos 1 , Alexander Artikis 2 , 3 ,

Complex Event Recognition in the Big Data Era Nikos Giatrakos 1 , Alexander Artikis 2 , 3 ,

Tutorial: Complex Event Recognition in the Big Data Era Nikos Giatrakos 1 , Alexander Artikis 2 , 3 , Antonios Deligiannakis 1 , Minos Garofalakis 1,4 1 Technical University of Crete, Chania, Greece 2 University of Piraeus, Greece 3 NCSR

1.1k views • 98 slides
Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine

Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine

Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine Learning? What is Machine Learning? Examples of machine learning applications: Facial recognition software E-mail spam detectors Automated

302 views • 17 slides
Machine learning and event classification SOTARRIVA ALVAREZ ISAI ROBERTO Advisor Dr. Antonio

Machine learning and event classification SOTARRIVA ALVAREZ ISAI ROBERTO Advisor Dr. Antonio

Machine learning and event classification SOTARRIVA ALVAREZ ISAI ROBERTO Advisor Dr. Antonio Ortiz Velasquez 1 MACHINE LEARNING APPLIED TO EVENT CLASSIFICATION Motivation Jet like Sphere like OR Machine learning (low spherocity) (High

301 views • 14 slides
Introduction to Machine Learning Machine Perception An Example Pattern Recognition Systems The

Introduction to Machine Learning Machine Perception An Example Pattern Recognition Systems The

Introduction to Machine Learning Machine Perception An Example Pattern Recognition Systems The Design Cycle Learning and Adaptation 1 Questions What is

1.2k views • 72 slides
Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning?

Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning?

CS6501: Deep Learning for Visual Recognition Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning? Supervised Learning: Classification with K-nearest neighbors Unsupervised Learning: Clustering with

1.36k views • 91 slides
Machine Learning & Object Recognition 2016 - 2017 Cordelia Schmid Jakob Verbeek Content of

Machine Learning & Object Recognition 2016 - 2017 Cordelia Schmid Jakob Verbeek Content of

Machine Learning & Object Recognition 2016 - 2017 Cordelia Schmid Jakob Verbeek Content of the course Visual object recognition Machine learning Practical matters Online course information Schedule, slides, papers

799 views • 30 slides
Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult

Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult

MACHINE LEARNING MACHINE LEARNING Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult Children Detecting facial attributes He & Zhang, Pattern Recognition, 2011 Sony (Make Believe) Training set

914 views • 80 slides
Paraphrase Recognition Using Machine Learning to Combine Similarity Measures Prodromos

Paraphrase Recognition Using Machine Learning to Combine Similarity Measures Prodromos

Paraphrase Recognition Using Machine Learning to Combine Similarity Measures Prodromos Malakasiotis Department of Informatics Athens University of Economics and Business Paraphrase Recognition Given a pair of phrases, sentences, or

419 views • 19 slides
Higgs Machine Learning Challenge experience. A HEP pattern recognition challenge ? David

Higgs Machine Learning Challenge experience. A HEP pattern recognition challenge ? David

Higgs Machine Learning Challenge experience. A HEP pattern recognition challenge ? David Rousseau LAL-Orsay 10th February 2015 CTD 2015, Berkeley Outline q Machine Learning, Challenges q The Higgs Machine Learning challenge q A

738 views • 57 slides
Event Recognition by Learning Amir Habibian Qualcomm Research, Amsterdam 27 Feb 2017 1 What is

Event Recognition by Learning Amir Habibian Qualcomm Research, Amsterdam 27 Feb 2017 1 What is

Event Recognition by Learning Amir Habibian Qualcomm Research, Amsterdam 27 Feb 2017 1 What is an event? Interaction of people and objects under a certain scene Event Object People Examples Actio Scene n Personal events: marriage

636 views • 44 slides
PRLab TUDelft NL PATTERN RECOGNITION & MACHINE LEARNING An Introduction Marco Loog

PRLab TUDelft NL PATTERN RECOGNITION & MACHINE LEARNING An Introduction Marco Loog

PRLab TUDelft NL PATTERN RECOGNITION & MACHINE LEARNING An Introduction Marco Loog Pattern Recognition Laboratory Delft University of Technology PRLab TUDelft NL What These Lectures Will Cover Intro to supervised learning and

707 views • 42 slides
This Lecture Classification Machine Learning and Pattern Recognition Now we focus on

This Lecture Classification Machine Learning and Pattern Recognition Now we focus on

This Lecture Classification Machine Learning and Pattern Recognition Now we focus on classfication . Weve already seen the naive Bayes classifier. This time: An alternative classification family, discriminative methods Chris Williams

398 views • 5 slides
Machine learning at LHC LHC Dr. Leonid Serkin (ICTP/Udine/CERN) 1 Introduction 2 Event

Machine learning at LHC LHC Dr. Leonid Serkin (ICTP/Udine/CERN) 1 Introduction 2 Event

Machine learning at LHC LHC Dr. Leonid Serkin (ICTP/Udine/CERN) 1 Introduction 2 Event classification problem (applied to HEP) The question: what decision boundary should we use to accept/reject events as belonging to event types H1, H2

532 views • 18 slides
Machine Learning in Speech Recognition Chao Zhang 7 March 2013 Cambridge University Engineering

Machine Learning in Speech Recognition Chao Zhang 7 March 2013 Cambridge University Engineering

Machine Learning in Speech Recognition Chao Zhang 7 March 2013 Cambridge University Engineering Department Machine Learning Research and Communication Club, March 2013 Toshiba Presentation Overview Characteristics of the Speech Signal

138 views • 12 slides
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 2: PROBABILITY DISTRIBUTIONS Parametric

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 2: PROBABILITY DISTRIBUTIONS Parametric

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 2: PROBABILITY DISTRIBUTIONS Parametric Distributions Basic building blocks: Need to determine given Representation: or ? Recall Curve Fitting Binary Variables (1) Coin

1.33k views • 86 slides
Optimization Machine Learning and Pattern Recognition Chris Williams School of Informatics,

Optimization Machine Learning and Pattern Recognition Chris Williams School of Informatics,

Optimization Machine Learning and Pattern Recognition Chris Williams School of Informatics, University of Edinburgh October 2014 (These slides have been adapted from previous versions by Charles Sutton, Amos Storkey, David Barber, and from Sam

548 views • 32 slides
Basics on generative and discriminative classification Machine Learning and Object Recognition

Basics on generative and discriminative classification Machine Learning and Object Recognition

Basics on generative and discriminative classification Machine Learning and Object Recognition 2016-2017 Jakob Verbeek Course website: http://thoth.inrialpes.fr/~verbeek/MLOR.16.17 Practical matters Online course information Updated

1.2k views • 61 slides
Probability Machine Learning and Pattern Recognition Chris Williams School of Informatics,

Probability Machine Learning and Pattern Recognition Chris Williams School of Informatics,

Probability Machine Learning and Pattern Recognition Chris Williams School of Informatics, University of Edinburgh August 2014 (All of the slides in this course have been adapted from previous versions by Charles Sutton, Amos Storkey, David

753 views • 31 slides
Clustering with k-means and Gaussian mixture distributions Machine Learning and Object Recognition

Clustering with k-means and Gaussian mixture distributions Machine Learning and Object Recognition

Clustering with k-means and Gaussian mixture distributions Machine Learning and Object Recognition 2016-2017 Jakob Verbeek Practical matters Online course information Schedule, slides, papers

439 views • 39 slides
MACHINE LEARNING Slide adapted from learning from data book and course, and Berkeley cs188 by Dan

MACHINE LEARNING Slide adapted from learning from data book and course, and Berkeley cs188 by Dan

MACHINE LEARNING Slide adapted from learning from data book and course, and Berkeley cs188 by Dan Klein, and Pieter Abbeel Machine Learning ?? Learning from data Tasks: Prediction Classification Recognition Focus on

691 views • 36 slides

More recommend