coupled bayesian sets algorithm for semi supervised
play

Coupled Bayesian Sets Algorithm for Semi-supervised Learning and - PowerPoint PPT Presentation

Nov 14, 2023 •213 likes •1.07k views

Coupled Bayesian Sets Algorithm for Semi-supervised Learning and Information Extraction Saurabh Verma Baranas Hindu University, India Estevam R. Hruschka Jr. F ederal University of So Carlos, Brazil ECML/PKDD2012

  1. Coupled Bayesian Sets Algorithm for Semi-supervised Learning and Information Extraction Saurabh Verma Baranas Hindu University, India Estevam R. Hruschka Jr. F ederal University of São Carlos, Brazil ECML/PKDD2012 Bristol, UK September, 26th, 2012

  2. http://rtw.ml.cmu.edu ECML/PKDD2012 Bristol, UK September, 26th, 2012

  3. NELL: Never-Ending Language Learner Inputs: l initial ontology l handful of examples of each predicate in ontology l the web l occasional interaction with human trainers The task: l run 24x7, forever • each day: 1. extract more facts from the web to populate the initial ontology 2. learn to read (perform #1) better than yesterday ECML/PKDD2012 Bristol, UK September, 26th, 2012

  4. NELL: Never-Ending Language Learner Goal: • run 24x7, forever • each day: 1. extract more facts from the web to populate given ontology 2. learn to read better than yesterday Today... Running 24 x 7, since January, 2010 Input: • ontology defining ~800 categories and relations • 10-20 seed examples of each • 1 billion web pages (ClueWeb – Jamie Callan) Result: • continuously growing KB with +1,300,000 extracted beliefs ECML/PKDD2012 Bristol, UK September, 26th, 2012

  5. http://rtw.ml.cmu.edu ECML/PKDD2012 Bristol, UK September, 26th, 2012

  6. Bayesian Sets (BS) Ghahramani & Heller; NIPS 2005 Given and , rank the elements of by D D { x } D c ⊂ D = how well they would “ fit into ” a set which includes D c Define a score for each : x D ∈ p ( x D ) c score ( x ) = p ( x ) From Bayes rule, the score can be re-written as: p ( x , D ) score ( x = ) c p ( x ) p ( D ) c

  7. Bayesian Sets (BS) Ghahramani & Heller; NIPS 2005 Intuitively, the score compares the probability that x and D c were generated by the same model with the same unknown parameters θ , to the probability that x and D c came from models with different parameters θ and θ ’ . p ( x , D ) c score ( x = ) p ( x ) p ( D ) c

  8. Bayesian Sets (BS) Ghahramani & Heller; NIPS 2005 Intuitively, the score compares the probability that x and D c were generated by the same model with the same unknown parameters θ , to the probability that x and D c came from models with different parameters θ and θ ’ . p ( x , D ) c score ( x = ) p ( x ) p ( D ) c

  9. Bayesian Sets (BS) Ghahramani & Heller; NIPS 2005 Intuitively, the score compares the probability that x and D c were generated by the same model with the same unknown parameters θ , to the probability that x and D c came from models with different parameters θ and θ ’ . p ( x , D ) c score ( x = ) p ( x ) p ( D ) c

  10. Bayesian Sets (BS) Ghahramani & Heller; NIPS 2005 Intuitively, the score compares the probability that x and D c were generated by the same model with the same unknown parameters θ , to the probability that x and D c came from models with different parameters θ and θ ’ . p ( x , D ) c score ( x = ) p ( x ) p ( D ) c

  11. BS using NELL’s Ontology Initial ontology: Everything Company Person Sport Vegetable ECML/PKDD2012 Bristol, UK September, 26th, 2012

  12. BS using NELL’s Ontology Initial ontology: Everything Company Person Sport City Apple Peter Flach Basketball Bristol Microsoft Bill Clinton Football Pittsburgh Google Jeremy Lin Swimming Rio de Janeiro IBM Adele Tennis Tokyo Yahoo Barak Obama Golf Cape Town ECML/PKDD2012 Bristol, UK September, 26th, 2012

  13. BS using NELL’s Ontology Given a huge web corpus, run BS once Everything Company Person Sport City Apple Peter Flach Basketball Bristol Microsoft Bill Clinton Football Pittsburgh Google Jeremy Lin Swimming Rio de Janeiro IBM Adele Tennis Tokyo Yahoo Barak Obama Golf Cape Town ECML/PKDD2012 Bristol, UK September, 26th, 2012

  14. BS using NELL’s Ontology Given a huge web corpus, run BS once Everything Company Person Sport City Apple Peter Flach Basketball Bristol Microsoft Bill Clinton Football Pittsburgh Google Jeremy Lin Swimming Rio de Janeiro IBM Adele Tennis Tokyo Yahoo Barak Obama Golf Cape Town AT&T Dalai Lama Soccer New York Boeing Freud Volleyball London Brazil Telecom Tom Mitchell Jogging Sao Paulo Texaco Aristotle Marathon Brisbane Facebook Alan Turing Baseball Beijing DELL Alexander Fleming Badminton Cairo … … … … ECML/PKDD2012 Bristol, UK September, 26th, 2012

  15. BS using NELL’s Ontology ECML/PKDD2012 Bristol, UK September, 26th, 2012

  16. BS using NELL’s Ontology ECML/PKDD2012 Bristol, UK September, 26th, 2012

  17. BS using NELL’s Ontology ECML/PKDD2012 Bristol, UK September, 26th, 2012

  18. Iterative BS using NELL’s Ontology Zhang & Liu, 2011 Given a huge web corpus, iteratively run BS Everything Company Person Sport City Apple Peter Flach Basketball Bristol Microsoft Bill Clinton Football Pittsburgh Google Jeremy Lin Swimming Rio de Janeiro IBM Adele Tennis Tokyo Yahoo Barak Obama Golf Cape Town AT&T Dalai Lama Soccer New York Boeing Freud Volleyball London ECML/PKDD2012 Bristol, UK September, 26th, 2012

  19. Iterative BS using NELL’s Ontology Zhang & Liu, 2011 Given a huge web corpus, iteratively run BS Everything Company Person Sport City Apple Peter Flach Basketball Bristol Microsoft Bill Clinton Football Pittsburgh Google Jeremy Lin Swimming Rio de Janeiro IBM Adele Tennis Tokyo Yahoo Barak Obama Golf Cape Town AT&T Dalai Lama Soccer New York Boeing Freud Volleyball London Brazil Telecom Tom Mitchell Jogging Sao Paulo Texaco Aristotle Marathon Brisbane ECML/PKDD2012 Bristol, UK September, 26th, 2012

  20. Iterative BS using NELL’s Ontology Zhang & Liu, 2011 Given a huge web corpus, iteratively run BS Everything Company Person Sport City Apple Peter Flach Basketball Bristol Microsoft Bill Clinton Football Pittsburgh Google Jeremy Lin Swimming Rio de Janeiro IBM Adele Tennis Tokyo Yahoo Barak Obama Golf Cape Town AT&T Dalai Lama Soccer New York Boeing Freud Volleyball London Brazil Telecom Tom Mitchell Jogging Sao Paulo Texaco Aristotle Marathon Brisbane Facebook Alan Turing Baseball Beijing DELL Alexander Fleming Badminton Cairo … … … … ECML/PKDD2012 Bristol, UK September, 26th, 2012

  21. Iterative BS using NELL’s Ontology ECML/PKDD2012 Bristol, UK September, 26th, 2012

  22. Iterative BS using NELL’s Ontology ECML/PKDD2012 Bristol, UK September, 26th, 2012

  23. NELL: Coupled semi-supervised training of many functions ECML/PKDD2012 Bristol, UK September, 26th, 2012

  24. Coupled Training Type 2: Structured Outputs, Multitask, Posterior Regularization, Multilabel Learn functions with the same input, different outputs, where we know some constraint ECML/PKDD2012 Bristol, UK September, 26th, 2012

  25. Coupled Training Type 2: Structured Outputs, Multitask, Posterior Regularization, Multilabel Learn functions with the same input, different outputs, where we know some constraint ECML/PKDD2012 Bristol, UK September, 26th, 2012

  26. Coupled Training Type 2: Structured Outputs, Multitask, Posterior Regularization, Multilabel Learn functions with the same input, different outputs, where we know some constraint ECML/PKDD2012 Bristol, UK September, 26th, 2012

Recommend

Iterative Hybrid Algorithm for Semi-supervised Classification Martin SAVESKI Supervised by

Iterative Hybrid Algorithm for Semi-supervised Classification Martin SAVESKI Supervised by

Iterative Hybrid Algorithm for Semi-supervised Classification Martin SAVESKI Supervised by professor Thierry Arti` eres University Pierre and Marie Curie June 19, 2012 Martin SAVESKI Iterative Hybrid Algorithm for Semi-supervised

1.06k views • 26 slides
Coupled Semi-Supervised Learning for Information Extraction Andrew Carlson, Justin Betteridge,

Coupled Semi-Supervised Learning for Information Extraction Andrew Carlson, Justin Betteridge,

Coupled Semi-Supervised Learning for Information Extraction Andrew Carlson, Justin Betteridge, Richard C. Wang, Estevam R. Hruschka Jr. and Tom M. Mitchell Machine Learning Department Carnegie Mellon University February 4, 2010 Friday,

405 views • 24 slides
A Semi-Supervised Bayesian Network Model for Microblog Topic Classification Yan Chen 1 , 2 Zhoujun

A Semi-Supervised Bayesian Network Model for Microblog Topic Classification Yan Chen 1 , 2 Zhoujun

A Semi-Supervised Bayesian Network Model for Microblog Topic Classification Yan Chen 1 , 2 Zhoujun Li 1 Liqiang Nie 2 Xia Hu 3 Xiangyu Wang 2 Tat-seng Chua 2 Xiaoming Zhang 1 1 State Key Laboratory of Software Development Environment, Beihang

528 views • 49 slides
OUTLINE Introduction Supervised ,Unsupervised And Semi-Supervised Learning.

OUTLINE Introduction Supervised ,Unsupervised And Semi-Supervised Learning.

Presentation in A Bayesian Approach To Satellite Aircraft Image Identification Using Invariant Moments . Dickson Gichaga Wambaa F56/76676/2009 Supervised By Professor Elijah Mwangi University Of Nairobi Electrical And Information Engineering

322 views • 29 slides
Semi-Supervised Learning Maria-Florina Balcan 03/30/2015 Readings: Semi-Supervised Learning.

Semi-Supervised Learning Maria-Florina Balcan 03/30/2015 Readings: Semi-Supervised Learning.

Semi-Supervised Learning Maria-Florina Balcan 03/30/2015 Readings: Semi-Supervised Learning. Encyclopedia of Machine Learning. Jerry Zhu, 2010 Combining Labeled and Unlabeled Data with Co- Training. Avrim Blum, Tom Mitchell. COLT

953 views • 45 slides
Semi-Supervised Kernel Mean Shift Clustering A Semi-Supervised Clustering Approach Motivation:

Semi-Supervised Kernel Mean Shift Clustering A Semi-Supervised Clustering Approach Motivation:

Semi-Supervised Kernel Mean Shift Clustering A Semi-Supervised Clustering Approach Motivation: Need for Supervision Data may not form clusters in Mapping to Feature Space Constraint Vector Input Points Clustering Projection the input

307 views • 27 slides
Unsupervised and Semi-supervised Learning of Structure Graham Neubig Site

Unsupervised and Semi-supervised Learning of Structure Graham Neubig Site

CS11-747 Neural Networks for NLP Unsupervised and Semi-supervised Learning of Structure Graham Neubig Site https://phontron.com/class/nn4nlp2020/ Supervised, Unsupervised, Semi-supervised Most models handled here are supervised learning

580 views • 39 slides
Unsupervised and Semi-supervised Learning of Structure Graham Neubig Site

Unsupervised and Semi-supervised Learning of Structure Graham Neubig Site

CS11-747 Neural Networks for NLP Unsupervised and Semi-supervised Learning of Structure Graham Neubig Site https://phontron.com/class/nn4nlp2018/ Supervised, Unsupervised, Semi-supervised Most models handled here are supervised learning

670 views • 32 slides
CS330 Paper Presentation: October 16th, 2019 Supervised Classification Semi-Supervised

CS330 Paper Presentation: October 16th, 2019 Supervised Classification Semi-Supervised

CS330 Paper Presentation: October 16th, 2019 Supervised Classification Semi-Supervised Classification: More realistic dataset Labelled Unlabelled Semi-Supervised Classification Most biologically plausible learning regime A familiar

650 views • 46 slides
Support Vector Machines (SVMs). Semi-Supervised Learning. Semi-Supervised SVMs.

Support Vector Machines (SVMs). Semi-Supervised Learning. Semi-Supervised SVMs.

Support Vector Machines (SVMs). Semi-Supervised Learning. Semi-Supervised SVMs. Maria-Florina Balcan 03/25/2015 Support Vector Machines (SVMs). One of the most theoretically well motivated and practically most e ff ective

792 views • 40 slides
Particles Competition and Cooperation in Networks for Semi-Supervised Learning Fabricio Breve

Particles Competition and Cooperation in Networks for Semi-Supervised Learning Fabricio Breve

Particles Competition and Cooperation in Networks for Semi-Supervised Learning Fabricio Breve Department of Electrical & Computer Engineering University of Alberta Seminar - October 09, 2009 Contents Introduction Semi-Supervised

863 views • 40 slides
Semi-Supervised Local Fisher Semi-Supervised Local Fisher Discriminant Analysis Discriminant

Semi-Supervised Local Fisher Semi-Supervised Local Fisher Discriminant Analysis Discriminant

PAKDD2008 May 20-23, 2008 Semi-Supervised Local Fisher Semi-Supervised Local Fisher Discriminant Analysis Discriminant Analysis for Dimensionality Reduction for Dimensionality Reduction Masashi Sugiyama (Tokyo Tech.) Tsuyoshi Ide (IBM)

927 views • 36 slides
Tangent-Normal Adversarial Regularization for Semi-Supervised Learning Bing Yu , Jingfeng Wu

Tangent-Normal Adversarial Regularization for Semi-Supervised Learning Bing Yu , Jingfeng Wu

Tangent-Normal Adversarial Regularization for Semi-Supervised Learning Bing Yu , Jingfeng Wu , Jinwen Ma, Zhanxing Zhu Peking University Beijing Institute of Big Data Research June, 2019 Semi-supervised learning (SSL) Suppose we

201 views • 18 slides
Link prediction in graph construction for supervised and semi-supervised learning Lilian Berton,

Link prediction in graph construction for supervised and semi-supervised learning Lilian Berton,

Link prediction in graph construction for supervised and semi-supervised learning Lilian Berton, Jorge Valverde-Rebaza and Alneu de Andrade Lopes Laboratory of Computational Intelligence (LABIC) University of S ao Paulo (USP) Brazil July

398 views • 20 slides
Semi-supervised Transliteration Mining from Parallel and Comparable Corpora Walid Aransa, Holger

Semi-supervised Transliteration Mining from Parallel and Comparable Corpora Walid Aransa, Holger

Introduction Related work TM algorithm for parallel corpora TM algorithm for comparable corpora Conclusion Related work Semi-supervised Transliteration Mining from Parallel and Comparable Corpora Walid Aransa, Holger Schwenk, Loic Barrault

698 views • 39 slides
Author Identification Using Semi-supervised Learning Ioannis Kourtis and Efstathios Stamatatos

Author Identification Using Semi-supervised Learning Ioannis Kourtis and Efstathios Stamatatos

Author Identification Using Semi-supervised Learning Ioannis Kourtis and Efstathios Stamatatos University of the Aegean Outline Introduction The proposed method Common n-grams SVM Semi-supervised learning Evaluation

533 views • 17 slides
Parallelizing Semi- ReDAS Lab Supervised Learning Algorithms with MapReduce Nick Gauthier

Parallelizing Semi- ReDAS Lab Supervised Learning Algorithms with MapReduce Nick Gauthier

Parallelizing Semi- ReDAS Lab Supervised Learning Algorithms with MapReduce Nick Gauthier Advisor: Dr. Rakesh Verma COMPUTER SCIENCE Motivation Semi-supervised learning(SSL) algorithms are slow when working with large-scale data.

801 views • 14 slides
Semi-supervised Semantic Role Labeling Hagen Frstenau Department of Computational Linguistics

Semi-supervised Semantic Role Labeling Hagen Frstenau Department of Computational Linguistics

Frame Semantics A Semi-supervised approach to role labeling Summary Semi-supervised Semantic Role Labeling Hagen Frstenau Department of Computational Linguistics Saarland University (joint work with Mirella Lapata) FEAST meeting

594 views • 37 slides
Regularizing objective functionals in semi-supervised learning Dejan Slep cev Carnegie Mellon

Regularizing objective functionals in semi-supervised learning Dejan Slep cev Carnegie Mellon

Regularizing objective functionals in semi-supervised learning Dejan Slep cev Carnegie Mellon University February 9, 2018. . 1 / 47 References S.,Thorpe, Analysis of p-Laplacian regularization in semi-supervised learning , arxiv

742 views • 48 slides
Mutual information deep regularization for semi- supervised segmentation J. Peng, M. Pedersoli,

Mutual information deep regularization for semi- supervised segmentation J. Peng, M. Pedersoli,

MIDL 2020 presentation Mutual information deep regularization for semi- supervised segmentation J. Peng, M. Pedersoli, C. Desrosiers Outline We proposed a semi-supervised segmentation method for medical image regularized by Mutual Information

256 views • 13 slides
Classification Semi-supervised learning based on network Speakers: Hanwen Wang, Xinxin Huang, and

Classification Semi-supervised learning based on network Speakers: Hanwen Wang, Xinxin Huang, and

Classification Semi-supervised learning based on network Speakers: Hanwen Wang, Xinxin Huang, and Zeyu Li CS 249-2 2017 Winter Semi-Supervised Learning Using Gaussian Fields and Harmonic Functions Xiaojin Zhu, Zoubin Ghahramani, John Lafferty

625 views • 45 slides
Realistic Evaluation of Deep Semi-Supervised Learning Algorithms Avital Oliver* Augustus Odena*

Realistic Evaluation of Deep Semi-Supervised Learning Algorithms Avital Oliver* Augustus Odena*

Realistic Evaluation of Deep Semi-Supervised Learning Algorithms Avital Oliver* Augustus Odena* Colin Raffel* Ekin Dogus Cubuk Ian Goodfellow vs. Error rates for our reimplementation of different semi-supervised learning methods. Reported

212 views • 17 slides
Semi-Supervised Learning Jia-Bin Huang Virginia Tech Spring 2019 ECE-5424G / CS-5824

Semi-Supervised Learning Jia-Bin Huang Virginia Tech Spring 2019 ECE-5424G / CS-5824

Semi-Supervised Learning Jia-Bin Huang Virginia Tech Spring 2019 ECE-5424G / CS-5824 Administrative Advanced Topics Semi-supervised learning Ensemble learning Generative models Sequence prediction models Deep reinforcement

345 views • 18 slides
A semi-supervised approach to extracting multiword entity names from user reviews Olga

A semi-supervised approach to extracting multiword entity names from user reviews Olga

A semi-supervised approach to extracting multiword entity names from user reviews Olga Vechtomova ovechtom@uwaterloo.ca Introduction Semi-supervised approach to extracting entities (both single words and multiword units) of a specific

663 views • 25 slides

More recommend