SEMANTIC CLUSTERING OF QUESTIONS RESEARCH REPORT, 2 ND SEMESTER - PowerPoint PPT Presentation

Jul 12, 2023 •211 likes •329 views

SEMANTIC CLUSTERING OF QUESTIONS RESEARCH REPORT, 2 ND SEMESTER Cristina Groap Problem statement 2 Part of the Smart Presentation project Efficient management of audience feedback Question clustering: Suggest similar asked

SEMANTIC CLUSTERING OF QUESTIONS RESEARCH REPORT, 2 ND SEMESTER Cristina Groap ă
Problem statement 2  Part of the Smart Presentation project  Efficient management of audience feedback  Question clustering:  Suggest similar asked questions  Group all questions according to topic  Important: real-time process
Specificity 3  Specificity = Information Content  E.g. { collie, sheepdog} vs. { go, be}  Evaluation:  Taxonomy depth  Corpus-based  Combine with measures of semantic similarity for better results
Semantic Similarity Measures 4  Path-based  Leacock-Chodorow:  IC-based  Resnik:  Semantic Relatedness  Hirst-and-St.Onge:
NLP Tools 5  Stanford CoreNLP  LingPipe  Java Wordet::Similarity
Implementation 6
Results 7  143 questions ~ 8 min (dualCore 2GHz processor, 3GB RAM)  Good:  Bad:
Results (2) 8  Good and bad:
Future work 9  Test on real data  Increase weight on NERs compared to common nouns  Introduce specificity  Word Sense Disambiguation
Thank you 10  Questions?

Recommend

Outline Linkage-based Clustering Motivation Definitions Clustering with Semantic

Outline Linkage-based Clustering Motivation Definitions Clustering with Semantic Links Applications Algorithms SimRank Yin X., Han J. and Yu P. S., 2006, LinkClus: Efficient ReCoM Clustering via Heterogeneous

221 views • 8 slides

Informational and Computational Limits of Clustering and other questions about clustering Nati

Informational and Computational Limits of Clustering and other questions about clustering Nati Srebro University of Toronto based on work in progress with Gregory Shakhnarovich Sam Roweis Brown University University of Toronto

657 views • 30 slides

Lecture 23: Spectral clustering Hierarchical clustering What is a good clustering?

Lecture 23: Spectral clustering Hierarchical clustering What is a good clustering? Aykut Erdem May 2016 Hacettepe University Last time K-Means An iterative clustering algorithm - Initialize: Pick K random points as cluster

932 views • 64 slides

Clustering Hierarchical clustering, k-mean clustering Genome 559: Introduction to Statistical and

Clustering Hierarchical clustering, k-mean clustering Genome 559: Introduction to Statistical and Computational Genomics Elhanan Borenstein A quick review The clustering problem: partition genes into distinct sets with high homogeneity

772 views • 40 slides

SEMANTIC CLUSTERING AND SPATIAL HYPERTEXT CMSC-676 - Pranav Ganore INTRODUCTION: Spatial

SEMANTIC CLUSTERING AND SPATIAL HYPERTEXT CMSC-676 - Pranav Ganore INTRODUCTION: Spatial Hypertext Hypertext is text which contains links to other texts. The term was coined by Ted Nelson around 1965. What is its most famous

475 views • 15 slides

Graph Clustering Graph Clustering What is clustering? What is clustering? Finding patterns

Graph Clustering Graph Clustering What is clustering? What is clustering? Finding patterns in data, or grouping similar groups of data-points together into clusters . Clustering algorithms for numeric data: Lloyds K-means, EM

688 views • 19 slides

Clustering: evolution of methods to meet new challenges C. Biernacki ee Clustering, Orange

Introduction Methods & questions Model-based clustering Illustrations Challenges Clustering: evolution of methods to meet new challenges C. Biernacki ee Clustering, Orange Labs, October 20 th 2015 Journ 1/54 Introduction

1.13k views • 54 slides

Clustering Hierarchical clustering and k-mean clustering Genome 373 Genomic Informatics

Clustering Hierarchical clustering and k-mean clustering Genome 373 Genomic Informatics Elhanan Borenstein A quick review The clustering problem: partition genes into distinct sets with high homogeneity and high separation Many

768 views • 43 slides

Clustering DSE 210 Clustering in R d Two common uses of clustering: Vector quantization Find

Clustering DSE 210 Clustering in R d Two common uses of clustering: Vector quantization Find a finite set of representatives that provides good coverage of a complex, possibly infinite, high-dimensional space. Finding meaningful

396 views • 36 slides

Clustering: Hierarchical Clustering and K- Means Clustering Machine

Clustering: Hierarchical Clustering and K- Means Clustering Machine Learning 10-601B Seyoung Kim Many of these slides are derived from William Cohen,

660 views • 46 slides

Questions (and Answers) on the Semantic Web $Date: 2006/11/25 13:37:12 $ Ivan Herman, W3C Ivan

Questions (and Answers) on the Semantic Web $Date: 2006/11/25 13:37:12 $ Ivan Herman, W3C Ivan Herman, W3C We all know that, right? The Semantic Web Artificial Intelligence on the Web It relies on centrally controlled ontologies for

1.5k views • 85 slides

Clustering and Dimensionality Reduction Preview Clustering K -means clustering

Clustering and Dimensionality Reduction Preview Clustering K -means clustering Mixture models Hierarchical clustering Dimensionality reduction Principal component analysis Multidimensional scaling Isomap

1.61k views • 17 slides

Questions (and Answers) on the Semantic Web Oslo, Norway, 2006-09-20 Ivan Herman, W3C Ivan

Questions (and Answers) on the Semantic Web Oslo, Norway, 2006-09-20 Ivan Herman, W3C Ivan Herman, W3C We all know that, right? The Semantic Web Artificial Intelligence on the Web It relies on centrally controlled ontologies for meaning

1.34k views • 82 slides

Semantic Web 2008 Se a t c eb 008 Semantic Web ca. 2008 S ti W b 2008 Semantic Web

Semantic Web 2008 Se a t c eb 008 Semantic Web ca. 2008 S ti W b 2008 Semantic Web companies starting & growing Siderean, SandPiper, SiberLogic, Ontology Works, Intellidimension, Intellisophic, TopQuadrant, Data Grid, Mondeca,

481 views • 23 slides

Clustering A Categorization of Major Clustering Methods Partitioning Methods

Clustering What is Clustering? Types of Data in Cluster Analysis Clustering A Categorization of Major Clustering Methods Partitioning Methods Hierarchical Methods 1 2 What is Clustering? What is Clustering? Typical

647 views • 18 slides

Questions (and Answers) on the Semantic Web XML-Days, Berlin, Germany, 2006-09-20 Ivan Herman,

Questions (and Answers) on the Semantic Web XML-Days, Berlin, Germany, 2006-09-20 Ivan Herman, W3C Ivan Herman, W3C We all know that, right? The Semantic Web Artificial Intelligence on the Web It relies on centrally controlled ontologies for

1.13k views • 76 slides

Subspace Clustering Ensemble Clustering Subspace Clustering, Ensemble Clustering, Alternative

LUDWIG- MAXIMILIANS- INSTITUTE DATABASE UNIVERSITT FOR SYSTEMS MNCHEN MNCHEN INFORMATICS INFORMATICS GROUP GROUP Subspace Clustering Ensemble Clustering Subspace Clustering, Ensemble Clustering, Alternative Clustering, Multiview

513 views • 9 slides

. . How would you group . . . . . . . . . . The price of crude oil has

12/11/17 What is Clustering? Clustering: k-means, Expectation-Maximization Given some instances of data: group them such that Ethics: Ethical Questions in AI Examples within a group are similar Examples in different groups are

238 views • 6 slides

What the #%*&! is the Semantic Web? The Semantic Web is a collaborative movement led by

What the #%*&! is the Semantic Web? The Semantic Web is a collaborative movement led by international standards body the World Wide Web Consortium (W3C).[1] ... By encouraging the inclusion of semantic content in web pages, the

578 views • 44 slides

Finding Clusters Types of Clustering Approaches: Linkage Based, e.g. Hierarchical Clustering

Finding Clusters Types of Clustering Approaches: Linkage Based, e.g. Hierarchical Clustering Clustering by Partitioning, e.g. k-Means Density Based Clustering, e.g. DBScan Grid Based Clustering Compendium slides for Guide to Intelligent

1.32k views • 82 slides

Introduction to Machine Learning, Clustering and EM Barnab s P czos Contents Clustering

Introduction to Machine Learning, Clustering and EM Barnab s P czos Contents Clustering K-means Mixture of Gaussians Expectation Maximization Variational Methods 2 Clustering 3 K- means clustering What is clustering?

1.32k views • 66 slides

Semantic Similarity MultiJEDI ERC 259234 Semantic Similarity Semantic Similarity Mostly

SemEval 2014 Task-3 Cross-Level Semantic Similarity MultiJEDI ERC 259234 Semantic Similarity Semantic Similarity Mostly focused on similar types of lexical items Semantic Similarity What if we have different types of inputs? CLSS:

971 views • 47 slides

PAC-Bayesian Analysis of Co-clustering, Graph Clustering and Pairwise Clustering Yevgeny Seldin

PAC-Bayesian Analysis of Co-clustering, Graph Clustering and Pairwise Clustering Yevgeny Seldin Motivation Example Clustering cannot be analyzed without specifying what it will be used for! be used for! Example Cluster then pack

293 views • 28 slides

Clustering kMeans, Expectation Maximization, Self-Organizing Maps Outline K-means

Clustering kMeans, Expectation Maximization, Self-Organizing Maps Outline K-means clustering Hierarchical clustering Incremental clustering Probability-based clustering Self-Organising Maps Classification vs. Clustering

1k views • 67 slides