text mining workshop
play

Text Mining Workshop LUCDH Studium Digitale A. Brandsen 25-09-2020 - PowerPoint PPT Presentation

Nov 17, 2023 •132 likes •489 views

Text Mining Workshop LUCDH Studium Digitale A. Brandsen 25-09-2020 1 Discover the world at Leiden University Discover the world at Leiden University Hello! I am Alex Brandsen PhD candidate at the Faculty of Archaeology / DSRP

  1. Text Mining Workshop LUCDH Studium Digitale A. Brandsen 25-09-2020 1 Discover the world at Leiden University Discover the world at Leiden University

  2. Hello! I am Alex Brandsen PhD candidate at the Faculty of Archaeology / DSRP @alex_brandsen 2 2 Discover the world at Leiden University

  3. Discover the world at Leiden University

  4. What is Text Mining? Deriving information from semi- or unstructured text collections • Search engines • Spam filters • Translation • Turnitin • Customer service 4 Discover the world at Leiden University

  5. Today’s Topics • Challenges of text data • Pre-processing of text • Tasks involving text data 5 Discover the world at Leiden University

  6. After this lecture... • You can list the challenges of processing text data • You can motivate and describe the most common text pre- processing steps: - tokenisation - lowercasing - stopword removal • You can conceptually explain text classification as a supervised learning task 6 Discover the world at Leiden University

  7. Introduction: Challenges 7 Discover the world at Leiden University

  8. Challenges of Processing Text Data Can you think of any challenges / problems specific to text data? 8 Discover the world at Leiden University

  9. Textual Data is Unstructured Or at best semi-structured: 9 Discover the world at Leiden University

  10. Textual Data can be Multi-Lingual • Dat is best wel een big deal • Oh my god , die jurk is fantastisch • Me, when lezers meteen aan de slag gaan met iets dat ze op mijn blog hebben gespot: 😮 • DUO: “ Hoi Valentina, we would advise you to delete your tweet with your burgerservicenummer .” • Waarschijnlijk is dat seksistische beeld gwn zo ingrained into our society 10 Discover the world at Leiden University

  11. Textual Data is Noisy • Optical Character Recognition (OCR): printed text to digital text • Special characters • Spelling errors 11 Discover the world at Leiden University

  12. Preprocessing 12 Discover the world at Leiden University

  13. PreProcessing: from Raw Text to Features CLEAN & GATHER TOKENISE ANNOTATION NORMALISE Raw Clean Linguistically Documents Tokens text text annotated text FEATURE CREATION & SELECTION Features 13 Discover the world at Leiden University

  14. Tokenisation Cutting a collection of characters (sentence) into tokens (words) Mr._O'Neill_thinks_that_Germany's_capital_isn’t_busy. Mr . O'Neill thinks that Germany 's capital is not busy . 14 Discover the world at Leiden University

  15. Lowercasing Sometimes useful, depends on application Mr . O'Neill thinks that Germany 's capital is not busy . mr . o'neill thinks that germany 's capital is not busy . 15 Discover the world at Leiden University

  16. Removing Stopwords Common words aren’t “useful” in analysis: mr . o'neill thinks that germany 's capital is not busy . mr . o'neill thinks germany capital busy . 16 Discover the world at Leiden University

  17. Removing inflections Lemmatization Stemming Use morphological analysis Cut off end • Apples → apple • Apples → apple • Studied → studi • studied → study 17 Discover the world at Leiden University

  18. Tasks Involving Text Data • Text classification - input is collection of texts, output is label(s) per text - spam categorisation • Sequence labelling - input is text, output is sequence of labels - named entity tagging • Sequence-to-sequence learning - input is text, output is text - machine translation 18 Discover the world at Leiden University

  19. (Un)supervised Machine Learning Supervised: • training data is labelled • output is labels • “spam or not?” Unsupervised: • training data has no labels • output is clusters • “these two documents look alike” • “this group of texts has the same topic” 19 Discover the world at Leiden University

  20. Classification 20 Discover the world at Leiden University

  21. Classification Texts -> labels Emails -> spam or not News item -> news category New article -> relevant to you or not (researchgate / academia) Review -> positive or negative 21 Discover the world at Leiden University

  22. Classification with Machine Learning Doc id Content Class 1 request urgent interest urgent Spam 2 assistance low interest deposit Spam Examples for machine learning 3 symposium defense june Ham 4 notas symposium deadline june Ham New unlabeled email, predict class 5 registration assistance symposium deadline ? Neutral Spam Ham Ham Ham! Machine Learning algorithm calculates probability of an email being spam based on how ‘spammy’ the words in the email are (spammyness calculated by looking at distribution of words over the spam and ham categories) 22 Discover the world at Leiden University

  23. Precision and Recall • Precision: How many of the positive predictions were correct? - How many predicted spam emails are actually spam? • Recall: How many of the positive documents did you retrieve? - How many of the spam emails did you catch? • F1: Harmonic mean of precision and recall - How well does my model perform in general? 23 Discover the world at Leiden University

  24. Sentiment Analysis Example Let’s look at some statements! Unicorns are awesome Finding unicorns is difficult 24 Discover the world at Leiden University

  25. Sentiment Analysis Example Tokenize! Unicorns are awesome Finding unicorns is difficult 25 Discover the world at Leiden University

  26. Sentiment Analysis Example Lower case! unicorns are awesome finding unicorns is difficult 26 Discover the world at Leiden University

  27. Sentiment Analysis Example Remove stopwords! unicorns are awesome finding unicorns is difficult 27 Discover the world at Leiden University

  28. Sentiment Analysis Example Add structure! unicorns awesome finding difficult sentiment unicorns 1 0 awesome 1 0 1 1 0 1 unicorns finding difficult Bag of words approach 28 Discover the world at Leiden University

  29. After this lecture... • You can list the challenges of processing text data • You can motivate and describe the most common text pre- processing steps: - tokenisation - lowercasing - stopword removal • You can conceptually explain text classification as a supervised learning task 29 Discover the world at Leiden University

  30. Tutorial 30 Discover the world at Leiden University

  31. What will we be doing? Get some movie reviews from IMDB 1. Clean the data 2. Look at the most frequent words 3. Sentiment analysis → :) or :( 4. 31 Discover the world at Leiden University

  32. Most frequent words 32 Discover the world at Leiden University

  33. Model performance 33 Discover the world at Leiden University

  34. Most important words for classifier ☹ ☺ 34 Discover the world at Leiden University

  35. Get started! Go to alexbrandsen.nl/tmtutorial/tutorial.pdf (or download from Kaltura) If you already have programming experience, you can also do these other tutorials: https://github.com/mchesterkadwell/bughunt-analysis https://github.com/alexbrandsen/Text-Analysis-for-Humanities-research (In both tutorials you can click the Binder button to start a Python notebook in your browser, no installation required.) 35 Discover the world at Leiden University

Recommend

Text Mining Text Mining Web pages Emails Technical documents Corporate documents

Text Mining Text Mining Web pages Emails Technical documents Corporate documents

Motivation for Text Mining Motivation for Text Mining Approximately 90% of the Worlds data is held in unstructured formats Text Mining Text Mining Web pages Emails Technical documents Corporate documents Books

456 views • 9 slides
Contents Text Mining Concept Tasks Twitter Data Analysis with R Twitter Extracting Tweets

Contents Text Mining Concept Tasks Twitter Data Analysis with R Twitter Extracting Tweets

Text Mining with R Yanchang Zhao http://www.RDataMining.com R and Data Mining Course Beijing University of Posts and Telecommunications, Beijing, China July 2019 Chapter 10: Text Mining, in R and Data Mining: Examples and Case Studies

904 views • 64 slides
Contents Text Mining Concept Tasks Twitter Data Analysis with R Twitter Extracting Tweets

Contents Text Mining Concept Tasks Twitter Data Analysis with R Twitter Extracting Tweets

Text Mining with R Yanchang Zhao http://www.RDataMining.com Tutorial on Machine Learning with R The Melbourne Data Science Week 2017 1 June 2017 Chapter 10: Text Mining, in R and Data Mining: Examples and Case Studies .

733 views • 57 slides
Text Mining with R Ben Williams 2018 Resources Text Mining with R: Julia Silge (StackOverflow)

Text Mining with R Ben Williams 2018 Resources Text Mining with R: Julia Silge (StackOverflow)

Text Mining with R Ben Williams 2018 Resources Text Mining with R: Julia Silge (StackOverflow) & David Robinson (DataCamp) https://www.tidytextmining.com/ R for Data Science: Garrett Grolemund & Hadley Wickham http://r4ds.had.co.nz/

866 views • 15 slides
Text Mining and Geo-referencing Historical Text Beatrice Alex Edinburgh Language Technology

Text Mining and Geo-referencing Historical Text Beatrice Alex Edinburgh Language Technology

Text Mining and Geo-referencing Historical Text Beatrice Alex Edinburgh Language Technology Group School of Informatics balex@inf.ed.ac.uk @bea_alex DCHRN Workshop Cultural Heritage Sparks, Edinburgh, Jan 29th 2016 EDINBURGH LTG Language

288 views • 12 slides
Data Mining in Bioinformatics Day 4: Text Mining Karsten Borgwardt February 21 to March 4, 2011

Data Mining in Bioinformatics Day 4: Text Mining Karsten Borgwardt February 21 to March 4, 2011

Data Mining in Bioinformatics Day 4: Text Mining Karsten Borgwardt February 21 to March 4, 2011 Machine Learning & Computational Biology Research Group MPIs Tbingen .: Data Mining in Bioinformatics, Page 1 What is text mining?

813 views • 31 slides
2. Text Mining D-BSSE Karsten Borgwardt Data Mining II Course, Basel Spring Semester 2016 118

2. Text Mining D-BSSE Karsten Borgwardt Data Mining II Course, Basel Spring Semester 2016 118

2. Text Mining D-BSSE Karsten Borgwardt Data Mining II Course, Basel Spring Semester 2016 118 / 179 Text Mining Goals To learn key problems and techniques in the mining one of the most common types of data To learn how to represent text

738 views • 59 slides
Text Mining in Search Engines By: DJ Ambler With special thanks to the Internet Overview

Text Mining in Search Engines By: DJ Ambler With special thanks to the Internet Overview

Text Mining in Search Engines By: DJ Ambler With special thanks to the Internet Overview What is text mining? How is it used in search engines? Text Mining Definition A way to extract meaning from text Structuring, deriving

314 views • 10 slides
Data Mining in Bioinformatics Day 4: Text Mining Karsten Borgwardt February 25 to March 10

Data Mining in Bioinformatics Day 4: Text Mining Karsten Borgwardt February 25 to March 10

Data Mining in Bioinformatics Day 4: Text Mining Karsten Borgwardt February 25 to March 10 Bioinformatics Group MPIs Tbingen Karsten Borgwardt: Data Mining in Bioinformatics, Page 1 What is text mining? Definition Text mining is the use

603 views • 31 slides
Combining data mining and text mining for detec1on of early

Combining data mining and text mining for detec1on of early

Combining data mining and text mining for detec1on of early stage demen1a: the SAMS framework Christopher Bull, Dommy Asfiandy, Ann Gledson, Joseph

284 views • 14 slides
Digital history and big data: Text mining historical documents on trade in the British Empire

Digital history and big data: Text mining historical documents on trade in the British Empire

Digital history and big data: Text mining historical documents on trade in the British Empire Beatrice Alex balex@inf.ed.ac.uk Digital scholarship: day of ideas 2, Edinburgh, 02/05/2013 OVERVIEW What is text mining? Text Mining in digital

484 views • 27 slides
Web Mining and Recommender Systems T ext Mining Learning Goals Introduce the topic of text

Web Mining and Recommender Systems T ext Mining Learning Goals Introduce the topic of text

Web Mining and Recommender Systems T ext Mining Learning Goals Introduce the topic of text mining Describe some of the difficulties of dealing with textual data Administrivia Midterm will be handed out after class next Monday Nov 9

891 views • 87 slides
Text Mining and Historical Research Beatrice Alex balex@inf.ed.ac.uk MSc Historical Research,

Text Mining and Historical Research Beatrice Alex balex@inf.ed.ac.uk MSc Historical Research,

Text Mining and Historical Research Beatrice Alex balex@inf.ed.ac.uk MSc Historical Research, University of Edinburgh, March 21st 2014 Friday, 21 March 2014 OVERVIEW What is text mining? Types of text analyses. Trading Consequences: text

698 views • 36 slides
1 Introduction The Text Mining Process Text representation Learning Conclusion Introduction

1 Introduction The Text Mining Process Text representation Learning Conclusion Introduction

Introduction The Text Mining Process Text representation Learning Conclusion Introduction The Text Mining Process Text representation Learning Conclusion Aim of presentation Strategies in Identifying Issues Addressed in Legal Reports

640 views • 5 slides
Assisted Curation: Does Text Mining Really Help? (Alex et al. 2008) by Benedict Fehringer

Assisted Curation: Does Text Mining Really Help? (Alex et al. 2008) by Benedict Fehringer

Assisted Curation: Does Text Mining Really Help? (Alex et al. 2008) by Benedict Fehringer Seminar: Unlocking the Secrets of the Past: Text Mining for Historical Documents Supervisor: Dr. Caroline Sporleder (and Martin Schreiber)

900 views • 64 slides
Twitter Data Analysis with R Text Mining and Social Network Analysis 1 Yanchang Zhao

Twitter Data Analysis with R Text Mining and Social Network Analysis 1 Yanchang Zhao

Twitter Data Analysis with R Text Mining and Social Network Analysis 1 Yanchang Zhao http://www.RDataMining.com Short Course on R and Data Mining University of Canberra 7 October 2016 1 Chapter 10: Text Mining, in R and Data Mining:

798 views • 40 slides
Introduzione al text mining Outline Introduzione e concetti di base Motivazioni,

Introduzione al text mining Outline Introduzione e concetti di base Motivazioni,

Complex Data Mining & Workflow Mining Introduzione al text mining Outline Introduzione e concetti di base Motivazioni, applicazioni Concetti di base nellanalisi dei dati complessi Text/Web Mining Concetti di base sul

1.34k views • 109 slides
Motivations Automated Text Mining and Vast Quantities of Text Available Knowledge Discovery

Motivations Automated Text Mining and Vast Quantities of Text Available Knowledge Discovery

A Visual Approach to Motivations Automated Text Mining and Vast Quantities of Text Available Knowledge Discovery Scientific Literature News Articles and Blogs Doctoral Dissertation by Email Andrey A. Puretskiy

336 views • 7 slides
Enabling Digital history: Text mining big historical document collections on trade in the British

Enabling Digital history: Text mining big historical document collections on trade in the British

Enabling Digital history: Text mining big historical document collections on trade in the British Empire Beatrice Alex balex@inf.ed.ac.uk PQIS All Team Meeting, ProQuest, April 23rd 2014 TEXT MINING D escribes a set of linguistic, statistical

408 views • 39 slides
Graph-Based Methods for M ltili Multilingual Text and Web l T t d W b Mining Mining Mark

Graph-Based Methods for M ltili Multilingual Text and Web l T t d W b Mining Mining Mark

Graph-Based Methods for M ltili Multilingual Text and Web l T t d W b Mining Mining Mark Last Department of Information Systems Engineering p y g g Ben-Gurion University of the Negev In cooperation with H Horst Bunke (University of

864 views • 53 slides
Data Mining 2020 Text Classification Naive Bayes Ad Feelders Universiteit Utrecht Ad Feelders

Data Mining 2020 Text Classification Naive Bayes Ad Feelders Universiteit Utrecht Ad Feelders

Data Mining 2020 Text Classification Naive Bayes Ad Feelders Universiteit Utrecht Ad Feelders ( Universiteit Utrecht ) Data Mining 1 / 49 Text Mining Text Mining is data mining applied to text data. Often uses well-known data mining

597 views • 49 slides
Data Mining in Bioinformatics Day 9: String & Text Mining in Bioinformatics Karsten Borgwardt

Data Mining in Bioinformatics Day 9: String & Text Mining in Bioinformatics Karsten Borgwardt

Data Mining in Bioinformatics Day 9: String & Text Mining in Bioinformatics Karsten Borgwardt February 25 to March 10 Bioinformatics Group MPIs Tbingen Karsten Borgwardt: Data Mining in Bioinformatics, Page 1 Why compare sequences?

786 views • 25 slides
Text Mining in Hebrew Impact of Morphology Analysis on Topic Analysis and on Search Quality

Text Mining in Hebrew Impact of Morphology Analysis on Topic Analysis and on Search Quality

Text Mining in Hebrew Impact of Morphology Analysis on Topic Analysis and on Search Quality Michael Elhadad, Meni Adler, Yoav Goldberg, Dudi Gabay and Yael Netzer Text in Hebrew Extract information from text in Hebrew Major immediate

1k views • 88 slides
Text mining with ngram variables Matthias Schonlau, Ph.D. University of Waterloo, Canada

Text mining with ngram variables Matthias Schonlau, Ph.D. University of Waterloo, Canada

Text mining with ngram variables Matthias Schonlau, Ph.D. University of Waterloo, Canada What to do with text data? The most common approach to dealing with text data is as follows: Step 1: encode text data into numeric variables

673 views • 41 slides

More recommend