Collecting and Analyzing Reddit Data Best Practices Christine Sowa - PDF document

Mar 28, 2023 •121 likes •189 views

6/11/2020 Collecting and Analyzing Reddit Data Best Practices Christine Sowa csowa@andrew.cmu.edu Center for Computational Analysis of Social and Organizational Systems http://www.casos.cs.cmu.edu/ Agenda Overview of Reddit How to

6/11/2020 Collecting and Analyzing Reddit Data Best Practices Christine Sowa csowa@andrew.cmu.edu Center for Computational Analysis of Social and Organizational Systems http://www.casos.cs.cmu.edu/ Agenda • Overview of Reddit • How to Get Data • Importing into ORA 11 June 2020 Christine Sowa 2 1
6/11/2020 What is Reddit? • Reddit is the 6 th most popular website in the USA with users averaging 11 minutes and 28 seconds on the site every day. • Globally it’s the 20 th most visited site in the world. • Users are 71% male, and 59% are between the ages of 18 and 29. • Users are highly reliant on the platform for news. – 45% of all Reddit users reported “learning something about the presidential campaign or candidates on the site in a given week” 11 June 2020 Christine Sowa 3 How do users interact with Reddit? • Over a million distinct subcommunities, called subreddits, exist. • Community members can ‘upvote’ or ‘downvote’ new content. • ‘Karma’ is a sum of a user’s post and comment scores. • Posts can be ‘gilded’ by users for money. • A post or comment’s ‘score’ is the number of upvotes it receives minus its downvotes. 11 June 2020 Christine Sowa 4 2
6/11/2020 What makes Reddit unique? • Moderation – Each subreddit has moderators that enforce community standards for posts 11 June 2020 Christine Sowa 5 Example Interactions 11 June 2020 Christine Sowa 6 3
6/11/2020 The Reddit API • First must read the terms and register to use the API • API data format comes out as a JSON – One JSON per post or comment • Can use wrappers (like praw or PushShift for Python). 11 June 2020 Christine Sowa 7 Type of Data to Pull • Get all of the posts (Submissions) from a given subreddit from the past 30 days – Get post title, score, id, url, number of comments, author, score • Get all posts from a given Redditor • Obtain all comments to a set of posts – Get comment author, time, score, text 11 June 2020 Christine Sowa 8 4
6/11/2020 Reddit Networks • User x Subreddit • User x Post • User x User • … 11 June 2020 Christine Sowa 9 Walking through API using PushShift 11 June 2020 Christine Sowa 10 5
6/11/2020 Pulling Data with Pushshift 11 June 2020 Christine Sowa 11 Uploading Data into Ora 11 June 2020 Christine Sowa 12 6

Recommend

Collecting and Analyzing Twitter Data Best Practices Ramon Villa-Cox rvillaco@andrew.cmu.edu

6/11/2020 Collecting and Analyzing Twitter Data Best Practices Ramon Villa-Cox rvillaco@andrew.cmu.edu The CASOS Center School of Computer Science, Carnegie Mellon Summer Institute 2020 June 2020, CASOS Summer Institute 2020 1

334 views • 6 slides

Collecting & Analyzing Qualitative Data in Community Health Assessments CHA/CHIP

Collecting & Analyzing Qualitative Data in Community Health Assessments CHA/CHIP Demonstration Project February 27, 2012 Presented By: Lisa Scott McCracken Webinar Logistics The lines are muted. If you wish to mute/unmute

477 views • 31 slides

Collecting & Analyzing Twitter data an Introduction Viktoria Spaiser UAF in Political

Collecting & Analyzing Twitter data an Introduction Viktoria Spaiser UAF in Political Science Informatics, School of Politics and International Studies Accessing Twitter data 1) Twitter Streaming API ( A pplication P rogramming I

449 views • 15 slides

Collecting and Analyzing Dosage Data to Improve Program Outcomes Kelly Bay-Meyer, Ph.D.

Collecting and Analyzing Dosage Data to Improve Program Outcomes Kelly Bay-Meyer, Ph.D. Lisa Predovich, M.Ed. Presentation at the National College Access Network Conference in Orlando, Florida (September 28, 2015).

193 views • 15 slides

COLLECTING, ANALYZING AND REPORTING DATA FOR ADMINISTRATIVE & EDUCATIONAL SUPPORT UNITS

COLLECTING, ANALYZING AND REPORTING DATA FOR ADMINISTRATIVE & EDUCATIONAL SUPPORT UNITS PRESENTED BY: KAROL BATEY, ASSESSMENT SPECIALIST CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING (FALL 2019) ASSESSMENT PROCESS

188 views • 14 slides

Analyzing the Traits and Anomalies of Political Discussions on Reddit Anna Guimar aes, Oana

Analyzing the Traits and Anomalies of Political Discussions on Reddit Anna Guimar aes, Oana Balalau, Erisa Terolli, Gerhard Weikum Max Planck Institute for Informatics June 14, 2019 Posted by u/NovelGrass 47.9k New Filipino law requires

848 views • 25 slides

Chapter 10 Marketing Research Marketing Research DATA Collecting Decision & Analyzing

Chapter 10 Marketing Research Marketing Research DATA Collecting Decision & Analyzing Interpreting Making Storing 2 Why marketing research is important? 1. Better understanding of your customers 2. Knowledge about your competitors

895 views • 22 slides

The Tortuous Path New Creation Doing ng again ain Preparation Collecting and sorting

The Tortuous Path New Creation Doing ng again ain Preparation Collecting and sorting relevant information Analyzing the problem thoroughly Exploring possible solution Incubation Mental work Analyzing, synthesizing,

1.37k views • 33 slides

Collecting Engineering Data Three ways of collecting data on the impacts of factors on a response

ST 370 Probability and Statistics for Engineers Collecting Engineering Data Three ways of collecting data on the impacts of factors on a response in a system: Retrospective Study: Collect relevant data from historical records; Observational

340 views • 12 slides

Analyzing Big Data at Web 2.0 Expo, 2010 Kevin Weil @kevinweil Three Challenges

Analyzing Big Data at Web 2.0 Expo, 2010 Kevin Weil @kevinweil Three Challenges Collecting Data Large-Scale Storage and Analysis Rapid Learning over Big Data My Background Studied Mathematics and Physics at Harvard, Physics

916 views • 75 slides

Collecting Data: New Information Sources November 2019 Outlines Collecting Data Legal

13 TH Session of the Committee of Director-Generals CoDGs of the National Statistics Offices High Level Meeting on Data Governance Tunis, 22 November 2019 Collecting Data: New Information Sources November 2019 Outlines Collecting Data

84 views • 7 slides

MY560 Workshop: Collecting and Analyzing Social Media Data Pablo Barber a London School of

MY560 Workshop: Collecting and Analyzing Social Media Data Pablo Barber a London School of Economics www.pablobarbera.com Workshop website: pablobarbera.com/social-media-workshop 62% of Americans get news on social media (Pew) 62%

1.88k views • 166 slides

Reddicommend Content recommendations for Reddit Motivation Reddit is the fourth-most visited

Reddicommend Content recommendations for Reddit Motivation Reddit is the fourth-most visited site in the US (8th globally) The ability of users to find content relevant to their interests is important to its utility as a

373 views • 13 slides

Amanpreet Singh & Anirudh Ganesh Reddit Reddit is a social content sharing and

Amanpreet Singh & Anirudh Ganesh Reddit Reddit is a social content sharing and discussion platform which was founded by Steve Huffman and Alexis Ohanian in 2005 now worth $1.8 billion. Users submit links, discussion topics, images

447 views • 13 slides

13 Collecting Statistical Data 13.1 The Population 13.2 Sampling 13.3 Random Sampling 1.1 - 1

13 Collecting Statistical Data 13.1 The Population 13.2 Sampling 13.3 Random Sampling 1.1 - 1 Polls, studies, surveys and other data collecting tools collect data from a small part of a larger group so that we can learn something about

833 views • 62 slides

Data Collection and HIVe Current Data Collection For those collecting data, you are use to

Data Collection and HIVe Current Data Collection For those collecting data, you are use to the Excel data collection sheets All Ryan White Funded entities will be required to report client level data Non-Medical Case Management

266 views • 13 slides

Collecting Social Media Data Two different methods: 1. Screen scraping: extract data from source

Collecting Social Media Data Two different methods: 1. Screen scraping: extract data from source code of website 2. Web APIs (application programming interface): use a set of structured https requests that return JSON or XML files Collecting

121 views • 10 slides

Reddit Mar 4, 2020 Quiz Time (5-7 minutes). Quiz on Opioid Use Disorder on Reddit Principles of

CMSC 20370/30370 Winter 2020 Designing for Users In Difficult Circumstances Case Study: Opioid Use Disorder on Reddit Mar 4, 2020 Quiz Time (5-7 minutes). Quiz on Opioid Use Disorder on Reddit Principles of Good Design Administrivia IA3

793 views • 36 slides

COLLECTING SOCIAL DETERMINANTS OF HEALTH DATA USING PRAPARE This project was made possible with

COLLECTING SOCIAL DETERMINANTS OF HEALTH DATA USING PRAPARE This project was made possible with funding from: TO REDUCE DISPARITIES, IMPROVE OUTCOMES, AND TRANSFORM CARE 1 AGENDA To Topic Importance of Collecting Data on the SDH Background

682 views • 29 slides

NGSS PRACTICE: ANALYZING AND INTERPRETING DATA SOUTHERN CT STATE UNIVERSITY ANALYZING DATA JULY

NGSS PRACTICE: ANALYZING AND INTERPRETING DATA SOUTHERN CT STATE UNIVERSITY ANALYZING DATA JULY 27, 2015 Dr. Marie Nabbout-Cheiban & Dr. Adam Goldberg A CTIVITY 1: R OLLING THE DICE Please answer each of the following questions alone. Then,

257 views • 7 slides

Collecting IoT Data in InfluxDB D AV I D G . S I M M O N S S E N I O R D E V E L O P E R E VA

Collecting IoT Data in InfluxDB D AV I D G . S I M M O N S S E N I O R D E V E L O P E R E VA N G E L I S T @ D AV I D G S I O T Who, What and Why is InfluxData Founded in 2013 Delivering a modern open- source platform for metrics

767 views • 48 slides

Statistics Physics Chemistry Economics Biology

3-1 Definitions Statistics is a branch of Mathematics that deals collecting, analyzing, summarizing, and presenting data to help in the decision-making process. Statistics is applied in all fields of life such as:

204 views • 9 slides

Contract Drafting Fundamentals Best Practices for Drafting, Analyzing and Interpreting Contracts

Presenting a live 90-minute webinar with interactive Q&A Contract Drafting Fundamentals Best Practices for Drafting, Analyzing and Interpreting Contracts WEDNES DAY, MARCH 14, 2012 1pm East ern | 12pm Cent ral | 11am Mount ain

1.22k views • 98 slides

Co lle c ting Ca nc e r Data : GI ST / NE T 1/ 9/ 14 Collecting Cancer Data: Gastrointestinal

Co lle c ting Ca nc e r Data : GI ST / NE T 1/ 9/ 14 Collecting Cancer Data: Gastrointestinal Stromal Tumor (GIST) Gastrointestinal Neuroendocrine Tumors (NET) 2013 2014 NAACCR Webinar Series January 9, 2014 Q&A Please submit all

666 views • 33 slides