Happiness Some motivation Measuring Happiness the Big Data Way Measuring emotional content Clinical and Translational Research Seminar, UVM Data sets Analysis Songs Peter Dodds, Chris Danforth, Blogs SOTU Isabel Kloumann, Cathy Bliss, and Kameron Harris. Twitter Mechanical Turk action Department of Mathematics & Statistics Prediction Center for Complex Systems References Vermont Advanced Computing Center University of Vermont 1 of 66
Happiness Outline Some motivation Some motivation Measuring emotional content Measuring emotional content Data sets Analysis Data sets Songs Blogs SOTU Analysis Twitter Mechanical Turk Songs action Blogs Prediction SOTU References Twitter Mechanical Turk action Prediction References 2 of 66
Happiness Tonight is the on-average coldest night of the year: Some motivation Avg. max and min Temperature Avg. max and min Temperature Measuring 1893−2007, Burlington VT 1876−2007, Central Park, NYC emotional content 100 100 Data sets 80 80 Analysis Fahrenheit Fahrenheit Songs 60 60 Blogs SOTU 40 40 Twitter Mechanical Turk 20 20 action 0 0 Prediction 100 200 300 100 200 300 Julian Day Julian Day References ◮ Hibernal Teletherm ≈ February 4. ◮ Halfway between Winter Solstice and Spring Equinox ◮ Bonus: Groundhog Day ( ⊞ ), Imbolc ( ⊞ ), . . . ◮ Aesteval Teletherm ≈ July 19 (164 days later). 3 of 66
Happiness The Team: anks to ... Some motivation The People: Measuring Kameron Harris Isabel Kloumann Catherine Bliss emotional content Data sets Analysis Songs Blogs SOTU Twitter Mechanical Turk action Prediction References The Machines: ◮ 1400 processors + storage at the Vermont Advanced Computing Center ◮ 30 TB of storage in Danforth’s office. 4 of 66
Happiness Happiness: Some motivation Measuring emotional content Data sets Analysis Songs Blogs SOTU Twitter Mechanical Turk action Prediction References Jefferson: Bentham: Socrates et al.: . . . the pursuit of hedonistic eudaimonia [8] happiness calculus 5 of 66
Happiness Early drafts: Some motivation Measuring emotional content Data sets Analysis Songs Blogs SOTU Twitter Mechanical Turk action Prediction References 6 of 66
Happiness Happiness: Some motivation Measuring emotional content Data sets Analysis Songs Blogs SOTU Twitter Even the odd modern economist Mechanical Turk likes happiness: action Prediction “Happiness” by Richard Layard [10] References [amazon] ( ⊞ ) 7 of 66
Happiness Some motivation Measuring Desiring happiness—not just for boffins: emotional content Data sets ◮ Average people routinely report being happy is what Analysis they want most in life [10, 11] Songs Blogs SOTU Twitter National indices of well-being: Mechanical Turk action Prediction ◮ Bhutan References ◮ France ◮ Australia 8 of 66
Happiness Emotional content Some motivation So how does one measure Measuring emotional content 1. happiness? Data sets 2. levels of other emotional states? Analysis Songs Blogs SOTU Just ask people how happy they are. Twitter Mechanical Turk ◮ Experience sampling [4, 6, 5] (Csikszentmihalyi et al.) action ◮ Day reconstruction [9] (Kahneman et al.) Prediction References But self-reporting has drawbacks... ◮ relies on memory and self-perception ◮ induces misreporting [12] ◮ costly 9 of 66
Happiness Measuring Emotional Content: Some motivation Measuring We’d like to build an ‘hedonometer’: emotional content Data sets ◮ An instrument to Analysis ‘remotely-sense’ emotional Songs Blogs states and levels, in real time or SOTU Twitter post hoc. Mechanical Turk action Ideally: Prediction References ◮ Transparent ◮ Non-reactive ◮ Fast ◮ Complementary to ◮ Based on written self-reported measures expression ◮ Improvable ◮ Uses human evaluation 10 of 66
Happiness ANEW study words—examples Some motivation 9 love/paradise/triumphant Measuring emotional content 8 glory/luxury/trophy Data sets 7 Analysis optimism/pancakes/church Songs 6 Blogs valence v SOTU engine/paper/street Twitter 5 Mechanical Turk derelict/neurotic/vanity action 4 Prediction fault/corrupt/lawsuit References 3 trauma/hostage/disgusted 2 funeral/rape/suicide 1 0 50 100 150 200 frequency ANEW = “Affective Norms for English Words” [3] 11 of 66
Happiness Analysing text: Some motivation Measuring emotional content Data sets Analysis Songs Blogs SOTU ANEW Lyrics for v k f k Twitter words k v k f k � Michael Jackson’s Billie Jean Mechanical Turk v text = k =1. love 8.72 1 action “She was more like a beauty queen k f k 2. mother 8.39 1 � Prediction from a movie scene. 3. baby 8.22 3 4. beauty 7.82 1 References 5. truth 7.80 1 And mother always told me, 6. people 7.33 2 v Billie Jean be careful who you love. = 7.1 7. strong 7.11 1 And be careful of what you do 8. young 6.89 2 ’cause the lie becomes the truth. v Thriller 9. girl 6.87 4 = 6.3 Billie Jean is not my lover, 10. movie 6.86 1 11. perfume 6.76 1 She’s just a girl who claims v Michael = 6.4 12. queen 6.44 1 that I am the one. Jackson 13. name 5.55 1 1 14. lie 2.79 12 of 66
Happiness Data sets: Some motivation Measuring Texts: emotional content Data sets 1. Song lyrics (1960–2007) Analysis Songs 2. Song titles (1960–2008) Blogs SOTU 3. State of the Union (SOTU) Addresses (1790–2008) Twitter Mechanical Turk action Sources: Prediction References ◮ hotlyrics.com ( ⊞ ) ◮ freedb.com ( ⊞ ) ◮ American Presidency Project: www.presidency.ucsb.edu ( ⊞ ). 13 of 66
Happiness Data sets: 4. Blog phrases containing “I feel...”, “I am feeling”, etc., Some motivation taken from wefeelfine.org ( ⊞ ) (API, 2005–2010) Measuring emotional content Data sets Analysis Songs Blogs SOTU Twitter Mechanical Turk action Prediction References ◮ Created by Jonathan Harris & Sep Kamvar 14 of 66
Happiness wefeelfine.org: Some motivation Measuring emotional content Data sets Analysis Songs Blogs SOTU Twitter Mechanical Turk action Prediction References 15 of 66
Happiness wefeelfine.org: Some motivation Measuring emotional content Data sets Analysis Songs Blogs SOTU Twitter Mechanical Turk action Prediction References 16 of 66
Happiness wefeelfine.org: Some motivation Measuring emotional content Data sets Analysis Songs Blogs SOTU Twitter Mechanical Turk action Prediction References 17 of 66
Happiness Data sets: Some motivation Measuring emotional content Data sets Analysis 5. Tweets from twitter.com: Songs Blogs SOTU Twitter Mechanical Turk action Prediction References 18 of 66
Happiness Some numbers: Some motivation Measuring Counts Song lyrics Song titles emotional content All words 58,610,849 60,867,223 Data sets Analysis ANEW words 3,477,575 (5.9%) 5,612,708 (9.2%) Songs Individuals ∼ 20,000 ∼ 632,000 Blogs SOTU Twitter Counts blogs SOTU Mechanical Turk action All words 155,667,394 1,796,763 Prediction ANEW words 8,581,226 (5.5%) 61,926 (3.5%) References Individuals ∼ 2,335,000 43 Counts Twitter ∼ 30 × 10 9 All words ∼ 1 × 10 9 (3.7%) ANEW words ∼ 50 × 10 6 Individuals 19 of 66
Happiness Most frequent ANEW words: Some motivation Measuring Rank Song lyrics Song titles emotional content 1 love (7.37%) love (7.39%) Data sets 2 time (4.18%) time (4.19%) Analysis Songs 3 baby (2.75%) baby (2.75%) Blogs SOTU 4 life (2.59%) life (2.60%) Twitter 5 heart (2.14%) heart (2.15%) Mechanical Turk action Prediction Rank blogs SOTU twitter References 1 good (4.89%) people (5.49%) good (4.50%) 2 time (4.72%) time (4.09%) love (4.45%) 3 people (3.94%) present (3.45%) time (3.30%) 4 love (3.31%) world (3.10%) people (2.06%) 5 life (3.13%) war (2.98%) home (1.71%) 20 of 66
Text: h avg Words with a similar score: Soul/Gospel 6.9 chocolate (6.88), leisurely (6.88), lyrics [7] penthouse (6.81) Pop lyrics [7] 6.7 dream (6.73), honey (6.73), sugar (6.74) Dante’s 6.5 muffin (6.57), rabbit (6.57), smooth Paradise [1] (6.58) Tweets, 9/9/2008 6.4 thought (6.39), face (6.39), blond (6.42) to 12/31/2010 Rock lyrics [7] 6.3 church (6.28), tree (6.32), air (6.34) Enron Emails [2] 6.2 clouds (6.18), alert (6.20), computer (6.24) State of the Union 6.1 grass (6.12), idol (6.12), bottle (6.15) Messages [7] New York Times 6.0 hotel (6.00), tennis (6.02), wonder (6.03) (1987–2007) [14] Blogs [7] 5.8 owl (5.80), whistle (5.81), humble (5.86) Dante’s Inferno [1] 5.5 glacier (5.50), repentant (5.53), mischief (5.57) Heavy Metal 5.4 lamp (5.41), elevator (5.44), truck (5.47) lyrics [7]
Happiness Song Lyrics—average happiness (valence) Some motivation 6.8 Measuring emotional content 6.7 Data sets mean valence v avg Analysis 6.6 Songs Blogs 6.5 SOTU Twitter 6.4 Mechanical Turk action 6.3 Prediction 6.2 References 6.1 6 5.9 1960 1970 1980 1990 2000 2010 year 23 of 66
Recommend
More recommend
