collaborative filtering
play

Collaborative Filtering Presentation by Alex Hugger Filtering - PowerPoint PPT Presentation

Mar 12, 2023 •473 likes •858 views

Collaborative Filtering Presentation by Alex Hugger Filtering Documents Mittwoch, 28. April 2010 Departement/Institut/Gruppe 2 Content-Based Methods Find other popular items by the same author or similar keywords Recommendation

  1. Collaborative Filtering Presentation by Alex Hugger

  2. Filtering Documents Mittwoch, 28. April 2010 Departement/Institut/Gruppe 2

  3. Content-Based Methods � Find other popular items by the same author or similar keywords � Recommendation quality is relatively poor Mittwoch, 28. April 2010 3

  4. Filtering Music Mittwoch, 28. April 2010 4

  5. Filtering Jokes www.xkcd.org Mittwoch, 28. April 2010 5

  6. Filtering Jokes � Let the users rate the jokes � Sort by average rating Mittwoch, 28. April 2010 6

  7. Collaborative Filtering � People who have agreed in the past tend to agree in the future Mittwoch, 28. April 2010 7

  8. Good or Bad? Dirty Dancing (1987) Die Hard (1988) Mittwoch, 28. April 2010 8

  9. Good or Bad? Mittwoch, 28. April 2010 9

  10. Mittwoch, 28. April 2010 10

  11. Jester 4.0 (http://eigentaste.berkeley.edu) Mittwoch, 28. April 2010 11

  12. MovieLens (http://movielens.org) Mittwoch, 28. April 2010 12

  13. Netflix � www.netflix.org � DVD/Blue-Ray rental and video streaming � 1’000’000$ for the first beating the current recommendation algorithm by 10% � Competition started in October 2006 � Ended July 2009 Mittwoch, 28. April 2010 13

  14. GroupLens: An Open Architecture for Collaborative Filtering of NetNews Research paper from 1994 by: � Paul Resnick, MIT Center for Coordination Science � � Neophytos Iacovou, University of Minnesota Neophytos Iacovou, University of Minnesota � Mitesh Suchak, MIT Center for Coordination Science � Peter Bergstrom , University of Minnesota � John Riedl , University of Minnesota Mittwoch, 28. April 2010 14

  15. NetNews Mittwoch, 28. April 2010 15

  16. Problems of NetNews Signal to noise ratio is too low � Splitting bulletin board into newsgroups � Moderated newsgroups � News clients � Summary of the author and subject line � Display discussion threads together � String search facilities � Kill files Mittwoch, 28. April 2010 16

  17. Modification to NetNews 2.61 3.72 Mittwoch, 28. April 2010 Mittwoch, 28. April 2010 17 17

  18. Predicting Scores � Score prediction system is robust to certain differences of interpretation of the rating scale � One user rates 3-5 and the other 1-3 � One thinks 1 and the other 5 is best score Mittwoch, 28. April 2010 18

  19. Predicting Scores � Predictions can be modeled as matrix filling Item # Ken Lee Meg Nan 1 1 1 1 4 4 2 2 2 2 2 5 2 4 4 3 3 4 2 5 5 5 4 1 1 6 ? 2 5 Mittwoch, 28. April 2010 19

  20. Predicting Scores � Assign similarities to each of the other people � Compute over articles rated by both � Pearson Correlation Coefficients � Between -1 and 1 cov( , ) [( )( )] − µ − µ K L E K L = = Ken Lee r Ken Lee − σ ⋅ σ σ ⋅ σ Ken Lee Ken Lee σ = standard deviation of Ken Ken µ = average of Ken’s ratings Ken Mittwoch, 28. April 2010 20

  21. Predicting Scores � Correlation Coefficients of Ken User Correlation # Ken Lee Meg Nan 1 1 1 1 4 4 2 2 2 2 Lee Lee -0.8 -0.8 2 5 2 4 4 Meg +1 3 3 Nan 0 4 2 5 5 5 4 1 1 6 ? 2 5 Mittwoch, 28. April 2010 21

  22. Predicting Scores � Weighted average of all ratings on article 6 � Ken’s prediction is 4.56 ( ( ) ) ∑ ∑ − − µ µ ⋅ ⋅ J J r r 6 Ken − J J = µ + ∈ Raters K J ∑ 6 Prediction K r Ken − J Raters J ∈ Mittwoch, 28. April 2010 22

  23. Scaling Issues � Relevant performance measures � Prediction quality � Compute time and disk storage � Rating is small, but each article may be rated by many � Rating is small, but each article may be rated by many users � Volume of ratings could exceed volume of news Mittwoch, 28. April 2010 23

  24. Scaling Issues � Pre-fetching ratings and pre-computing predictions keeps user time constant � High computation complexity � Volume of all ratings may exceed the storage capacity � 100’000 users rate 10 articles per day. 100 bytes are required to store a rating. 1GB of storage required per 10 days. Mittwoch, 28. April 2010 24

  25. Cluster Models Mittwoch, 28. April 2010 25

  26. Cluster Models � Better online scalability and performance than classical collaborative filtering � Complex and extensive clustering is run offline � Prediction quality gets reduced Mittwoch, 28. April 2010 26

  27. Item-to-Item Collaborative Filtering Mittwoch, 28. April 2010 27

  28. Item-to-Item Collaborative Filtering � Amazon.com extensively uses recommendation algorithms � 10’000’000 products and customers � Result returned in real-time (< 0.5s) � Algorithm must respond immediately to new information Mittwoch, 28. April 2010 28

  29. Amazon.com Mittwoch, 28. April 2010 29

  30. Amazon.com Mittwoch, 28. April 2010 30

  31. Amazon.com Mittwoch, 28. April 2010 31

  32. Amazon.com Mittwoch, 28. April 2010 32

  33. How It Works - Offline � Similar-items table � Calculating similarity between a single product and all related products � Complexity: O(mn 2 ) - in practice: O(mn) � m: number of users � m: number of users � n: number of items Mittwoch, 28. April 2010 33

  34. How It Works - Online � Given a similar-items table � Find all similar items to each of the users ratings and purchases � Aggregate those items � Recommend most popular and correlated items � Number of users has no effect on performance Mittwoch, 28. April 2010 34

  35. General difficulties � Cold start � Self-fulfilling prophecy � Recommendations for groups � Evaluation of recommendation systems � Evaluation of recommendation systems Mittwoch, 28. April 2010 35

  36. Conclusion � Effective form of targeted marketing � Mostly used in e-commerce business � Mostly used in e-commerce business � But can always be used when signal to noise ratio is too low Mittwoch, 28. April 2010 36

  37. Questions? Mittwoch, 28. April 2010 37

  38. References � GroupLens: An Open Architecture for Collaborative Filtering of NetNews � Published 1994 � Paul Resnick, MIT Center for Coordination Science � Neophytos Iacovou, University of Minnesota � Neophytos Iacovou, University of Minnesota � Mitesh Suchak, MIT Center for Coordination Science � Peter Bergstrom , University of Minnesota � John Riedl , University of Minnesota � Amazon.com Recommendations � Published 2003 � Greg Linden � Brent Smith � Jeremy York Mittwoch, 28. April 2010 38

Recommend

CS490W: What is Collaborative Filtering? Collaborative Filtering (CF): Making recommendation

CS490W: What is Collaborative Filtering? Collaborative Filtering (CF): Making recommendation

CS490W: What is Collaborative Filtering? Collaborative Filtering (CF): Making recommendation decisions for a specific CS-490W user based on the judgments of users with similar tastes Collaborative Filtering Luo Si Train_User 1 1 5 3 3 4

628 views • 6 slides
Collaborative Filtering Yun-Ta Tsai 1 , Markus Steinberger 2 , Dawid Pajk 3 , Kari Pulli 4 1

Collaborative Filtering Yun-Ta Tsai 1 , Markus Steinberger 2 , Dawid Pajk 3 , Kari Pulli 4 1

FastANN for High Quality Collaborative Filtering Yun-Ta Tsai 1 , Markus Steinberger 2 , Dawid Pajk 3 , Kari Pulli 4 1 Google, Inc. 2 TU Graz 3 NVIDIA 4 Light Research Story Collaborative Filtering - Aggregation Collaborative Filtering -

722 views • 68 slides
Training deep Autoencoders for collaborative filtering Oleksii Kuchaiev &amp; Boris Ginsburg

Training deep Autoencoders for collaborative filtering Oleksii Kuchaiev &amp; Boris Ginsburg

Training deep Autoencoders for collaborative filtering Oleksii Kuchaiev &amp; Boris Ginsburg Motivation Personalized recommendations 2 Key points (spoiler alert) 1. Deep autoencoder for collaborative filtering 1. Improves generalization

461 views • 24 slides
Collaborative Filtering at Scale Recommender engines with Mahout and Hadoop Berlin Buzzwords Sean

Collaborative Filtering at Scale Recommender engines with Mahout and Hadoop Berlin Buzzwords Sean

Collaborative Filtering at Scale Recommender engines with Mahout and Hadoop Berlin Buzzwords Sean Owen 8 June 2010 + Mahout is ! Machine learning ! Collaborative filtering (recommenders) ! Clustering ! Classification ! Frequent item set

831 views • 27 slides
Collaborative Filtering Practical Machine Learning, CS 294-34 Lester Mackey Based on slides by

Collaborative Filtering Practical Machine Learning, CS 294-34 Lester Mackey Based on slides by

Intro Prelim Class/Reg MF Extend Combo Conclude Collaborative Filtering Practical Machine Learning, CS 294-34 Lester Mackey Based on slides by Aleksandr Simma October 18, 2009 Lester Mackey Collaborative Filtering Intro Prelim

808 views • 68 slides
Distributed Itembased Collaborative Filtering with Apache Mahout Sebastian Schelter

Distributed Itembased Collaborative Filtering with Apache Mahout Sebastian Schelter

Distributed Itembased Collaborative Filtering with Apache Mahout Sebastian Schelter ssc@apache.org twitter.com/sscdotopen 7. October 2010 Overview 1. What is Apache Mahout? 2. Introduction to Collaborative Filtering 3. Itembased

633 views • 17 slides
1 Collaborative Filtering Collaborative Filtering Maintain a database of many users

1 Collaborative Filtering Collaborative Filtering Maintain a database of many users

Recommender Systems Systems for recommending items (e.g. books, movies, music, web pages, newsgroup messages) to users based on examples of their preferences. Recommender Systems Many on-line stores provide recommendations (e.g. Amazon,

346 views • 11 slides
1 2 3 4 5 Second Project Implement collaborative filtering algorithm Apply to

1 2 3 4 5 Second Project Implement collaborative filtering algorithm Apply to

1 2 3 4 5 Second Project Implement collaborative filtering algorithm Apply to (subset of) Netflix Prize data 1821 movies, 28,978 users, 3.25 million ratings (* - *****) To date: 11,615 submissions from 1960 teams Try to

292 views • 6 slides
Music recommenda tion System - Spotify Collaborative Filtering and Feedback System 1 Mithun

Music recommenda tion System - Spotify Collaborative Filtering and Feedback System 1 Mithun

Music recommenda tion System - Spotify Collaborative Filtering and Feedback System 1 Mithun Madathil 2 Table of contents Introduction Methods of recommendation Collaborative Filtering in Spotify Feedback System

2.29k views • 22 slides
A Privacy-Protecting Architecture for Collaborative Filtering via Forgery and Suppression of

A Privacy-Protecting Architecture for Collaborative Filtering via Forgery and Suppression of

A Privacy-Protecting Architecture for Collaborative Filtering via Forgery and Suppression of Ratings Javier Parra-Arnau , David Rebollo-Monedero and Jordi Forn http://sites.google.com/site/javierparraarnau/ Department of Telematics

920 views • 34 slides
RLT: Residual-Loop Training in Collaborative Filtering for Combining Factorization and

RLT: Residual-Loop Training in Collaborative Filtering for Combining Factorization and

RLT: Residual-Loop Training in Collaborative Filtering for Combining Factorization and Global-Local Neighborhood Lei Li 1 , 2 , Weike Pan 1 , Li Chen 2 , and Zhong Ming 1 lilei1995eli@gmail.com, panweike@szu.edu.cn,

537 views • 24 slides
CoFiGAN: Collaborative Filtering by Generative and Discriminative Training for One-Class

CoFiGAN: Collaborative Filtering by Generative and Discriminative Training for One-Class

CoFiGAN: Collaborative Filtering by Generative and Discriminative Training for One-Class Recommendation Jixiong Liu a , b , c , Weike Pan a , b , c and Zhong Ming a , b , c liujixiong@email.szu.edu.cn, { panweike, mingz } @szu.edu.cn a

855 views • 40 slides
k -Reciprocal Nearest Neighbors Algorithm for One-Class Collaborative Filtering Wei Cai a , b , c

k -Reciprocal Nearest Neighbors Algorithm for One-Class Collaborative Filtering Wei Cai a , b , c

k -Reciprocal Nearest Neighbors Algorithm for One-Class Collaborative Filtering Wei Cai a , b , c , Weike Pan a , b , c , Jixiong Liu a , b , c , Zixiang Chen a , b , c , Zhong Ming a , b , c { caiwei2016, liujixiong, chenzixiang2016 }

678 views • 35 slides
Problem Domain Collaborative filtering (CF)-based recommender systems (RS). Issue:

Problem Domain Collaborative filtering (CF)-based recommender systems (RS). Issue:

ClustKNN : A Highly Scalable Hybrid Model-&amp; Memory-Based CF Algorithm Al Mamunur Rashid, Shyong K. Lam, George Karypis, and John Riedl University of Minnesota Problem Domain Collaborative filtering (CF)-based recommender systems (RS).

730 views • 19 slides
Applying Subsequence Matching to Collaborative Filtering Alejandro Bellog n Pablo S

Applying Subsequence Matching to Collaborative Filtering Alejandro Bellog n Pablo S

Applying Subsequence Matching to Collaborative Filtering Alejandro Bellog n Pablo S anchez Universidad Aut onoma de Madrid Escuela Polit ecnica Superior Departamento de Ingenier a Inform atica V Congreso Espa nol de

887 views • 64 slides
Collaborative Filtering Alejandro Bellogn 1 , Jun Wang 2 , and Pablo Castells 1 1 Escuela

Collaborative Filtering Alejandro Bellogn 1 , Jun Wang 2 , and Pablo Castells 1 1 Escuela

Text Retrieval Methods for Item Ranking in Collaborative Filtering Alejandro Bellogn 1 , Jun Wang 2 , and Pablo Castells 1 1 Escuela Politcnica Superior, Universidad Autnoma de Madrid 2 Department of Computer Science, University College

246 views • 23 slides
Algorithm Recommendation as Collaborative Filtering Mich` ele Sebag &amp; Mustafa Misir &amp;

Algorithm Recommendation as Collaborative Filtering Mich` ele Sebag &amp; Mustafa Misir &amp;

Algorithm Recommendation as Collaborative Filtering Mich` ele Sebag &amp; Mustafa Misir &amp; Philippe Caillou TAO, CNRS INRIA Universit e Paris-Sud AutoML Wshop, ICML 2015 1 / 44 Control layer in algorithmic platforms Goal

598 views • 46 slides
Transfer Learning for Heterogeneous One-Class Collaborative Filtering Weike Pan , Mengsi Liu and

Transfer Learning for Heterogeneous One-Class Collaborative Filtering Weike Pan , Mengsi Liu and

Transfer Learning for Heterogeneous One-Class Collaborative Filtering Weike Pan , Mengsi Liu and Zhong Ming panweike@szu.edu.cn, liumengsi@email.szu.edu.cn, mingz@szu.edu.cn College of Computer Science and Software Engineering Shenzhen

441 views • 27 slides
Neighborhood-Enhanced Transfer Learning for One-Class Collaborative Filtering Wanling Cai 1 , 2 ,

Neighborhood-Enhanced Transfer Learning for One-Class Collaborative Filtering Wanling Cai 1 , 2 ,

Neighborhood-Enhanced Transfer Learning for One-Class Collaborative Filtering Wanling Cai 1 , 2 , Jiongbin Zheng 1 , Weike Pan 1 , Jing Lin 1 , Lin Li 1 , Li Chen 2 , Xiaogang Peng 1 and Zhong Ming 1 cswlcai@comp.hkbu.edu.hk,

440 views • 29 slides
Collaborative Filtering Radek Pel anek Notes on Lecture the most technical lecture of the

Collaborative Filtering Radek Pel anek Notes on Lecture the most technical lecture of the

Collaborative Filtering Radek Pel anek Notes on Lecture the most technical lecture of the course includes some scary looking math, but typically with intuitive interpretation use of standard machine learning techniques, which are

971 views • 68 slides
Collaborative Filtering: basic ideas (slides based on chapter 2 of Programming Collective

Collaborative Filtering: basic ideas (slides based on chapter 2 of Programming Collective

Collaborative Filtering: basic ideas (slides based on chapter 2 of Programming Collective Intelligence book by Toby Segaran) Fernando Lobo Data mining 1 / 16 Recommendation Systems Use the preferences of a group of people to make

335 views • 16 slides
Nearest-Biclusters Collaborative Filtering Philadelphia, 20 August 2006 Speaker : Panagiotis

Nearest-Biclusters Collaborative Filtering Philadelphia, 20 August 2006 Speaker : Panagiotis

Nearest-Biclusters Collaborative Filtering Philadelphia, 20 August 2006 Speaker : Panagiotis Symeonidis PhD Candidate Scholar of the State Scholarships Foundation Aristotle University of Thessaloniki, Greece symeon@delab.csd.auth.gr http:/ /

597 views • 33 slides
Boolean Matrix Factorisation for Collaborative Filtering: An FCA based approach Dmitry Ignatov

Boolean Matrix Factorisation for Collaborative Filtering: An FCA based approach Dmitry Ignatov

Boolean Matrix Factorisation for Collaborative Filtering: An FCA based approach Dmitry Ignatov 1 , Elena Nenova 2 , Andrey Konstantinov 1 , Natalia Konstantinova 3 1 National Research University Higher School of Economics, Moscow, Russia 2

630 views • 33 slides
On the Effectiveness of Linear Models for One-Class Collaborative Filtering Suvash Sedhain 1,2 ,

On the Effectiveness of Linear Models for One-Class Collaborative Filtering Suvash Sedhain 1,2 ,

On the Effectiveness of Linear Models for One-Class Collaborative Filtering Suvash Sedhain 1,2 , Aditya Menon 2,1 , Scott Sanner 3,1 , Darius Braziunas 4 Australian National University 1 NICTA 2 Oregon State University 3 Rakuten Kobo Inc 4

442 views • 27 slides

More recommend