privacy preserving distributed id3 algorithm
play

Privacy Preserving Distributed ID3 Algorithm Nan Meng University of - PowerPoint PPT Presentation

Jul 09, 2023 •214 likes •514 views

Privacy Preserving Distributed ID3 Algorithm Nan Meng University of Hong Kong u3003637@connect.hku.hk April 29, 2016 Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 1 / 29 Overview Introduction

  1. Privacy Preserving Distributed ID3 Algorithm Nan Meng University of Hong Kong u3003637@connect.hku.hk April 29, 2016 Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 1 / 29

  2. Overview ∗ Introduction ∗ Problem Definition ∗ Solution ∗ Result ∗ Conclusion Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 2 / 29

  3. Privacy Preserving Data Mining • Mining while protecting the privacy of data. Figure: Lindell’s definition Figure: Agrawal’s definition Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 3 / 29

  4. ID3 Algorithm • ID3 is an algorithm used to generate a decision tree from a dataset, and is typically used in the data mining. 1 . Calculate the entropy of every attribute using the data set S. 2 . Split the set S into subsets using the attribute for which entropy is minimum 3 . Make a decision tree node containing that attribute 4 . Recurse on subsets using remaining attributes. Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 4 / 29

  5. Distributed ID3 Algorithm Table: Play Golf Dataset Outlook Temp Humidity Windy Play Golf Rainy Hot High FALSE No Rainy Hot High TRUE No Overcast Hot High FALSE Yes Alice ⇒ Sunny Mild High FALSE Yes Rainy Mild Normal TRUE Yes Overcast Cool Normal TRUE Yes Rainy Mild High FALSE No Bob ⇒ Rainy Cool Normal FALSE Yes Sunny Mild Normal FALSE Yes Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 5 / 29

  6. Distributed ID3 Algorithm • Data is distributed in two or more parties Table: Bob Table: Alice Outlook Temp Humidity Windy Play Golf Outlook Temp Humidity Windy Play Golf Overcast Cool Normal TRUE Yes Rainy Hot High FALSE No Rainy Mild High FALSE No Rainy Hot High TRUE No Rainy Cool Normal FALSE Yes Overcast Hot High FALSE Yes Sunny Mild Normal FALSE Yes Sunny Mild High FALSE Yes Rainy Mild Normal TRUE Yes • Combine data together and get a decision tree Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 6 / 29

  7. Problem Definition • However, data is privacy . Table: Bob Table: Alice Outlook Temp Humidity Windy Play Golf Outlook Temp Humidity Windy Play Golf Overcast Cool Normal TRUE Yes Rainy Hot High FALSE No Rainy Mild High FALSE No Rainy Hot High TRUE No Rainy Cool Normal FALSE Yes Overcast Hot High FALSE Yes Sunny Mild Normal FALSE Yes Sunny Mild High FALSE Yes Rainy Mild Normal TRUE Yes • How to share data in a safe way in distributed ID3 algorithm? Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 7 / 29

  8. An Example of Distributed ID3 Algorithm • Here we use a example of Distributed ID3 algorithm to clearly define the problem. For example, Compute the entropy of Rainy . Table: Bob Table: Alice Outlook Temp Humidity Windy Play Golf Outlook Temp Humidity Windy Play Golf Overcast Cool Normal TRUE Yes Rainy Hot High FALSE No Rainy Mild High FALSE No Rainy Hot High TRUE No Rainy Cool Normal FALSE Yes Overcast Hot High FALSE Yes Sunny Mild Normal FALSE Yes Sunny Mild High FALSE Yes Rainy Mild Normal TRUE Yes 2 records, 1 No, 1 Yes 3 records, 2 No, 1 Yes Entropy ( Rainy ) = − 2+1 3+2 log 2 ( 2+1 − 1+1 3+2 log 2 ( 1+1 3+2 ) 3+2 ) � �� � � �� � P layGolf = No P layGolf = Y es = − 3 5 log 2 ( 3 5 ) − 2 5 log 2 ( 2 5 ) Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 8 / 29

  9. An Example of Distributed ID3 Algorithm • For example, Compute the entropy of Rainy . Table: Bob Table: Alice Outlook Temp Humidity Windy Play Golf Outlook Temp Humidity Windy Play Golf Overcast Cool Normal TRUE Yes Rainy Hot High FALSE No Rainy Mild High FALSE No Rainy Hot High TRUE No Rainy Cool Normal FALSE Yes Overcast Hot High FALSE Yes Sunny Mild Normal FALSE Yes Sunny Mild High FALSE Yes Rainy Mild Normal TRUE Yes 2 records, 1 No, 1 Yes 3 records, 2 No, 1 Yes Entropy ( Rainy ) = − 2+1 3+2 log 2 ( 2+1 1+1 3+2 log 2 ( 1+1 3+2 ) − 3+2 ) = − 3 5 log 2 ( 3 5 ) − 2 5 log 2 ( 2 5 ) Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 9 / 29

  10. An Example of Distributed ID3 Algorithm • For example, Compute the entropy of Rainy . Table: Bob Table: Alice Outlook Temp Humidity Windy Play Golf Outlook Temp Humidity Windy Play Golf Overcast Cool Normal TRUE Yes Rainy Hot High FALSE No Rainy Mild High FALSE No Rainy Hot High TRUE No Rainy Cool Normal FALSE Yes Overcast Hot High FALSE Yes Sunny Mild Normal FALSE Yes Sunny Mild High FALSE Yes Rainy Mild Normal TRUE Yes 2 records, 1 No, 1 Yes 3 records, 2 No, 1 Yes − 2+1 3+2 log 2 ( 2+1 3+2 ) Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 10 / 29

  11. An Example of Distributed ID3 Algorithm • For example, Compute the entropy of Rainy . Table: Bob Table: Alice Outlook Temp Humidity Windy Play Golf Outlook Temp Humidity Windy Play Golf Overcast Cool Normal TRUE Yes Rainy Hot High FALSE No Rainy Mild High FALSE No Rainy Hot High TRUE No Rainy Cool Normal FALSE Yes Overcast Hot High FALSE Yes Sunny Mild Normal FALSE Yes Sunny Mild High FALSE Yes Rainy Mild Normal TRUE Yes 2 records, 1 No, 1 Yes 3 records, 2 No, 1 Yes − 2+1 3+2 log 2 ( 2+1 3+2 ) Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 11 / 29

  12. An Example of Distributed ID3 Algorithm • For example, Compute the entropy of Rainy . Table: Bob Table: Alice Outlook Temp Humidity Windy Play Golf Outlook Temp Humidity Windy Play Golf Overcast Cool Normal TRUE Yes Rainy Hot High FALSE No Rainy Mild High FALSE No Rainy Hot High TRUE No Rainy Cool Normal FALSE Yes Overcast Hot High FALSE Yes Sunny Mild Normal FALSE Yes Sunny Mild High FALSE Yes Rainy Mild Normal TRUE Yes 2 records, 1 No, 1 Yes 3 records, 2 No, 1 Yes 2+1 3+2 Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 12 / 29

  13. An Example of Distributed ID3 Algorithm • For example, Compute the entropy of Rainy . Table: Bob Table: Alice Outlook Temp Humidity Windy Play Golf Outlook Temp Humidity Windy Play Golf Overcast Cool Normal TRUE Yes Rainy Hot High FALSE No Rainy Mild High FALSE No Rainy Hot High TRUE No Rainy Cool Normal FALSE Yes Overcast Hot High FALSE Yes Sunny Mild Normal FALSE Yes Sunny Mild High FALSE Yes Rainy Mild Normal TRUE Yes b records, y No, 1 Yes a records, x No, 1 Yes x + y a + b Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 13 / 29

  14. Problem Definition • Compute x + y a + b without reveal a, x, b, y. • Realize Privacy Preserving Distributed ID3 algorithm. Alice Bob b record, y No a record, x No Enc(a) Enc(x) Enc(b) Enc(y) x+y a+b Enc ( · ) – Encryption Algorithm Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 14 / 29

  15. Solution PPWAP • PPWAP: Privacy Preserving Weight Average Protocol • In this project, we choose PPWAP by Pailier Encryption. Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 15 / 29

  16. Pailier Encryption • KeyGeneration () : Generate public key PK , and secret key SK . • Encryption ( m, PK ) : Using PK to encrypt message m , output Enc ( m ) . • Decryption ( Enc ( m ) , SK ) : Using SK to decrypt Enc ( m ) , output m . Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 16 / 29

  17. Pailier Encryption • Property: Addition Homomorphism • Given two messages m 1 and m 2 , Enc ( m 1 + m 2) = Enc ( m 1) · Enc ( m 2) . • The encryption of m 1 + m 2 can be computerd by Enc ( m 1) and Enc ( m 2) . Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 17 / 29

  18. PPWAP based on Pailier Encryption Privacy Preserving Weighted Average Protocol • Within the help of Paillier, build PPWAP scheme. Alice Bob Enc(a) Enc(x) Enc(b) Enc(y) x+y a+b Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 18 / 29

  19. PPWAP Alice Bob 1 . KeyGeneration () : SK, PK Enc ( a ) ⇒ Encryption ( a, PK ) : Enc ( a ) Enc ( x ) Encryption ( x, PK ) : Enc ( x ) Random integer z 2 . Enc ( a ) z , Enc ( x ) z Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 19 / 29

  20. PPWAP Alice Bob 1 . KeyGeneration () : SK, PK Enc ( a ) ⇒ Encryption ( a, PK ) : Enc ( a ) Enc ( x ) Encryption ( x, PK ) : Enc ( x ) Random integer z 2 . Enc ( a ) z , Enc ( x ) z Enc(a) z = Enc(a)...Enc(a) = Enc(a+a+...+a) = Enc(za) Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 20 / 29

  21. PPWAP Alice Bob 1 . KeyGeneration () : SK, PK ⇒ Enc ( a ) Encryption ( a, PK ) : Enc ( a ) Enc ( x ) Encryption ( x, PK ) : Enc ( x ) Random integer z 2 . Enc ( a ) z , Enc ( x ) z Enc ( za ) , Enc ( zx ) Nan Meng (Imaging Systems Laboratory) Two-party Jointly Decision Tree April 29, 2016 21 / 29

Recommend

Secure Multiparty Computation Introduction to Privacy Preserving Distributed Data Mining Li

Secure Multiparty Computation Introduction to Privacy Preserving Distributed Data Mining Li

CS573 Data Privacy and Security Secure Multiparty Computation Introduction to Privacy Preserving Distributed Data Mining Li Xiong Slides credit: Chris Clifton, Purdue University; Murat Kantarcioglu, UT Dallas Outline Overview Data

901 views • 42 slides
GNUnet A network protocol stack for building secure, distributed, and privacy-preserving

GNUnet A network protocol stack for building secure, distributed, and privacy-preserving

GNUnet A network protocol stack for building secure, distributed, and privacy-preserving application FOSDEM20 Martin Schanzenbach 2/2/2020 The Internet is under attack The Internet HTTP, Facebook, Google, Libra ... DNS / X.509 TCP /

631 views • 34 slides
Collaborative Privacy Preserving Data Mining in Vertically Partitioned Databases Ehud Gudes

Collaborative Privacy Preserving Data Mining in Vertically Partitioned Databases Ehud Gudes

Collaborative Privacy Preserving Data Mining in Vertically Partitioned Databases Ehud Gudes Ben-Gurion University, Israel This talk presents joint work with Boris Rozenberg Talk Outline Motivation for Privacy-Preserving Distributed Data

1.48k views • 68 slides
Privacy-Preserving Publish/Subscribe: Efficient Protocols in a

Privacy-Preserving Publish/Subscribe: Efficient Protocols in a

Privacy-Preserving Publish/Subscribe: Efficient Protocols in a Distributed Model Giovanni Di Crescenzo 1 Brian Coan 1 John Schultz 3 Simon Tsang 1 Rebecca N.

338 views • 14 slides
Privacy-Preserving Distributed Information Sharing Lea Kissner leak@cs.cmu.edu Advisor: Dawn

Privacy-Preserving Distributed Information Sharing Lea Kissner leak@cs.cmu.edu Advisor: Dawn

Privacy-Preserving Distributed Information Sharing Lea Kissner leak@cs.cmu.edu Advisor: Dawn Song dawnsong@cmu.edu Why Share? Many applications require mutually distrustful parties to share information Many examples in two major

783 views • 39 slides
DARM: A Privacy-preserving Approach for Distributed Association Rules Mining on

DARM: A Privacy-preserving Approach for Distributed Association Rules Mining on

DARM: A Privacy-preserving Approach for Distributed Association Rules Mining on Horizontally-partitioned Data Presenter: Gaby Dagher Omar Abdel Wahab, Concordia University Moulay Omar Hachami, Concordia University Arslan Zaffari, Concordia

720 views • 31 slides
Privacy Preserving Protocols Workshop on Cryptography for the Internet of Things Jens Hermans KU

Privacy Preserving Protocols Workshop on Cryptography for the Internet of Things Jens Hermans KU

Privacy Preserving Protocols Privacy Preserving Protocols Workshop on Cryptography for the Internet of Things Jens Hermans KU Leuven - COSIC 20 November 2012 Privacy Preserving Protocols Introduction Cryptography in Daily Life RFID Privacy

1.04k views • 60 slides
Privacy-preserving Information Sharing: Crypto Tools and Applications Emiliano De Cristofaro

Privacy-preserving Information Sharing: Crypto Tools and Applications Emiliano De Cristofaro

Privacy-preserving Information Sharing: Crypto Tools and Applications Emiliano De Cristofaro University College London (UCL) https://emilianodc.com Privacy-preserving what ? Parties with limited mutual trust willing or required to share

1.1k views • 66 slides
New Directions in Privacy- preserving Machine Learning Kamalika Chaudhuri University of

New Directions in Privacy- preserving Machine Learning Kamalika Chaudhuri University of

New Directions in Privacy- preserving Machine Learning Kamalika Chaudhuri University of California, San Diego Sensitive Data Medical Records Genetic Data Search Logs AOL Violates Privacy AOL Violates Privacy Netflix Violates Privacy [NS08]

957 views • 92 slides
Privacy-Preserving Computation with Trusted Computing via Scramble-then-Compute Hung Dang, Anh

Privacy-Preserving Computation with Trusted Computing via Scramble-then-Compute Hung Dang, Anh

Privacy-Preserving Computation with Trusted Computing via Scramble-then-Compute Hung Dang, Anh Dinh, Ee-Chien Chang, Beng Chin Ooi School of Computing National University of Singapore PETS 2017 Privacy-Preserving Computation with Trusted

477 views • 34 slides
Preserving the Privacy of Sensitive Relationships in Graph Data Motivation Valuable Data! No

Preserving the Privacy of Sensitive Relationships in Graph Data Motivation Valuable Data! No

Preserving the Privacy of Sensitive Relationships in Graph Data Motivation Valuable Data! No privacy breaches! Public Data Anonymization Data representation? Privacy breach? Value of data? Data publisher Privacy Analyst Work by: Elena

80 views • 3 slides
Privacy preserving data mining randomized response and association rule hiding Li Xiong

Privacy preserving data mining randomized response and association rule hiding Li Xiong

Privacy preserving data mining randomized response and association rule hiding Li Xiong CS573 Data Privacy and Anonymity Partial slides credit: W. Du, Syracuse University, Y. Gao, Peking University Privacy Preserving Data Mining

659 views • 39 slides
Privacy-preserving Biometrics in practice: diffjcult to sell Carmela Troncoso (Gradiant) My

Privacy-preserving Biometrics in practice: diffjcult to sell Carmela Troncoso (Gradiant) My

Privacy-preserving Biometrics in practice: diffjcult to sell Carmela Troncoso (Gradiant) My experience with biometrics and privacy Academic background on privacy Gradiants goal: transfer of knowledge to industry We bring state of

193 views • 6 slides
Network Privacy Mostly issues of preserving privacy of data flowing through network Start

Network Privacy Mostly issues of preserving privacy of data flowing through network Start

Network Privacy Mostly issues of preserving privacy of data flowing through network Start with encryption With good encryption, data values not readable So whats the problem? Lecture 17 Page 1 CS 236 Online Traffic Analysis

532 views • 21 slides
On the Theory and Practice of Privacy-Preserving Bayesian Data Analysis James Foulds,* Joseph

On the Theory and Practice of Privacy-Preserving Bayesian Data Analysis James Foulds,* Joseph

On the Theory and Practice of Privacy-Preserving Bayesian Data Analysis James Foulds,* Joseph Geumlek,* Max Welling, + Kamalika Chaudhuri* + University of Amsterdam *University of California, San Diego Overview Bayesian Privacy-preserving

878 views • 75 slides
Privacy-Preserving Query Processing over Encrypted Data in Cloud CS573 Data Privacy and Security

Privacy-Preserving Query Processing over Encrypted Data in Cloud CS573 Data Privacy and Security

Motivation Two-Cloud Setting PP k NN Classification Conclusion and Future Research Privacy-Preserving Query Processing over Encrypted Data in Cloud CS573 Data Privacy and Security Yousef M. Elmehdwi Department of Mathematics and Computer

919 views • 19 slides
DIMACS/PORTIA Workshop on Privacy Preserving Data Mining Data Mining & Information Privacy:

DIMACS/PORTIA Workshop on Privacy Preserving Data Mining Data Mining & Information Privacy:

DIMACS/PORTIA Workshop on Privacy Preserving Data Mining Data Mining & Information Privacy: New Problems and the Search for Solutions March 15 th , 2004 Tal Zarsky The Information Society Project, Yale Law School Introduction: Various

273 views • 25 slides
Privacy-Preserving DNS Analysis of Broadcast, Range Queries and Mixes Hannes Federrath,

Privacy-Preserving DNS Analysis of Broadcast, Range Queries and Mixes Hannes Federrath,

Privacy-Preserving DNS Analysis of Broadcast, Range Queries and Mixes Hannes Federrath, Karl-Peter Fuchs, Dominik Herrmann , Christopher Piosecny University of Hamburg (Germany) 1 Agenda Missing Privacy in DNS Characteristics of DNS Traffic

559 views • 24 slides
Privacy-preserving KYC on Ethereum Introduction A decentralized KYC-compliant identity Alex

Privacy-preserving KYC on Ethereum Introduction A decentralized KYC-compliant identity Alex

Privacy-preserving KYC on Ethereum Biryukov, Khovratovich, Tikhomirov Privacy-preserving KYC on Ethereum Introduction A decentralized KYC-compliant identity Alex Biryukov, Dmitry Khovratovich, Sergei Tikhomirov Conclusion and future work

828 views • 20 slides
P 4 PCN: Privacy-Preserving Path Probing for Payment Channel Networks Ruozhou Yu, Assistant

P 4 PCN: Privacy-Preserving Path Probing for Payment Channel Networks Ruozhou Yu, Assistant

P 4 PCN: Privacy-Preserving Path Probing for Ruozhou Yu , Yinxin Wan, Vishnu Teja Kilari, Guoliang Xue, Jian Tang, Dejun Yang Payment Channel Networks P 4 PCN: Privacy-Preserving Path Probing for Payment Channel Networks Ruozhou Yu, Assistant

197 views • 5 slides
DPM 2013 Privacy-Preserving Multi-Party Reconciliation Secure in the Malicious Model 8th ACM

DPM 2013 Privacy-Preserving Multi-Party Reconciliation Secure in the Malicious Model 8th ACM

DPM 2013 Privacy-Preserving Multi-Party Reconciliation Secure in the Malicious Model 8th ACM International Workshop on Data Privacy Management 2013 Georg Neugebauer 1 , Lucas Brutschy 1 , Ulrike Meyer 1 and Susanne Wetzel 2 UMIC LuFG IT-Security,

212 views • 17 slides
Privacy-Preserving Outsourcing by Distributed Verifiable Computation Meilof Veeningen Philips

Privacy-Preserving Outsourcing by Distributed Verifiable Computation Meilof Veeningen Philips

Privacy-Preserving Outsourcing by Distributed Verifiable Computation Meilof Veeningen Philips Research MPC 2016, Aarhus, May 30 2016 2 Philips Research 3 Philips Research 4 Philips Research 5 Philips Research 6 Philips Research

529 views • 31 slides
Privacy-Preserving Statistical Data Analysis on Federated Databases Dan Bogdanov Liina Kamm

Privacy-Preserving Statistical Data Analysis on Federated Databases Dan Bogdanov Liina Kamm

Privacy-Preserving Statistical Data Analysis on Federated Databases Dan Bogdanov Liina Kamm Sven Laur Pille Pruulmann-Vengerfeldt Riivo Talviste Jan Willemson Annual Privacy Forum Athens, Greece May 20, 2014 UaESMC Problem Statement

429 views • 17 slides
Back to the Drawing Board: Revisiting the Design of Optimal Location Privacy-preserving

Back to the Drawing Board: Revisiting the Design of Optimal Location Privacy-preserving

Back to the Drawing Board: Revisiting the Design of Optimal Location Privacy-preserving Mechanisms Simon Oya, Carmela Troncoso, Fernando Prez-Gonzlez 1 Motivation. Obfuscation-Based Location Privacy. Location information is sensitive.

521 views • 20 slides

More recommend