Multi-Criteria Dimensionality Reduction with Applications to Fairness UTHAIPON (TAO) TANTIPONGPIPAT (GRADUATING) PHD STUDENT, INDUSTRY JOB MARKET GEORGIA INSTITUTE OF TECHNOLOGY JOINT WORK WITH JAMIE MORGERNSTERN, SAMIRA SAMADI, MOHIT SINGH, AND SANTOSH VEMPALA
PCA can be unfair! Standard PCA on face data LFW of male and female
PCA can be unfair! Standard PCA on face data LFW of Equalizing male and female male and female weight before PCA
Contribution 1: Problem Formulation Multi-criteria dimensionality reduction (MCDR) : projection π π π max 1 π , π 2 π , β¦ , π π π Utility criterion π π βs and social welfare π
Contribution 1: Problem Formulation Multi-criteria dimensionality reduction (MCDR) : projection π π π max 1 π , π 2 π , β¦ , π π π Utility criterion π π βs and social welfare π 2 β π΅ π π πΊ 2 β’ Mar-Loss : min πβ{1,β¦,π} max max π΅ π π πΊ π π π 2 β’ NSW : max Ο π=1 π΅ π π πΊ π
Contribution 2: Algorithms and Guarantees π in ππ T and concave π : On linear π β’ Polynomial-time algorithm for MCDR with optimal utility and small rank violation π‘ = 2π + 1/4 β 3/2 β’ Approximation ratio 1 β π‘/π on utility when no rank violation
Contribution 2: Algorithms and Guarantees π in ππ T and concave π : On linear π β’ Polynomial-time algorithm for MCDR with optimal utility and small rank violation π‘ = 2π + 1/4 β 3/2 β’ Approximation ratio 1 β π‘/π on utility when no rank violation β’ Semi-definite Program (SDP) β Multiplicative Weight (MW) method β’ scalable up to β 1000 dimensions
Contribution 2: Algorithms and Guarantees β’ Mar-Loss : 2 β π΅ π π πΊ 2 min πβ{1,β¦,π} max max π΅ π π πΊ π π β’ NSW : π 2 Ο π=1 max π΅ π π πΊ π
Contribution 3: Optimization Theory β’ Every extreme point of the semi-definite program relaxation of MCDR has low rank β’ Generalize work on low-rank property in semi-definite program by Barvinokβ95, Patakiβ98 β’ Optimization result + ML application
Contribution 4: Complexity of MCDR β’ NP-hard for general π β’ Reduction to MAX-CUT β’ Polynomial-time for fixed π β’ Algorithmic theory of quadratic maps.
More details β’ Poster: Thursday Dec 12 th at 10:45 AM -- 12:45 PM, East Exhibition Hall B + C #80 β’ Happy to chat! β’ Code: github.com/uthaipon/multi-criteria-dimensionality-reduction β’ Web: sites.google.com/site/ssamadi/fair-pca-homepage (searchable links at NeurIPS website or my website Uthaipon Tantipongpipat)
Recommend
More recommend