Sparse PCA / LDA T x A x max T General x B x symmetric matrices - PowerPoint PPT Presentation

Jun 03, 2023 •148 likes •307 views

Baback Moghaddam Machine Learning Group baback @ jpl.nasa.gov NASA Sounder Science Team Meeting November 3 rd - 5 th 2010 Sparse PCA / LDA T x A x max T General x B x symmetric matrices (given) Problem Formulation k card ( x ) x k subject

Baback Moghaddam Machine Learning Group baback @ jpl.nasa.gov NASA Sounder Science Team Meeting November 3 rd - 5 th 2010
Sparse PCA / LDA T x A x max T General x B x symmetric matrices (given) Problem Formulation k card ( x ≤ ) x k subject to : ie . ≤ 0
DNA Microarray • n ~ 10 3 -10 4 genes • m ~ 10 2 samples • 2 classes: cancer vs. healthy subject to : card( x ) = k
x 2 x 1
98% of spectral variance is in 500 frequencies (total of 2500), hence yielding a 5:1 compression AQUA/AIRS radiance data (June 4 th 2007)
Hyperion Sulfur Detection Sparse Classifier (best 12 of 242 channels) 1024-by-256 imagery of Detection Performance (ROC) sulfur-rich Borup Fiord glacier also measured by 242-band Hyperion sensor during 2006-07 For FPR > 1% the 12-band detection rate is as good as using all 242 bands, yielding 20:1 compression ratio
AIRS Dataset July, 2005 ~20,000 spectra Sec3on of Pacific with stratocumulus, cumulus and deep convec3ve clouds
AIRS Spectrum
Cloudy/Clear Classifier : 1-freq H 2 O
Cloudy/Clear Classifier : 2-freqs CO 2 H 2 O
Cloudy/Clear Classifier : 5-freqs CO 2 O 3 H 2 O
Cloudy/Clear Classifier : 50-freqs CO 2 O 3 H 2 O
Current Work • Algorithmic Enhancements • formulated Sparse-LDA as Sparse Regression problem • this speeds up optimization, reduces CPU time by factor of ~10 3 • Dataset Preparation • Selected suitable hyperspectral datasets from AIRS archive • IR spectra for a whole month (huge data matrix = 20000 x 1843) • Visual data in four frequency bands (from AIRS VIS instrument) • Demo of AIRS Cloudy/Clear sparse classifier • Separation of cloudy from clear data based on Level 1 data • Worked with Prof. Yung (Caltech) using their method of cloud separation • Tested 2 methods of cloud separation by AIRS Project Scientist G. Aumann
Future Work • Methodology • Test current algorithm with a 3 rd cloud separation criterion (based on CO 2 retrievals) as suggested/used by Bill Irion (JPL) • Select more varied AIRS datasets (ocean and land regions separated) and perform cross-dataset validation • Missions • Meet with AIRS Science Team to discuss and propose new product (L1 D) based on our preliminary Sparse-LDA algorithm results
Publications

Recommend

Sparse Matrices Example Of Sparse Matrices diagonal tridiagonal sparse many elements are

Sparse Matrices Example Of Sparse Matrices diagonal tridiagonal sparse many elements are zero lower triangular (?) dense few elements are zero These are structured sparse matrices. May be mapped into a 1D array so that a mapping

391 views • 6 slides

Sparse Matrices sparse many elements are zero dense few elements are zero Example Of

Sparse Matrices sparse many elements are zero dense few elements are zero Example Of Sparse Matrices diagonal tridiagonal lower triangular (?) These are structured sparse matrices. May be mapped into a 1D array so that a mapping

698 views • 11 slides

= + N 1 N M measurements M 1 sparse signal Problem : Solve for x Basis pursuit,

Sparse processing / Compressed sensing Model : y = Ax + n , x is sparse = + N 1 N M measurements M 1 sparse signal Problem : Solve for x Basis pursuit, LASSO (convex objective function) Matching pursuit (greedy method)

210 views • 17 slides

Tutorial: Sparse Recovery Using Sparse Matrices Piotr Indyk MIT Problem Formulation

Tutorial: Sparse Recovery Using Sparse Matrices Piotr Indyk MIT Problem Formulation (approximation theory, learning Fourier coeffs, linear sketching, finite rate of innovation, compressed sensing...) Setup: Data/signal in n-dimensional

418 views • 25 slides

Sparse Representations The Sparse Representations (SRs) framework was inspired by studies of

Manifold Based Sparse Representation for Robust Expression Recognition without Neutral Subtraction Raymond Ptucha, Grigorios Tsagkatakis, Andreas Savakis Department of Computer Engineering, Rochester Institute of Technology, Rochester, NY Nov

411 views • 11 slides

Tutorial: TF-Ranking for sparse features Tutorial: TF-Ranking for sparse features This tutorial

Tutorial: TF-Ranking for sparse features Tutorial: TF-Ranking for sparse features This tutorial is an end-to-end walkthrough of training a TensorFlow Ranking (TF-Ranking) neural network model which incorporates sparse textual features.

257 views • 24 slides

Extremal results for sparse pseudorandom graphs Yufei Zhao Massachusetts Institute of Technology

Extremal results for sparse pseudorandom graphs Yufei Zhao Massachusetts Institute of Technology Joint work with David Conlon and Jacob Fox Sparse extensions Extending classical results to sparse settings. For example: Sparse extensions

882 views • 55 slides

Parallel Numerical Algorithms Chapter 4 Sparse Linear Systems Section 4.1 Direct Methods

Sparse Matrices Sparse Triangular Solve Cholesky Factorization Sparse Cholesky Factorization Parallel Numerical Algorithms Chapter 4 Sparse Linear Systems Section 4.1 Direct Methods Michael T. Heath and Edgar Solomonik Department of

906 views • 63 slides

Outline Background Sparse Coding Semi-supervised Learning with Sparse Coding

Sparse-coded Net Model and Applications Y. Gwon, M. Cha, W. Campbell, H.T. Kung, C. Dagli IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2016) September 16, 2016 This work is sponsored by the

416 views • 17 slides

CNBC Matlab Mini-Course Sparse Matrices Sparse matrices provide an efficient means to store

CNBC Matlab Mini-Course Sparse Matrices Sparse matrices provide an efficient means to store matrices that are mostly empty. David S. Touretzky s = sparse(1000, 1000) October 2019 s(2, 11) = 2 s(992, 875) = 3 Day 3: The Really Cool Stuff

550 views • 6 slides

sparse matrices and graphs L. Olson Department of Computer Science University of Illinois at

sparse matrices and graphs L. Olson Department of Computer Science University of Illinois at Urbana-Champaign 1 objectives Convert a graph into a sparse matrix Go over a few sparse matrix storage formats Give an example of lower

513 views • 24 slides

Exploiting GPU Caches in Sparse Matrix Vector Multiplication Yusuke Nagasaka Tokyo Institute of

Exploiting GPU Caches in Sparse Matrix Vector Multiplication Yusuke Nagasaka Tokyo Institute of Technology Sparse Matrix Generated by FEM, being as the graph data Often require solving sparse linear equation fast Iterative method :

629 views • 30 slides

Sparse and TV Kaczmarz solvers and the linearized Bregman method Dirk Lorenz, Frank Schpfer,

Sparse and TV Kaczmarz solvers and the linearized Bregman method Dirk Lorenz, Frank Schpfer, Stephan Wenger, Marcus Magnor, March, 2014 Sparse Tomo Days, DTU Motivation Split feasibility problems Sparse Kaczmarz and TV-Kaczmarz Application

1.04k views • 67 slides

MLSS 06 - Canberra Elements Hierarchical Basis Sparse Grids Sparse Grids Combination

MLSS 06 - Canberra Sparse Grids Jochen Garcke (Very) Short Course on Finite MLSS 06 - Canberra Elements Hierarchical Basis Sparse Grids Sparse Grids Combination Technique Jochen Garcke Regression / Classification via Function

977 views • 68 slides

Parameter efficient training of deep convolutional neural networks by dynamic sparse

Parameter efficient training of deep convolutional neural networks by dynamic sparse reparameterization Hesham Mostafa (Intel AI) Xin Wang (Intel AI, Cerebras Systems) Easy : post-training (sparse) compression Hard : direct training of sparse

727 views • 9 slides

Lecture 5 : Sparse Models Homework 3 discussion (Nima) Sparse Models Lecture - Reading :

Lecture 5 : Sparse Models Homework 3 discussion (Nima) Sparse Models Lecture - Reading : Murphy, Chapter 13.1, 13.3, 13.6.1 - Reading : Peter Knee, Chapter 2 Paolo Gabriel (TA) : Neural Brain Control After class - Project groups

571 views • 28 slides

High-Dimensional Pattern Recognition via Sparse Representation Allen Y. Yang University of

Introduction Sparse Representation Sparse Optimization Wearable Augmented Reality Conclusion High-Dimensional Pattern Recognition via Sparse Representation Allen Y. Yang University of California, Berkeley and Atheer, Inc. UC Berkeley, June

498 views • 47 slides

Taming the Beast: Topic imaging Predictive approach Sparse Machine Learning for Large Text

Sparse ML for Text 1/33 L. El Ghaoui Information Overload Taming the Beast: Topic imaging Predictive approach Sparse Machine Learning for Large Text Corpora Visualizaations Beyond co-occurence Examples Research Agenda Sparse PCA Laurent

488 views • 47 slides

Sparse sampling sampling design in design in Sparse population PK/PD studies studies

Sparse sampling sampling design in design in Sparse population PK/PD studies studies population PK/PD Sylvie Retout & France Mentr INSERM U738, Universit Paris 7, UFR de Mdecine, Hpital Bichat, Paris. 1 Outline Outline

674 views • 21 slides

Submanifold Sparse Convolutional Networks for Sparse, Locally Dense Particle Image Analysis

Submanifold Sparse Convolutional Networks for Sparse, Locally Dense Particle Image Analysis Laura Domine (Stanford / SLAC) Kazuhiro Terao (SLAC) 2018 CPAD Instrumentation Frontier Workshop 1 Outline 1. Particle image analysis &

799 views • 31 slides

Sparse CCA using Lasso Anastasia Lykou & Joe Whittaker Department of Mathematics and

Introduction CCA Lasso Sparse CCA Summary Sparse CCA using Lasso Anastasia Lykou & Joe Whittaker Department of Mathematics and Statistics, Lancaster University July 23, 2008 Introduction CCA Lasso Sparse CCA Summary Outline

447 views • 34 slides

Parallel Sparse Matrix-Vector and Matrix- Transpose-Vector Multiplication using Compressed Sparse

Parallel Sparse Matrix-Vector and Matrix- Transpose-Vector Multiplication using Compressed Sparse Blocks Aydn Bulu, UCSB Jeremy T. Fineman (MIT) Matteo Frigo (Cilk Arts) John R. Gilbert (UCSB) Charles E. Leiserson (MIT & Cilk Arts) 1

523 views • 21 slides

Cache&aware)Sparse)Matrix)Formats)) for)Kepler)GPU

Cache&aware)Sparse)Matrix)Formats)) for)Kepler)GPU Yusuke&Nagasaka,&Akira&Nukada,&Satoshi&Matsuoka& Tokyo&Ins8tute&of&Technology& & Sparse)Matrix

563 views • 27 slides

From simple structure to sparse components: a comparative introduction Nickolay T. Trendafilov

ERCIM12, Session ES11: Sparse dimension reduction, 1-3 December 2012, Conference Centre, Oviedo, Spain From simple structure to sparse components: a comparative introduction Nickolay T. Trendafilov Department of Mathematics and Statistics

595 views • 30 slides