flow cytometry data compression
play

FLOW CYTOMETRY DATA COMPRESSION A.E. Bras PhD Student Erasmus - PowerPoint PPT Presentation

Dec 07, 2022 •254 likes •950 views

FLOW CYTOMETRY DATA COMPRESSION A.E. Bras PhD Student Erasmus University, Rotterdam, the Netherlands Flow Cytometry Flow Cytometry Flow Cytometry Flow Cytometry Flow Cytometry Flow Cytometry Older Systems Older Systems Newer Systems

  1. FLOW CYTOMETRY – DATA COMPRESSION A.E. Bras PhD Student Erasmus University, Rotterdam, the Netherlands

  2. Flow Cytometry

  3. Flow Cytometry

  4. Flow Cytometry

  5. Flow Cytometry

  6. Flow Cytometry

  7. Flow Cytometry

  8. Older Systems

  9. Older Systems

  10. Newer Systems

  11. Newer Systems

  12. Newer Systems

  13. Newer Systems FLOATING POINT DATA - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

  14. Newer Systems FLOATING POINT DATA - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - MILLIONS - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

  15. Storage FLOATING POINT DATA - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - MILLIONS - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

  16. Storage .FCS FLOATING POINT DATA - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - MILLIONS - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

  17. Storage FLOW CYTOMETRY STRANDARD .FCS FLOATING POINT DATA - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - MILLIONS - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

  18. Storage FLOW CYTOMETRY STRANDARD .FCS PRO WIDELEY USED FLOATING POINT DATA - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - MILLIONS - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

  19. Storage FLOW CYTOMETRY STRANDARD .FCS PRO WIDELEY USED FLOATING POINT DATA - - - - - - - - - - - - CON - - - - - - - - - - - - NO COMPRESSION - - - - - - - - - - - - MILLIONS - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

  20. Lossless Compression .FCS

  21. Lossless Compression .FCS ≈ 70 % .ZIP

  22. Lossless Compression .FCS ≈ 70 % .ZIP Better alternative?

  23. Lossless Compression - Benchmark

  24. Lossless Compression - Benchmark .FCS 167.131

  25. Lossless Compression - Benchmark RANDOM .FCS 167.131

  26. Lossless Compression - Benchmark RANDOM .FCS 167.131

  27. Lossless Compression - Benchmark CODEC RATIO CODEC RATIO LZIP 0.533 ZPAQ 0.460 LZMA 0.533 BCM 0.510 XZ 0.533 LZIP 0.533 GLZA 0.558 LZMA 0.533 LZHAM 0.568 FLZMA2 0.539 CSC 0.590 LZHAM 0.569 BROTLI 0.598 BROTLI 0.571 TORNADO 0.622 BZIP2 0.580 ZSTD 0.626 CSC 0.590 XPACK 0.637 BALZ 0.598 ZLING 0.665 XPACK 0.612 LIBDEFLATE 0.676 ZSTD 0.625 LZFSE 0.690 ZOPFLI 0.674 RANDOM CRUSH 0.692 LIBDEFLATE 0.676 ZLIB 0.695 LZFSE 0.690 UCL_NRV2D 0.725 CRUSH 0.692 UCL_NRV2E 0.725 ZLIB 0.695 UCL_NRV2B 0.734 BRIEFLZ 0.727 LZO1X 0.755 DOBOZ 0.750 LZO1Z 0.757 LZSSE8 0.758 LZSSE8 0.758 BSCQLFC 0.763 LZO1Y 0.768 LZSSE2 0.768 LZSSE2 0.768 LZ4 0.777 LIZARD 0.770 LZSSE4 0.781 DENSITY 0.771 LZG 0.803 .FCS LZO2A 0.774 SUBOTIN 0.819 LZO1B 0.775 FASTAC 0.819 LZ4HC 0.777 ZLIBH 0.823 167.131 ... ... ... ...

  28. Lossless Compression - Benchmark CODEC RATIO CODEC RATIO LZIP 0.533 ZPAQ 0.460 LZMA 0.533 BCM 0.510 XZ 0.533 LZIP 0.533 GLZA 0.558 LZMA 0.533 LZHAM 0.568 FLZMA2 0.539 CSC 0.590 LZHAM 0.569 BROTLI 0.598 BROTLI 0.571 TORNADO 0.622 BZIP2 0.580 ZSTD 0.626 CSC 0.590 XPACK 0.637 BALZ 0.598 ZLING 0.665 XPACK 0.612 LIBDEFLATE 0.676 ZSTD 0.625 LZFSE 0.690 ZOPFLI 0.674 RANDOM CRUSH 0.692 LIBDEFLATE 0.676 ZLIB 0.695 LZFSE 0.690 UCL_NRV2D 0.725 CRUSH 0.692 UCL_NRV2E 0.725 ZLIB 0.695 UCL_NRV2B 0.734 BRIEFLZ 0.727 LZO1X 0.755 DOBOZ 0.750 LZO1Z 0.757 LZSSE8 0.758 LZSSE8 0.758 BSCQLFC 0.763 LZO1Y 0.768 LZSSE2 0.768 LZSSE2 0.768 LZ4 0.777 LIZARD 0.770 LZSSE4 0.781 DENSITY 0.771 LZG 0.803 .FCS LZO2A 0.774 SUBOTIN 0.819 LZO1B 0.775 FASTAC 0.819 LZ4HC 0.777 ZLIBH 0.823 167.131 ... ... ... ...

  29. Lossless Compression - Benchmark CODEC RATIO CODEC RATIO LZIP 0.533 ZPAQ 0.460 LZMA 0.533 BCM 0.510 XZ 0.533 LZIP 0.533 GLZA 0.558 LZMA 0.533 LZHAM 0.568 FLZMA2 0.539 CSC 0.590 LZHAM 0.569 BROTLI 0.598 BROTLI 0.571 TORNADO 0.622 BZIP2 0.580 ZSTD 0.626 CSC 0.590 XPACK 0.637 BALZ 0.598 ZLING 0.665 XPACK 0.612 LIBDEFLATE 0.676 ZSTD 0.625 LZFSE 0.690 ZOPFLI 0.674 CRUSH 0.692 LIBDEFLATE 0.676 ZLIB 0.695 LZFSE 0.690 UCL_NRV2D 0.725 CRUSH 0.692 UCL_NRV2E 0.725 ZLIB 0.695 UCL_NRV2B 0.734 BRIEFLZ 0.727 LZO1X 0.755 DOBOZ 0.750 LZO1Z 0.757 LZSSE8 0.758 LZSSE8 0.758 BSCQLFC 0.763 LZO1Y 0.768 LZSSE2 0.768 LZSSE2 0.768 LZ4 0.777 LIZARD 0.770 LZSSE4 0.781 DENSITY 0.771 LZG 0.803 .FCS LZO2A 0.774 SUBOTIN 0.819 LZO1B 0.775 FASTAC 0.819 LZ4HC 0.777 ZLIBH 0.823 167.131 ... ... ... ...

  30. Lossless Compression - Benchmark

  31. Lossless Compression - Benchmark ≈ 0.45

  32. Implementation in R

  33. Implementation in R base::memCompress(type=" XZ ")

  34. Implementation in R base::memCompress(type=" XZ ")

  35. Bioconductor - flowCore

  36. Bioconductor - flowCore

  37. Bioconductor - flowCore C:\input.fcs flowCore::read.FCS flowSom::FlowSOM flowCore::write.FCS C:\output.fcs

  38. Bioconductor - flowCore base::readBin C:\input.fcs flowCore::read.FCS flowSom::FlowSOM flowCore::write.FCS C:\output.fcs

  39. Bioconductor - flowCore base::readBin C:\input.fcs flowCore::read.FCS flowSom::FlowSOM flowCore::write.FCS base::writeBin C:\output.fcs

  40. Bioconductor - flowCore base::readBin C:\input.fcs flowCore::read.FCS flowSom::FlowSOM flowCore::write.FCS base::memCompress base::writeBin C:\output.fcs

  41. Bioconductor - flowCore base::readBin C:\input.fcs base::memDecompress flowCore::read.FCS flowSom::FlowSOM flowCore::write.FCS base::memCompress base::writeBin C:\output.fcs

  42. Bioconductor - flowCore C:\input.fcs flowCore::read.FCS flowSom::FlowSOM flowCore::write.FCS .TAR.GZ C:\output.fcs

  43. Bioconductor - flowCore C:\input.fcs flowCore::read.FCS flowSom::FlowSOM flowCore::write.FCS .TAR.GZ C:\output.fcs

  44. Bioconductor - flowCore C:\input.fcs flowCore::read.FCS flowSom::FlowSOM flowCore::write.FCS .TAR.GZ C:\output.fcs

  45. Bioconductor - flowCore C:\input.fcs flowCore::read.FCS flowSom::FlowSOM flowCore::write.FCS .FCS.XZ C:\output.fcs

  46. Bioconductor - flowCore C:\input.fcs flowCore::read.FCS flowSom::FlowSOM flowCore::write.FCS .FCS.XZ C:\output.fcs

  47. Bioconductor - flowCore C:\input.fcs flowCore::read.FCS flowSom::FlowSOM flowCore::write.FCS .FCS.XZ C:\output.fcs

  48. Bioconductor - flowCore C:\input.fcs flowCore::read.FCS flowSom::FlowSOM flowCore::write.FCS .FCS.XZ C:\output.fcs

  49. Bioconductor – flowCore - Pipelines

  50. Bioconductor – flowCore - Pipeline C:\input\01.fcs C:\input\02.fcs flowCore::read.flowSet flowCore::write.flowSet C:\output\01.fcs C:\output\02.fcs

  51. Bioconductor – flowCore - Pipeline C:\input.zip base::unzip C:\input\01.fcs C:\input\02.fcs flowCore::read.flowSet flowCore::write.flowSet C:\output\01.fcs C:\output\02.fcs

  52. Bioconductor – flowCore - Pipeline C:\input.zip base::unzip C:\input\01.fcs C:\input\02.fcs flowCore::read.flowSet flowCore::write.flowSet C:\output\01.fcs C:\output\02.fcs base::zip C:\output.zip

  53. Bioconductor – flowCore - Pipeline C:\input.zip base::unzip C:\input\01.fcs C:\input\02.fcs flowCore::read.flowSet flowCore::write.flowSet C:\output\01.fcs C:\output\02.fcs base::zip C:\output.zip

  54. Bioconductor – flowCore - Pipeline C:\input.zip base::unzip C:\input\01.fcs C:\input\02.fcs flowCore::read.flowSet ARCHIVAL flowCore::write.flowSet CYTOMETRY STANDARD C:\output\01.fcs C:\output\02.fcs .ACS base::zip C:\output.zip

  55. Bioconductor – flowCore - Pipeline = ARCHIVAL CYTOMETRY STANDARD .ACS .ZIP

  56. Bioconductor – flowCore - Pipeline = ARCHIVAL CYTOMETRY .FCS .FCS .FCS STANDARD .ACS .ZIP

  57. Bioconductor – flowCore - Pipeline .TXT = ARCHIVAL CYTOMETRY .FCS .FCS .FCS STANDARD .ACS .ZIP

Recommend

Cytometry Flow Cytometry Flow Cytometry is the technological process that allows for the

Cytometry Flow Cytometry Flow Cytometry is the technological process that allows for the

Basic Principles in Flow Cytometry Flow Cytometry Flow Cytometry is the technological process that allows for the individual measurements of cell fluorescence and light scattering. This process is performed at rates of thousands of cells

214 views • 20 slides
Flow Cytometry What is Flow Cytometry? What Is It Used For? Measure many different

Flow Cytometry What is Flow Cytometry? What Is It Used For? Measure many different

Flow Cytometry What is Flow Cytometry? What Is It Used For? Measure many different parameters on the same cell Protein expression DNA content Immunophenotype cells Sorting cells into different tubes based

126 views • 12 slides
Introduction to Flow Cytometry presented by: Flow Cytometry Core Facility Flow Cytometry Core

Introduction to Flow Cytometry presented by: Flow Cytometry Core Facility Flow Cytometry Core

Introduction to Flow Cytometry presented by: Flow Cytometry Core Facility Flow Cytometry Core Facility Biomedical Instrumentation Center Uniformed Services University f d Topics Covered in this Lecture Topics Covered in this Lecture

762 views • 43 slides
DC CFAR VIRTUAL LAB OPEN HOUSE MULTIPARAMETRIC FLOW CYTOMETRY May 22, 2020 What is

DC CFAR VIRTUAL LAB OPEN HOUSE MULTIPARAMETRIC FLOW CYTOMETRY May 22, 2020 What is

DC CFAR VIRTUAL LAB OPEN HOUSE MULTIPARAMETRIC FLOW CYTOMETRY May 22, 2020 What is Multiparametric Flow Cytometry? Multiparameter flow cytometry is a powerful analytical and preparative tool ( 1,2). It enables the rapid measurement of multiple

200 views • 18 slides
Standardization of extracellular vesicle measurements by flow cytometry Edwin van der Pol

Standardization of extracellular vesicle measurements by flow cytometry Edwin van der Pol

Standardization of extracellular vesicle measurements by flow cytometry Edwin van der Pol November 19th, 2019 Outline Small particles: extracellular vesicles (EVs) Flow cytometry limitations Calibration Solid beads are misleading Swarm

681 views • 42 slides
Flow Cytometry Analysis Determining cell types using deep learning techniques Creating

Flow Cytometry Analysis Determining cell types using deep learning techniques Creating

Flow Cytometry Analysis Determining cell types using deep learning techniques Creating software to allow streamlined process for flow cytometry analysis Nathan Wong The problem FlowJo Variability in Data Problem statement The

593 views • 16 slides
IN IN CELLULAR THERAPY STANDARDS IN FLOW CYTOMETRY OVERVIEW Reproducibility &

IN IN CELLULAR THERAPY STANDARDS IN FLOW CYTOMETRY OVERVIEW Reproducibility &

PRODUCT CHARACTERIZATION IN IN CELLULAR THERAPY STANDARDS IN FLOW CYTOMETRY OVERVIEW Reproducibility & Variability in Pre-Clinical Research Standards, Practices & Policies in Flow Cytometry (FCM) Case Study: FCM for stem

373 views • 16 slides
On the Use of NMF and curvHDR to Cluster Flow Cytometry Data e M. Maisog 1,2 , Andrea A. Barbo 2 ,

On the Use of NMF and curvHDR to Cluster Flow Cytometry Data e M. Maisog 1,2 , Andrea A. Barbo 2 ,

On the Use of NMF and curvHDR to Cluster Flow Cytometry Data e M. Maisog 1,2 , Andrea A. Barbo 2 , George Luta 2 Jos 1 Medical Numerics, Inc., Germantown, MD 20876 2 Department of Biostatistics, Bioinformatics, and Biomathematics, Georgetown

1.11k views • 63 slides
THE BIOCONDUCTOR PACKAGE FLOWCORE, A SHARED DEVELOPMENT PLATFORM FOR FLOW CYTOMETRY DATA

THE BIOCONDUCTOR PACKAGE FLOWCORE, A SHARED DEVELOPMENT PLATFORM FOR FLOW CYTOMETRY DATA

THE BIOCONDUCTOR PACKAGE FLOWCORE, A SHARED DEVELOPMENT PLATFORM FOR FLOW CYTOMETRY DATA ANALYSIS IN R N. Le Meur 1,2 , F. Hahne 1 , R. Brinkman 3 , B. Ellis 5 , P. Haaland 4 , D. Sarkar 1 , J. Spidlen 3 , E. Strain 4 , R. Gentleman 1 1 Fred

201 views • 16 slides
Molecular Medicine Postgraduate School Course Biomedical Research Techniques FLOW CYTOMETRY

Molecular Medicine Postgraduate School Course Biomedical Research Techniques FLOW CYTOMETRY

Molecular Medicine Postgraduate School Course Biomedical Research Techniques FLOW CYTOMETRY November , 2017 Jaco Kraan, PhD Dept. of Medical Oncology Erasmus MC Cancer Institute j.kraan@erasmusmc.nl FLOW CYTOMETRY Introduction

883 views • 45 slides
Flow Cytometry Orientation http://web.mit.edu/flowcytometry/www/ Glenn Paradis Director of

Flow Cytometry Orientation http://web.mit.edu/flowcytometry/www/ Glenn Paradis Director of

Flow Cytometry Orientation http://web.mit.edu/flowcytometry/www/ Glenn Paradis Director of the Koch Institute Flow Cytometry Core Facility Sorting Facility 76-279 Analyzer Facility 76-273 Spectra of Fluorophores

460 views • 25 slides
Phenotyping and Robust Feature Selection for Flow Cytometry Data Nima Aghaeepour CIHR/MSFHR

Phenotyping and Robust Feature Selection for Flow Cytometry Data Nima Aghaeepour CIHR/MSFHR

Phenotyping and Robust Feature Selection for Flow Cytometry Data Nima Aghaeepour CIHR/MSFHR Strategic Training Program in Bioinformatics for Health Research, University of British Columbia Sep 22, 2011 1 / 24 Introduction Problem statement

767 views • 25 slides
SamSPECTRAL: Efficient spectral clustering ffi i l l i on flow cytometry data Habil Zare PhD

SamSPECTRAL: Efficient spectral clustering ffi i l l i on flow cytometry data Habil Zare PhD

SamSPECTRAL: Efficient spectral clustering ffi i l l i on flow cytometry data Habil Zare PhD Candidate Terry Fox Laboratory, British Columbia Cancer Agency and Department of Computer Science, British Columbia University Vancouver, Canada

846 views • 27 slides
FLOW CYTOMETRY November 1th, 2018 Jaco Kraan, PhD Dept. of Medical Oncology Erasmus MC Cancer

FLOW CYTOMETRY November 1th, 2018 Jaco Kraan, PhD Dept. of Medical Oncology Erasmus MC Cancer

Molecular Medicine Postgraduate School Course Biomedical Research Techniques FLOW CYTOMETRY November 1th, 2018 Jaco Kraan, PhD Dept. of Medical Oncology Erasmus MC Cancer Institute j.kraan@erasmusmc.nl FLOW CYTOMETRY Introduction

613 views • 45 slides
Flow Cytometry Techniques Caf Andrew Sharon Jack HyungJo Hwang Justin Liang Mizuki Kurashina

Flow Cytometry Techniques Caf Andrew Sharon Jack HyungJo Hwang Justin Liang Mizuki Kurashina

Flow Cytometry Techniques Caf Andrew Sharon Jack HyungJo Hwang Justin Liang Mizuki Kurashina What is Flow Cytometry? High-throughput technique to analyse and/or sort cells Utilizes microfluidics and lasers to measure parameters

613 views • 12 slides
Spectral Flow Cytometry Definition No Nola lan an and d Condello llo (20 2013) Cur urrent

Spectral Flow Cytometry Definition No Nola lan an and d Condello llo (20 2013) Cur urrent

Spectral Flow Cytometry Definition No Nola lan an and d Condello llo (20 2013) Cur urrent t Pro rotocols ls in n Cytometry ry Spectra of dyes excited by blue (488 nm) laser Cytek Auroras Optical Design Unique Optical Design

336 views • 31 slides
Flow Cytometry Data Assessment Flow Cytometry Data Assessment with L2 Discrepancy Learning with

Flow Cytometry Data Assessment Flow Cytometry Data Assessment with L2 Discrepancy Learning with

Flow Cytometry Data Assessment Flow Cytometry Data Assessment with L2 Discrepancy Learning with L2 Discrepancy Learning with L2 Discrepancy Learning with L2 Discrepancy Learning Process Process Faysal El Khettabi Faysal El Khettabi Faysal

429 views • 14 slides
New CLSI Document for the Validation of Methods Preformed by Flow Cytometry Sneak Peek and

New CLSI Document for the Validation of Methods Preformed by Flow Cytometry Sneak Peek and

New CLSI Document for the Validation of Methods Preformed by Flow Cytometry Sneak Peek and Update Virginia Litwin, Ph.D. Vice President, Immunology CLSI H62 Validation of Methods Performed by Flow Cytometry Sneak Peek Overview

905 views • 65 slides
Detection of microparticles by flow cytometry Edwin van der Pol May 21st, 2013 Biomedical

Detection of microparticles by flow cytometry Edwin van der Pol May 21st, 2013 Biomedical

Detection of microparticles by flow cytometry Edwin van der Pol May 21st, 2013 Biomedical Engineering and Physics Laboratory Experimental Clinical Chemistry Academic Medical Center, Amsterdam, The Netherlands 1 Microparticles and flow

1.39k views • 28 slides
Tools for MRD in AML: flow cytometry Francesco Buccisano Can MRD improve outcome determina3on?

Tools for MRD in AML: flow cytometry Francesco Buccisano Can MRD improve outcome determina3on?

ACUTE MYELOID LEUKEMIA MEETING Ravenna - October 27, 2017 Tools for MRD in AML: flow cytometry Francesco Buccisano Can MRD improve outcome determina3on? Relapse 12 10 leukemic cells 10 10 CR 8 10 6 10 MRD No. of 4 10 2 10 Cure 0 10 Time This

751 views • 25 slides
Know the Excitation and Emission Spectra of Your Fluorophores Flow Cytometry Orientation

Know the Excitation and Emission Spectra of Your Fluorophores Flow Cytometry Orientation

Know the Excitation and Emission Spectra of Your Fluorophores Flow Cytometry Orientation http://web.mit.edu/flowcytometry/www/ Glenn Paradis Sorting Facility 76-279 Analyzer Facility 76-273 Quartz Cuvette Do Not Run Your Test Tube Dry

173 views • 6 slides
Transfer Learning for Auto-gating of Flow Cytometry Data Gyemin Lee Lloyd Stoolman Clayton

Transfer Learning for Auto-gating of Flow Cytometry Data Gyemin Lee Lloyd Stoolman Clayton

Transfer Learning for Auto-gating of Flow Cytometry Data Gyemin Lee Lloyd Stoolman Clayton Scott University of Michigan ICML 2011 Workshop on Unsupervised and Transfer Learning July 2, 2011 Lee, Stoolman, Scott (University of Michigan) TL

736 views • 15 slides
Data compression anhtt-fit@mail.hut.edu.vn dungct@it-hut.edu.vn Data Compression Data in memory

Data compression anhtt-fit@mail.hut.edu.vn dungct@it-hut.edu.vn Data Compression Data in memory

Data compression anhtt-fit@mail.hut.edu.vn dungct@it-hut.edu.vn Data Compression Data in memory have used fixed length for representation For data transfer (in particular), this method is inefficient. For speed and storage

858 views • 22 slides
From Sorting to Heaps to Compression Data Compression video on demand/set top box jpeg

From Sorting to Heaps to Compression Data Compression video on demand/set top box jpeg

From Sorting to Heaps to Compression Data Compression video on demand/set top box jpeg in browsers gzip, pkzip, compress, zip, ... for files (stacker?) Lossy compression, Lossless compression Huffman coding possible to

275 views • 6 slides

More recommend