scaling investigations
play

Scaling Investigations with GPU Visual Graph Analytics Workflows G - PowerPoint PPT Presentation

Oct 13, 2023 •133 likes •349 views

Scaling Investigations with GPU Visual Graph Analytics Workflows G R A P H I S T R Y Leo Meyerovich, CEO @LMeyerov Graphistry Inc. 2017 info@graphistry.com Today Investigation A weird yet common problem Graph are amazing

  1. Scaling Investigations with GPU Visual Graph Analytics Workflows G R A P H I S T R Y Leo Meyerovich, CEO @LMeyerov Graphistry Inc. 2017 info@graphistry.com

  2. Today Investigation … A weird yet common problem Graph are amazing … Investigation analytics + the UI for ML (Some of) Graphistry’s tech: GPU accelerating the web … First client<>cloud GPU platform + GoAI initiative for multi-vendor GPU interop (incl. nodejs!) Graphistry Inc. 2017 info@graphistry.com 2

  3. IP=10.16.0.8; msg=Spear phishing clicked; time=2 Nov 2017 19:32:00 UTC; vendor=Blue Coat Graphistry Inc. 2017 info@graphistry.com 3

  4. Graphistry Inc. 2017 info@graphistry.com 4

  5. Graphistry Inc. 2017 info@graphistry.com 5

  6. 5-100 tools, APIs, tables 10M - 1B events / day Manually search Manually link & repeat Hope it’s not pool night for your senior analysts Graphistry Inc. 2017 info@graphistry.com 6

  7. Graphistry Inc. 2017 info@graphistry.com 7

  8. Can we turn 30min – 1 week into < 10min? • Query for the right data • Find the connections Amdahl’s Law: • Make the right conclusions Max improvement constrained by slowest step • … repeat è need story on full è Appropriate actions investigation process Graphistry Inc. 2017 info@graphistry.com 8

  9. This is the dirty reality behind many important things we don’t hear about • Security SOC, IR, Hunting, & Intel • Genomics & health records • Anti-Fraud: E-commerce, AML, … • Big systems: NOC, DevOps, IOT, … • Gov: Anti-human trafficking, … • Finance: Risk, Loans, … Graphistry Inc. 2017 info@graphistry.com 9

  10. Low-Dimensional: Lists, Pie Charts, Bar Charts, Heatmaps, … > $ select * from ALERTS where PRIORITY > 8 ?? srcIP dstIP alert score time … … … … … Page 1 … 99 Graphistry Inc. 2017 info@graphistry.com 10

  11. Graphs = Maps for Data? Show all events & entities involved, how they relate, and enable people & computers to easily interact with them Graphistry Inc. 2017 info@graphistry.com 11

  12. Graphs Answer Tricky Questions Progression & behavior Patterns, correlations, & outliers Entities & scope Graphistry Inc. 2017 info@graphistry.com 12

  13. Intuition: All Entity & Event Correlations = Hypergraphs ip1 url1 e1 url2 alert1 e2 url3 e2 ip2 Graphistry Inc. 2017 info@graphistry.com 13

  14. Enterprise Trend: Graph = The Correlation Service Prioritization Days events è grouped incidents … Investigation è Click for context around an alert Interactive ML without knowing any Graph layouts = visual understanding & manipulation of many clustering & inference algorithms for high-dimensional data…!!! Graphistry Inc. 2017 info@graphistry.com 14

  15. GPUs Inside: Kernels Accelerate Every Component 10-1000X Interactive Rendering 1+ million entities: 100X+ over D3.js Meaningful Viz: Layout & ML Smart clustering, coloring, sizing: 50X+ over Gephi Interactive Analytics Quickly drill down: 1 NVidia Tesla K80 = ~9 TFLOPS Graphistry Inc. 2017 info@graphistry.com 15

  16. 100X Speedups: We Make Your Device Span GPU Client + Cloud Optimized networking 20ms 50ms GovCloud GPU rendering GPU analytics & viz (No JavaScript!) Graphistry Inc. 2017 info@graphistry.com 16

  17. To combine GPU analytics frameworks (… & in JavaScript!!) … builders are standardizing on Arrow columnar file format 2. New: 3 rd Party GPU Analytics GRAPHISTRY BOX data.arrow data.arrow (gpu pointer) INPUT DATA pyGDF Spark, SQL, Pandas, … MapD In-house … GPU kernels 1. Arrow Input: (nodejs app) Ingest More Data, Faster Graphistry Inc. 2017 info@graphistry.com 17

  18. Arrow.js Arrow.js: From Node, use & combine GPU frameworks, including GPU dataframes! à Contact us to contribute or fund! Graphistry Inc. 2017 info@graphistry.com 18

  19. GPU Visual Graph Analytics Workflows Turn Investigation From 30min – 1 week into < 10min • Query • Connect • Understand • … Repeat è Act Graphistry Inc. 2017 info@graphistry.com 19

  20. Piloting with security & fraud teams. (And we’re hiring!) G R A P H I S T R Y info@graphistry.com Graphistry Inc. 2017 info@graphistry.com

Recommend

Scaling Investigations Next-Generation Visual Graph Analytics through GPU Cloud Streaming G R A

Scaling Investigations Next-Generation Visual Graph Analytics through GPU Cloud Streaming G R A

Scaling Investigations Next-Generation Visual Graph Analytics through GPU Cloud Streaming G R A P H I S T R Y Leo Meyerovich, CEO @LMeyerov Graphistry Inc. 2017 Graphistry Inc. 2017 info@graphistry.com info@graphistry.com ABOUT Graphistry

589 views • 21 slides
Inspections and Inspections and Inspections and Investigations Investigations Investigations

Inspections and Inspections and Inspections and Investigations Investigations Investigations

Lesson 6. Inspections February 3-10, 2004 Inspections and Inspections and Inspections and Investigations Investigations Investigations Lesson No. 6 ENV H 471 Environmental Health Regulation Winter Quarter 2004 Lesson Overview Lesson

361 views • 9 slides
Analysis of Scaling Algorithms for Matrix &amp; Operator Scaling Contents Scaling Algorithms

Analysis of Scaling Algorithms for Matrix &amp; Operator Scaling Contents Scaling Algorithms

Rafael Oliveira University of Toronto Analysis of Scaling Algorithms for Matrix &amp; Operator Scaling Contents Scaling Algorithms Three Step Analysis Generalization One More Application of Scaling Non-Negative Matrices &amp;

604 views • 15 slides
Welcome CURRENT ISSUES IN Internal Corporate Internal Corporate Investigations Investigations

Welcome CURRENT ISSUES IN Internal Corporate Internal Corporate Investigations Investigations

Welcome CURRENT ISSUES IN Internal Corporate Internal Corporate Investigations Investigations Steven Wolowitz John M. Driscoll Director of Litigation Michael Martinez Alex Lakatos &amp; Regulatory Affairs Mayer Brown LLP Socit

694 views • 46 slides
Scaling From simple models to rich strategies PPPLab Day, November 30th Scaling: recent

Scaling From simple models to rich strategies PPPLab Day, November 30th Scaling: recent

Scaling From simple models to rich strategies PPPLab Day, November 30th Scaling: recent publications Insight Series Tool Animation The rationale for scaling As the SDGs require transformational change, scaling can provide: Reaching more

609 views • 37 slides
On-going investigations in the ECC regarding coexistence with LTE Ongoing Investigations, Work

On-going investigations in the ECC regarding coexistence with LTE Ongoing Investigations, Work

Info to EC Workshop on Coexistence Challenges of LTE Deployment On-going investigations in the ECC regarding coexistence with LTE Ongoing Investigations, Work Items and available information inside the ECC WGSE, 2 work items: Creation of

321 views • 5 slides
ETI se Scaling for many organizations Hierarchy Recursive vs T.to eRaokon traverses the

ETI se Scaling for many organizations Hierarchy Recursive vs T.to eRaokon traverses the

Discovery Naming or IN 5 Why name 172.217 11.14 or google.com Indirection Security Isafety concerns How name iEE f google.com Et Challenge Scaling Scaling for many clients Caching D y D ETI se Scaling for many organizations Hierarchy

215 views • 4 slides
Patrick Clavin Chief Bureau Officer Full Preliminary Total Investigations Investigations

Patrick Clavin Chief Bureau Officer Full Preliminary Total Investigations Investigations

Dublin South Central Area Joint Policing Committee Patrick Clavin Chief Bureau Officer Full Preliminary Total Investigations Investigations Investigations Division No. of Profilers per Division per Division per Division DMR East 6 5

625 views • 6 slides
Outline Scaling Scalinga Plenitude of Power Laws Scaling-at-large Scaling-at-large

Outline Scaling Scalinga Plenitude of Power Laws Scaling-at-large Scaling-at-large

Scaling Outline Scaling Scalinga Plenitude of Power Laws Scaling-at-large Scaling-at-large Scaling-at-large Principles of Complex Systems Allometry Allometry Definitions Definitions Course 300, Fall, 2008 Examples Examples

568 views • 27 slides
So#ware Scaling Mo/va/on &amp; Goals HW Configura/on &amp; Scale Out So#ware Scaling

So#ware Scaling Mo/va/on &amp; Goals HW Configura/on &amp; Scale Out So#ware Scaling

So#ware Scaling Mo/va/on &amp; Goals HW Configura/on &amp; Scale Out So#ware Scaling Efforts System management Opera/ng system Programming environment PreAcceptance Work HW stabiliza/on &amp; early scaling

390 views • 19 slides
UMBC A B M A L T F O U M B C I M Y O R T 1 (10/18/04) I E S R C E O V

UMBC A B M A L T F O U M B C I M Y O R T 1 (10/18/04) I E S R C E O V

Advanced VLSI Design Scaling CMPE 640 Scaling Technology scaling rate is approximately 13%/year, halving every 5 years. 100 10 m 1 0.1 1960 1970 1980 1990 2000 The size of the circuits also continues to increase. Besides increasing

362 views • 7 slides
company Investigations Contents Introduction who, what, why? Disqualification

company Investigations Contents Introduction who, what, why? Disqualification

company Investigations Contents Introduction who, what, why? Disqualification misconduct types Criminal referrals Legislative developments Who? Investigations and Enforcement Services What and Where? Manchester

1.55k views • 14 slides
Outline Scalinga Plenitude of Power Laws Scaling-at-large Scaling-at-large Principles of

Outline Scalinga Plenitude of Power Laws Scaling-at-large Scaling-at-large Principles of

Scaling Scaling Outline Scalinga Plenitude of Power Laws Scaling-at-large Scaling-at-large Principles of Complex Systems Allometry Allometry CSYS/MATH 300, Fall, 2010 Definitions Definitions Examples Examples History: Metabolism

250 views • 20 slides
Responding to Internal Complaints: Complaints Procedures and the Investigations that Follow

Responding to Internal Complaints: Complaints Procedures and the Investigations that Follow

06/09/2017 Responding to Internal Complaints: Complaints Procedures and the Investigations that Follow Capacity Building for Residential Service Providers to Respond Effectively to Investigations Conducted by PACY Second Consultation Meeting

628 views • 34 slides
Diagnosis of CDG Diagnosis of CDG Enzyme Analysis Enzyme Analysis and Other Investigations and

Diagnosis of CDG Diagnosis of CDG Enzyme Analysis Enzyme Analysis and Other Investigations and

Diagnosis of CDG Diagnosis of CDG Enzyme Analysis Enzyme Analysis and Other Investigations and Other Investigations Biochemical Genetics Network Cambridge April 2005 Viki Worthington National Hospital for Neurology and Neurosurgery, London

304 views • 18 slides
Outline Introduction What are the cusp anomaly and generalized scaling function? Superstring in

Outline Introduction What are the cusp anomaly and generalized scaling function? Superstring in

Scaling and integrability from AdS 5 S 5 Riccardo Ricci Imperial College London DAMTP Cambridge 14th October Work in collaboration with S. Giombi, R.Roiban, A. Tseytlin and C.Vergu Scaling and integrability from AdS 5 S 5 Riccardo Ricci

893 views • 50 slides
Communication Avoiding Power Scaling Power Scaling Derivatives of Algorithmic Communication

Communication Avoiding Power Scaling Power Scaling Derivatives of Algorithmic Communication

Communication Avoiding Power Scaling Power Scaling Derivatives of Algorithmic Communication Complexity John D. Leidel, Yong Chen Parallel Programming Models &amp; Systems for High End Computing (P2S2 2015) Sept 1, 2015 1 Overview Intro:

776 views • 26 slides
Agenda Reasons for using outside experts for internal investigations Types of experts to

Agenda Reasons for using outside experts for internal investigations Types of experts to

6/5/2019 Use of Third-Party Assistance for Investigations Gerry Zack, CCEP, CFE, CIA CEO SCCE &amp; HCCA Minneapolis, MN gerry.zack@corporatecompliance.org 1 Agenda Reasons for using outside experts for internal investigations

345 views • 8 slides
Using EBS with Auto Scaling Groups How to use the immense power of AWS Auto-Scaling Groups for a

Using EBS with Auto Scaling Groups How to use the immense power of AWS Auto-Scaling Groups for a

Using EBS with Auto Scaling Groups How to use the immense power of AWS Auto-Scaling Groups for a stateful Docker application. Background Background In a service-oriented world where requests can come from anywhere at any time, keeping a

1.04k views • 31 slides
Scaling and Universality in Probability Francesco Caravenna Universit` a degli Studi di

Scaling and Universality in Probability Francesco Caravenna Universit` a degli Studi di

Weak Convergence Brownian Motion A glimpse of SLE Scaling Limits with Disorder Scaling and Universality in Probability Francesco Caravenna Universit` a degli Studi di Milano-Bicocca Luxembourg June 14, 2016 Francesco Caravenna Scaling

1.94k views • 163 slides
Scaling and Universality in Probability Francesco Caravenna Universit` a degli Studi di

Scaling and Universality in Probability Francesco Caravenna Universit` a degli Studi di

Weak Convergence Brownian Motion A glimpse of SLE Scaling Limits with Disorder Scaling and Universality in Probability Francesco Caravenna Universit` a degli Studi di Milano-Bicocca Luxembourg June 14, 2016 Francesco Caravenna Scaling

745 views • 33 slides
Performance Scaling How is my parallel code performing and scaling? Performance metrics

Performance Scaling How is my parallel code performing and scaling? Performance metrics

Performance Scaling How is my parallel code performing and scaling? Performance metrics Measure the execution time T how do we quantify performance improvements? Speed up typically S(N,P) &lt; P Parallel efficiency

377 views • 17 slides
1 National Western Center February 25, 2016 Environmental Investigations Presentation to the

1 National Western Center February 25, 2016 Environmental Investigations Presentation to the

1 National Western Center February 25, 2016 Environmental Investigations Presentation to the Citizens Advisory Committee 2 Why Conduct Environmental Investigations? Past industrial land uses may have contaminated soils and groundwater

423 views • 14 slides
Investigations of High-Level Employees and Executives Navigating Complex Legal, Ethical and PR

Investigations of High-Level Employees and Executives Navigating Complex Legal, Ethical and PR

Presenting a live 90-minute webinar with interactive Q&amp;A Investigations of High-Level Employees and Executives Navigating Complex Legal, Ethical and PR Issues in Internal and Government Investigations WEDNES DAY, MARCH 7, 2012 1pm East ern

690 views • 41 slides

More recommend