go beyond data
play

GO BEYOND DATA Real-time Analytics for Application Performance - PowerPoint PPT Presentation

Oct 07, 2022 •134 likes •351 views

GO BEYOND DATA Real-time Analytics for Application Performance Management Yury Oleynik Data Analyst Modern applications Agenda Monitoring challenges INSTANA apploach 2 Instana, Inc. Proprietary and Confidential Business Demand: Write and

  1. GO BEYOND DATA Real-time Analytics for Application Performance Management Yury Oleynik Data Analyst

  2. Modern applications Agenda Monitoring challenges INSTANA apploach 2 Instana, Inc. Proprietary and Confidential

  3. Business Demand: Write and Deploy code faster! Drives adoption of Drives adoption of - Agile - Cloud 
 - Continuous Delivery - Containers / Microservice - Reactive / Polyglot Technologies 3 Instana, Inc. Proprietary and Confidential

  4. Monitoring Why monitor systems and the applications? - to obtain information needed to guide whether the system is working properly Reality of monitoring - produce data - data is not information - current insight tools are system oriented - built from the perspective of the system providing the metrics - require specialised knowledge to use and interpret How it should be - information about the quality of service - help diagnose what is causing the problem - suggest what to do to fix the problem 4 Instana, Inc. Proprietary and Confidential

  5. Netflix January 2014 “And at our scale, humans cannot continuously monitor the status of all of our systems. To maintain high availability across such a complicated system, and to help us continuously improve the experience for our customers, it is critical for us to have exceptional tools coupled with intelligent analysis to proactively detect and communicate system faults and identify areas of improvement.”

  6. Monitoring Challenges: Intense operational complexity AGILE CLOUD POLYGLOT Shared infrastructure. Experts knowledge needed. Daily/Hourly code and configuration changes. CONTAINERS REACTIVE Throw away infrastructure. Non-deterministic code path. 6 Instana, Inc. Proprietary and Confidential

  7. Vision 7 Instana, Inc. Proprietary and Confidential

  8. Creating a Virtual DevOps Expert 8 Instana, Inc. Proprietary and Confidential

  9. Creating a Virtual DevOps Expert Intelligent Sensor Technology - Dynamic Component Discovery - Realtime Sensoring 9 Instana, Inc. Proprietary and Confidential

  10. Intelligent Sensor Technology Realtime Sensoring CURRENT Data viewed as 1 minute running average APM Data viewed as 5 second running average followed by 1 second data points. INSTANA collects 1 second resolution data. Aggregation = loss of information 10 Instana, Inc. Proprietary and Confidential

  11. Creating a Virtual DevOps Expert Intelligent Health Management - Dynamic Dependency Graph - Adaptive Learning - Predictive Alerting & Optimization 11 Instana, Inc. Proprietary and Confidential

  12. Intelligent Health Mangement Streaming, Analytics, Learning & Knowledge Realtime Stream Processing Persistence Memory Stream Processing Sensor Data Dynamic Graph Raw Store Communication Result Store Health Management Machine Learning Health Signatures 3D Map Knowledge Base Predictive Alerting 12 Instana, Inc. Proprietary and Confidential

  13. Dynamic Dependency Graph JV Cassandra Cluster JV JV App App App Schema Schema 1 2 3 1 2 JV JV Service Service JVM JVM JVM JVM A B JV JV JV JV Tomcat Cluster 13 Instana, Inc. Proprietary and Confidential

  14. Dynamic Dependency Graph JV JV Cassandra Cassandra Cassandra Cluster Cluster Cluster JV JV App App App Schema Schema 1 2 3 1 2 JV JV Service Service JVM JVM JVM JVM A B JV JV JV JV Tomcat Cluster 14 Instana, Inc. Proprietary and Confidential

  15. Dynamic Dependency Graph JV JV Cassandra Cassandra Cassandra Cluster Cluster Cluster JV JV App App App App Schema Schema 1 2 2 3 1 2 JV JV Service Service JVM JVM JVM JVM A B JV JV JV JV Tomcat Cluster 15 Instana, Inc. Proprietary and Confidential

  16. Predictive Alerting & Optimization Severe Situation Detected JVM GC Overhead too high - Impact on Service >20%. Knowledge Base recommendations: 
 1. Update to Java 1.6.62 
 2. Increase Eden Space to -XX:NewRatio=2 at 10:43am. Optimization Detected. com.mycomp.Calc.calc() consumes 20% of Clock time. Optimization will have high impact on Service response time for Shop service. a few seconds ago Realtime Event Intelligent Health Management Alterts & Optimizations Stream 16 Instana, Inc. Proprietary and Confidential

  17. Creating a Virtual DevOps Expert 3D Map - Runtime Visualization - Persona Optimized Perspectives 17 Instana, Inc. Proprietary and Confidential

  18. Demo

  19. STAN - a Virtual DevOps Expert 19 Instana, Inc. Proprietary and Confidential

  20. THANK YOU! 20 Instana, Inc. Proprietary and Confidential

Recommend

Data Preparation Data cleaning Data integration and transformation (Data

Data Preparation Data cleaning Data integration and transformation (Data

Data Preprocessing Why preprocess the data? Data Preparation Data cleaning Data integration and transformation (Data preprocessing) Data reduction, Feature selection Discretization and concept hierarchy generation 2

891 views • 21 slides
DATA MINING LECTURE 2 What is data? The data mining pipeline What is Data Mining? Data

DATA MINING LECTURE 2 What is data? The data mining pipeline What is Data Mining? Data

DATA MINING LECTURE 2 What is data? The data mining pipeline What is Data Mining? Data mining is the use of efficient techniques for the analysis of very large collections of data and the extraction of useful and possibly unexpected

2.4k views • 94 slides
Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Inf1-DA 20102011 III: 68 / 91 Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval Statistical Analysis of Data: III.2 Data scales and summary statistics III.3 Hypothesis testing and correlation III.4 2

579 views • 8 slides
Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Inf1-DA 20102011 III: 28 / 89 Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval Statistical Analysis of Data: III.2 Data scales and summary statistics III.3 Hypothesis testing and correlation III.4

455 views • 23 slides
Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Inf1-DA 20102011 III: 51 / 89 Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval Statistical Analysis of Data: III.2 Data scales and summary statistics III.3 Hypothesis testing and correlation III.4

344 views • 17 slides
Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Inf1-DA 20102011 III: 68 / 91 Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval Statistical Analysis of Data: III.2 Data scales and summary statistics III.3 Hypothesis testing and correlation III.4 2

729 views • 24 slides
Data Preparation Data cleaning Discretization (Data preprocessing) Data

Data Preparation Data cleaning Discretization (Data preprocessing) Data

Data Preprocessing Why preprocess the data? Data Preparation Data cleaning Discretization (Data preprocessing) Data integration and transformation Data reduction, Feature selection 2 Why Prepare Data? Why Prepare

462 views • 15 slides
DATA QUALITY AND DATA DATA QUALITY AND DATA PROGRAMMING PROGRAMMING "Data cleaning and

DATA QUALITY AND DATA DATA QUALITY AND DATA PROGRAMMING PROGRAMMING "Data cleaning and

DATA QUALITY AND DATA DATA QUALITY AND DATA PROGRAMMING PROGRAMMING "Data cleaning and repairing account for about 60% of the work of data scientists." Christian Kaestner Required reading: Schelter, S., Lange, D., Schmidt, P.,

1.1k views • 86 slides
Data stories with The Pudding So what is data storytelling? Data academia & data science

Data stories with The Pudding So what is data storytelling? Data academia & data science

Data stories with The Pudding So what is data storytelling? Data academia & data science dense complex static/non-interactive often not accompanied by an easy-to-follow narrative Data art beautiful abstract

647 views • 5 slides
Data Acquisition Chapter 2 Data Acquisition 1 st step: get data Usually data gathered by

Data Acquisition Chapter 2 Data Acquisition 1 st step: get data Usually data gathered by

Data Acquisition Chapter 2 Data Acquisition 1 st step: get data Usually data gathered by some geophysical device Most surveys are comprised of linear traverses or transects Typically constant data spacing Perpendicular to

432 views • 12 slides
Data Collection and Aggregation Data Collection and Aggregation 1 Challenges: data Challenges:

Data Collection and Aggregation Data Collection and Aggregation 1 Challenges: data Challenges:

Data Collection and Aggregation Data Collection and Aggregation 1 Challenges: data Challenges: data Data type: numerical sensor readings. Rich and massive data, spatially distributed and correlated. Data dynamics: data

714 views • 48 slides
Business Statistics CONTENTS The role of data The data matrix Data types Aspects of data

Business Statistics CONTENTS The role of data The data matrix Data types Aspects of data

DATA Business Statistics CONTENTS The role of data The data matrix Data types Aspects of data Obtaining data Further study THE ROLE OF DATA Data refers to observed facts there are 82 persons in this train the weight of

683 views • 22 slides
DataCamp Data Types for Data Science DataCamp Data Types for Data Science Data types Data type

DataCamp Data Types for Data Science DataCamp Data Types for Data Science Data types Data type

DataCamp Data Types for Data Science DataCamp Data Types for Data Science Data types Data type system sets the stage for the capabilities of the language Understanding data types empowers you as a data scientist DataCamp Data Types for Data

527 views • 23 slides
q.Datum Data Exchange The marketplace for big data Data is the new oil of the Internet and the

q.Datum Data Exchange The marketplace for big data Data is the new oil of the Internet and the

q.Datum Data Exchange The marketplace for big data Data is the new oil of the Internet and the new currency of the digital world . World Economic Forum 1 Problem: access to big data Data accessed & analyzed Data in organizations

543 views • 30 slides
Concatenating data Cleaning Data in Python Combining data Data may not always come in 1

Concatenating data Cleaning Data in Python Combining data Data may not always come in 1

CLEANING DATA IN PYTHON Concatenating data Cleaning Data in Python Combining data Data may not always come in 1 huge file 5 million row dataset may be broken into 5 separate datasets Easier to store and share May have

426 views • 26 slides
Prioritizing Data and Purpose of Data Points What data do I have? What data do I trust? What

Prioritizing Data and Purpose of Data Points What data do I have? What data do I trust? What

Prioritizing Data and Purpose of Data Points What data do I have? What data do I trust? What data do I use most? Session Target: After todays session, you will be able to: 1. Insert/include data opportunities into PL models. 2.

710 views • 12 slides
Data Preparation Discretization Data cleaning (Data pre-processing) Data

Data Preparation Discretization Data cleaning (Data pre-processing) Data

Data Preparation Why prepare the data? Data Preparation Discretization Data cleaning (Data pre-processing) Data integration and transformation Data reduction, Feature selection 2 Why Prepare Data? Why Prepare Data?

426 views • 17 slides
Introduction to IoT data AN ALYZ IN G IOT DATA IN P YTH ON Matthias Voppichler IT Developer

Introduction to IoT data AN ALYZ IN G IOT DATA IN P YTH ON Matthias Voppichler IT Developer

Introduction to IoT data AN ALYZ IN G IOT DATA IN P YTH ON Matthias Voppichler IT Developer Course overview Collect and analyze IoT data Gather data API Endpoints Data Streams Visualize data Combine datasets Detect patterns ML Model

756 views • 27 slides
Modeling Data the different views on Data Mining Views on Data Mining Fitting the data

Modeling Data the different views on Data Mining Views on Data Mining Fitting the data

Modeling Data the different views on Data Mining Views on Data Mining Fitting the data Density Estimation Learning being able to perform a task more accurately than before Prediction use the data to predict future data

517 views • 29 slides
Abstract Data Types & Templates 1 Abstract Data Type 2 Data and Abstraction

Abstract Data Types & Templates 1 Abstract Data Type 2 Data and Abstraction

Abstract Data Types & Templates 1 Abstract Data Type 2 Data and Abstraction Operations on data are central to most solutions Think abstractly about data and its management Typically need to Organize data Add data Remove

756 views • 30 slides
Tidy data CLEAN IN G DATA IN P YTH ON Daniel Chen Instructor Tidy data Tidy Data paper

Tidy data CLEAN IN G DATA IN P YTH ON Daniel Chen Instructor Tidy data Tidy Data paper

Tidy data CLEAN IN G DATA IN P YTH ON Daniel Chen Instructor Tidy data Tidy Data paper by Hadley Wickham, PhD Formalize the way we describe the shape of data Gives us a goal when formatting our data Standard way to organize data

462 views • 27 slides
Big Data Analytics Armistead Boyd SVP, Product & Data Partnerships October 25, 2016 What is

Big Data Analytics Armistead Boyd SVP, Product & Data Partnerships October 25, 2016 What is

Big Data Analytics Armistead Boyd SVP, Product & Data Partnerships October 25, 2016 What is Big Data Analytics? Data Future Data Past Data Present 1 Big Data Trends Data Driven Organization Other Executives 5% 8% Operations Data

620 views • 22 slides
Concatenating data CLEAN IN G DATA IN P YTH ON Daniel Chen Instructor Combining data Data may

Concatenating data CLEAN IN G DATA IN P YTH ON Daniel Chen Instructor Combining data Data may

Concatenating data CLEAN IN G DATA IN P YTH ON Daniel Chen Instructor Combining data Data may not always come in 1 huge le 5 million row dataset may be broken into 5 separate datasets Easier to store and share May have new data for each

555 views • 31 slides
Data Collection and HIVe Current Data Collection For those collecting data, you are use to

Data Collection and HIVe Current Data Collection For those collecting data, you are use to

Data Collection and HIVe Current Data Collection For those collecting data, you are use to the Excel data collection sheets All Ryan White Funded entities will be required to report client level data Non-Medical Case Management

266 views • 13 slides

More recommend