methodology
play

Methodology Adapted from Menasc & Almeida. 1 Learning - PowerPoint PPT Presentation

Feb 01, 2023 •218 likes •655 views

Capacity Planning Methodology Adapted from Menasc & Almeida. 1 Learning Objectives Discuss the concept of adequate capacity of a system. Introduce service level agreements. Present a methodology for capacity planning.

  1. Capacity Planning Methodology Adapted from Menascé & Almeida. 1

  2. Learning Objectives • Discuss the concept of adequate capacity of a system. • Introduce service level agreements. • Present a methodology for capacity planning. Adapted from Menascé & Almeida. 2

  3. Learning Objectives (cont’d) • Discuss the main steps of the methodology: – understanding the environment – workload characterization – workload forecasting – Performance/dependability modeling – Performance/dependability prediction – cost/performance-dependability analysis. Adapted from Menascé & Almeida. 3

  4. What is Adequate Capacity? We say that a Web service has adequate capacity if the service-level agreements are continuously met for a specified technology and standards, and if the services are provided within cost constraints. Adapted from Menascé & Almeida. 4

  5. Technology and Standards • T&S means, for instance: – HW for servers (and for clients) – O.S. software – LAN, WAN line infrastructure (type, speed) • Sometimes the choice is based on factors not related to performance: – ease of system administration – familiarity of personnel with the system – number/quality of vendors for HW/SW Adapted from Menascé & Almeida. 5

  6. Service-Level Agreements (SLA) • SLAs determine what a user of an application can expect in terms of response time, throughput, system availability, and reliability – focus on metrics that users can understand – set easy-to-measure goals – tie IT costs to your SLAs Adapted from Menascé & Almeida. 6

  7. Service Level Agreements: examples • Response time for trivial database queries should not exceed 2 sec. • We want the same level of availability and response time that we had in the mainframe environment. • The goal for Web services is 99% of availability and less than 1-sec response time for 90% of the HTTP requests for small documents. Adapted from Menascé & Almeida. 7

  8. Adequate Capacity e.g.: response time < 2 sec. SLAs Users e.g.: NT Specified Adequate and T1 Technology Capacity & Standards Mgmt Cost Constraints e.g.: startup cost < 100K$ maintenance cost < 20K$/yr Adapted from Menascé & Almeida. 8

  9. Understanding the Environment Workload Characterization Developing a Cost Model Workload Model Validation Workload and Calibration Model Cost Workload Forecasting Model Performance/Availability Model Development Cost Prediction Performance Performance/Availability and Availability Model Calibration Model Performance & Availability Prediction Cost/Performance Analysis Configuration Plan Investment Plan Personnel Plan Adapted from Menascé & Almeida. 9

  10. The Three Models • Workload model: – resource demand, load intensity - for each component of a global workload • Performance/Dependability model: – used to predict performance/dependability as function of system description and workload parameters – outputs: response times, throughputs, system resources utilizations, queue lengths, availability, reliability, safety, etc. Adapted from Menascé & Almeida. 10

  11. The Three Models (cont.) • Performance/Dependability model (cont.): – the performance/dependability metrics are matched against SLAs to check if capacity is adequate • Cost model: – accounts for SW, HW, TLC, personnel, training, support expenditures, etc. Adapted from Menascé & Almeida. 11

  12. Understanding the Environment Workload Characterization Developing a Cost Model Workload Model Validation Workload and Calibration Model Cost Workload Forecasting Model Performance/Availability Model Development Cost Prediction Performance Performance/Availability and Availability Model Calibration Model Performance & Availability Prediction Cost/Performance Analysis Configuration Plan Investment Plan Personnel Plan Adapted from Menascé & Almeida. 12

  13. Understanding the Environment The goal is • to learn what kind of – hardware (clients and servers) – software (OS, middleware, applications) – network connectivity and protocols are present in the environment. • Identify peak periods, management structures, SLAs Adapted from Menascé & Almeida. 13

  14. Understanding the Environment: example • 80 Unix Unix 512 GB HD, file clients RAID-5 server 10 Mbps Ethernet LAN 3 LAN 2 proxy NT file server server ftp,web mail s. FDDI ring 100 Mbps 100 NT clients LAN 5 120 NT clients Internet LAN 1 LAN 4 10 Mbps 10 Mbps 16 Mbps token ring Ethernet Ethernet file 100 NT SQL server clients server Adapted from Menascé & Almeida. 14

  15. Elements in Understanding the Environment Client platform Quantity and type Server platform Quantity, type, configuration and functions Middleware Type (e.g. TP monitors) DBMS Type Application Main types of applications, criticality, etc. Network Network diagrams with LANs, WANs, connectivity routers, servers, etc. SLAs Existing SLAs per application Procurement Elements of the procurement process, procedures expenditure limits, justification procedures for acquisitions. Adapted from Menascé & Almeida. 15

  16. Understanding the Environment Workload Characterization Developing a Cost Model Workload Model Validation Workload and Calibration Model Cost Workload Forecasting Model Performance/Availability Model Development Cost Prediction Performance Performance/Availability and Availability Model Calibration Model Performance & Availability Prediction Cost/Performance Analysis Configuration Plan Investment Plan Personnel Plan Adapted from Menascé & Almeida. 16

  17. Workload Characterization Workload characterization is the process of precisely describing the system’s global workload in terms of its main components. The basic components are then characterized by intensity (e.g. transaction arrival rate) and service demand parameters at each resource of the system. Adapted from Menascé & Almeida. 17

  18. Workload Characterization Process Global Workload . . . Wkl component # 1 Wkl component # n (e.g., C/S transactions) (e.g., Web doc. Requests) Basic component 1.1 Basic Component 1.2 Basic component n.1 Basic component n.k (e.g., personnel transactions) (e.g., sales transactions) (e.g., small HTML docs.) (e.g. video requests) Adapted from Menascé & Almeida. 18

  19. Workload Description • Parameters for a basic component: must usually be derived indirectly (measurement or estimation of other parameters; usage of performance monitors, accounting systems, system log files, etc.) • Measurements during normal and peak workload periods • Use of clustering algorithms Adapted from Menascé & Almeida. 19

  20. Workload Description: example Basic Components and Parameters Type Sales transaction -- . Number of transactions submitted per client WI . Number of clients WI . Total number of I/Os to the Sales DB SD . CPU utilization at the DB server SD . Avg. messages sent/received by the DB server SD Web-based training -- . Avg. number of training sessions per day WI . Avg size of image files retrieved SD . Avg. size of http documents retrieved SD . Avg number of image files retrieved/session SD . Avg. number of documents retrieved/session SD . Avg. CPU utilization of the httpd server SD SD = service demand WI = workload intensity Adapted from Menascé & Almeida. 20

  21. Workload Parameters • Workload intensity parameters: – provide a measure of the load placed on system, indicated by number of units of work that contend for system resources • Workload service demand parameters: – specify the total amount of service time required by each basic component at each resource Adapted from Menascé & Almeida. 21

  22. Data Collection Issues • How to determine the parameter values for each basic component? -> adequate tools are often unavailable; most tools provide only aggregate data for resource levels. (ROT: Rule of Thumb) Use benchmark, Use benchmark, Use measurements industry practice, industry practice, ROT, only and ROTs only and measurements Data Collection Facilities None Some Detailed Adapted from Menascé & Almeida. 22

  23. Data Collection Issues: example • The server demand at the server for a given application was 10 msec obtained in a controlled environment with a server with a SPECint rating of 3.11. • What would be the service demand if the server used in the actual system were faster and had a SPECint rating of 10.4? ActualServiceDemand = MeasuredServiceDemand x ScalingFactor ScalingFactor = ControlledResourceThroughput / ActualResourceThroughput ActualServiceDemand = 10 * (3.11/10.4) = 3.0 msec . Adapted from Menascé & Almeida. 23

  24. Understanding the Environment Workload Characterization Developing a Cost Model Workload Model Validation Workload and Calibration Model Cost Workload Forecasting Model Performance/Availability Model Development Cost Prediction Performance Performance/Availability and Availability Model Calibration Model Performance & Availability Prediction Cost/Performance Analysis Configuration Plan Investment Plan Personnel Plan Adapted from Menascé & Almeida. 24

  25. Validating Workload Models Actual Synthetic Workload Workload System System Measured RT, Measured RT, Throughput., etc Throughput., etc. No Model Acceptable? Calibration Yes Adapted from Menascé & Almeida. 25

Recommend

Listing Methodology Listing Methodology Aquatic Life q Prepared for the 303(d) Listing

Listing Methodology Listing Methodology Aquatic Life q Prepared for the 303(d) Listing

Listing Methodology Listing Methodology Aquatic Life q Prepared for the 303(d) Listing Methodology Meeting P d f h 303(d) Li i M h d l M i Wednesday, September 3, 2014 EDU contacts: Kristy Richardson, Scott Garncarz, and Sarah Wheeler

445 views • 27 slides
Scaling Methodology Scaling Methodology Dan Smith Director HW Engineering dsmith@nvidia.com

Scaling Methodology Scaling Methodology Dan Smith Director HW Engineering dsmith@nvidia.com

EDP- -2002 2002 EDP Scaling Methodology Scaling Methodology Dan Smith Director HW Engineering dsmith@nvidia.com Introduction NVIDIA NVIDIAs growth Methodology Group NVIDIAs methodology beginnings How the methodology has changed

135 views • 13 slides
Available Flowgate Capability and the AFC Methodology the AFC Methodology Presented By Nate

Available Flowgate Capability and the AFC Methodology the AFC Methodology Presented By Nate

Available Flowgate Capability and the AFC Methodology the AFC Methodology Presented By Nate Schweighart d h h Reliability Engineering TVA TVA E.ON Stakeholder Meeting 2009 Wh t i What is a flowgate? fl t ? Flowgate A single

392 views • 23 slides
Hardware Design with VHDL Register Transfer Methodology II ECE 443 Register Transfer Methodology:

Hardware Design with VHDL Register Transfer Methodology II ECE 443 Register Transfer Methodology:

Hardware Design with VHDL Register Transfer Methodology II ECE 443 Register Transfer Methodology: Practice In this lecture, we will look at several examples of RT methodology applied to a vari- ety of applications Examples include control of a

587 views • 54 slides
Methodology Methodology 3 age groups 2 7 years 8-12 years 13-17 years

Methodology Methodology 3 age groups 2 7 years 8-12 years 13-17 years

Methodology Methodology 3 age groups 2 7 years 8-12 years 13-17 years Nielsen data: Top 10 networks for any one of the three age groups Methodology Methodology Total of 13 networks ABC, CBS, Fox, NBC, UPN,

419 views • 19 slides
Next Generation ACO Model Review of Alignment / Benchmarking Methodology February 28, 2017 For

Next Generation ACO Model Review of Alignment / Benchmarking Methodology February 28, 2017 For

Next Generation ACO Model Review of Alignment / Benchmarking Methodology February 28, 2017 For Discussion Purposes Only: Actual methodology is specified in methodology paper Agenda Alignment Overview of cross-sectional approach

836 views • 44 slides
BUDGET METHODOLOGY 1 CLICK TO EDIT MASTER TITLE STYLE BUDGET METHODOLOGY Member Consumption

BUDGET METHODOLOGY 1 CLICK TO EDIT MASTER TITLE STYLE BUDGET METHODOLOGY Member Consumption

BUDGET METHODOLOGY 1 CLICK TO EDIT MASTER TITLE STYLE BUDGET METHODOLOGY Member Consumption (Billion Gallons) Traditional Method - Budget for full FY Minimum Actual Difference variable rate to be covered directly by 08 91.8 77.5

671 views • 51 slides
PR19 Methodology webinar: Aligning Risk and Return and Financeability 19 July 2017 Trust in

PR19 Methodology webinar: Aligning Risk and Return and Financeability 19 July 2017 Trust in

PR19 Methodology webinar: Aligning Risk and Return and Financeability 19 July 2017 Trust in water 1 Approach Aim To explain draft methodology to assist your response To take clarification questions not for views on methodology (this is

882 views • 24 slides
CEC BASED APPROACH, CEC BASED APPROACH, METHODOLOGY AND PROCESS METHODOLOGY AND PROCESS (CECBA)

CEC BASED APPROACH, CEC BASED APPROACH, METHODOLOGY AND PROCESS METHODOLOGY AND PROCESS (CECBA)

CEC BASED APPROACH, CEC BASED APPROACH, METHODOLOGY AND PROCESS METHODOLOGY AND PROCESS (CECBA) (CECBA) Pacific Ecosystem based Adaptation to Climate Change (PEBACC) Solomon Islands component inception workshop. 3 rd March 2016 SOLOMON

497 views • 46 slides
A Traffic Study to Interleaved Dark Space Markus De Shon (mdeshon) Agenda Methodology Results

A Traffic Study to Interleaved Dark Space Markus De Shon (mdeshon) Agenda Methodology Results

A Traffic Study to Interleaved Dark Space Markus De Shon (mdeshon) Agenda Methodology Results Discussion on Data Sharing Methodology Methodology Flow collection at Google Sampled sFlow and Netflow v{5,9} collected at network devices

463 views • 18 slides
Comparison of Frontier Definitions - FAR Methodology and BPHC/CMS Criteria - February 13, 2015

Comparison of Frontier Definitions - FAR Methodology and BPHC/CMS Criteria - February 13, 2015

Comparison of Frontier Definitions - FAR Methodology and BPHC/CMS Criteria - February 13, 2015 Three Alternative Frontier Definitions FAR Methodology: The FAR methodology is a based upon distance/travel time between rural areas and

335 views • 9 slides
Methodology Presentation October 13, 2016 Traditional Methodology 1. Pan &amp; Tilt Camera

Methodology Presentation October 13, 2016 Traditional Methodology 1. Pan &amp; Tilt Camera

San Francisco Sewer Inspection Methodology Presentation October 13, 2016 Traditional Methodology 1. Pan &amp; Tilt Camera 2. Panoramo 360 Camera (Est. Starting 2010) 3. Walking Inspection (For Larger Structures) Pan &amp; Tilt Camera

463 views • 34 slides
Hardware Design with VHDL Register Transfer Methodology I ECE 443 Register Transfer Methodology:

Hardware Design with VHDL Register Transfer Methodology I ECE 443 Register Transfer Methodology:

Hardware Design with VHDL Register Transfer Methodology I ECE 443 Register Transfer Methodology: Principle We typically use algorithms to accomplish complex tasks Although it is common to execute algorithms on a GPU, a hardware implementation is

1.38k views • 76 slides
Methodology for Lecture Methodology for Lecture Computer Graphics (Spring 2008) Computer

Methodology for Lecture Methodology for Lecture Computer Graphics (Spring 2008) Computer

Methodology for Lecture Methodology for Lecture Computer Graphics (Spring 2008) Computer Graphics (Spring 2008) Lecture deals with lighting (teapot shaded as in HW1) Some Nate Robbins tutor demos in lecture COMS 4160, Lecture 14: OpenGL

535 views • 5 slides
Mr. Zoltn Gyula Szab, SAO of Hungary Methodology of the SAO's Integrity Survey Methodology

Mr. Zoltn Gyula Szab, SAO of Hungary Methodology of the SAO's Integrity Survey Methodology

Mr. Zoltn Gyula Szab, SAO of Hungary Methodology of the SAO's Integrity Survey Methodology of the SAOs Integrity Survey Presentation by Zoltn Gyula Szab Assistant Auditor What and how do we examine? Focus on the public sector

438 views • 7 slides
Methodology for Comparison and Ranking of SAT Solvers Mladen Nikoli c Third Workshop on

Methodology for Comparison and Ranking of SAT Solvers Mladen Nikoli c Third Workshop on

Introduction Preliminaries Methodology Evaluation Related work Conclusions Methodology for Comparison and Ranking of SAT Solvers Mladen Nikoli c Third Workshop on Formal and Automated Theorem Prooving and Applications January 29, 2010.

974 views • 27 slides
Review of the Port Tariff Methodology some few comments on elements within the existing

Review of the Port Tariff Methodology some few comments on elements within the existing

Review of the Port Tariff Methodology some few comments on elements within the existing Methodology Discussion forum at Waterfront Hotel, Durban 31 October 2016 Trevor Jones Director Unit of Maritime Law &amp; Maritime Studies

69 views • 5 slides
CMG + Highlights Overview of the new acute care inpatient grouping methodology Presentation to

CMG + Highlights Overview of the new acute care inpatient grouping methodology Presentation to

CMG + Highlights Overview of the new acute care inpatient grouping methodology Presentation to CCHSE Leadership Conference June 12, 2007 - Toronto Sandra Mitchell Manager, Grouper Redevelopment Project Purpose of Grouping Methodology

648 views • 19 slides
Draft Port Tariff Methodology Ports Regulator of South Africa Roadshow 05 February 2020 Strictly

Draft Port Tariff Methodology Ports Regulator of South Africa Roadshow 05 February 2020 Strictly

Draft Port Tariff Methodology Ports Regulator of South Africa Roadshow 05 February 2020 Strictly private and confidential 0 Tariff Methodology Tariff Methodology (TM) assists application of the Regulatory framework to determine the

392 views • 12 slides
n = 8 (z / ) + 1 = b 0 + b 1 x F = (MS T + MS SIT ) (MS TS + MS IT )

n = 8 (z / ) + 1 = b 0 + b 1 x F = (MS T + MS SIT ) (MS TS + MS IT )

n = 8 (z / ) + 1 = b 0 + b 1 x F = (MS T + MS SIT ) (MS TS + MS IT ) 2011-2012 Research Methodology Series Statistics and Research Methodology Unit Nebraska Center for Research on Children, Youth, Families and Schools

234 views • 8 slides
Content: 1. Principal task in EGS development 2. A methodology: HEX-S code 3. Example: Coso

Content: 1. Principal task in EGS development 2. A methodology: HEX-S code 3. Example: Coso

A Methodology for the Hydro-mechanical Characterisation of EGS reservoirs Session: Reservoir characterisation during stimulation Content: 1. Principal task in EGS development 2. A methodology: HEX-S code 3. Example: Coso geothermal field,

742 views • 25 slides
Lecture 11: Practical Methodology Princeton University COS 495 Instructor: Yingyu Liang

Lecture 11: Practical Methodology Princeton University COS 495 Instructor: Yingyu Liang

Deep Learning Basics Lecture 11: Practical Methodology Princeton University COS 495 Instructor: Yingyu Liang Designing process Practical methodology Important to know a variety of techniques and understand their pros and cons In

1.18k views • 25 slides
Intro slides from Emily C G As C O V I D - 1 9 Methodology and P U L S E S U RV E Y S

Intro slides from Emily C G As C O V I D - 1 9 Methodology and P U L S E S U RV E Y S

Intro slides from Emily C G As C O V I D - 1 9 Methodology and P U L S E S U RV E Y S sample Methodology and sample Results collected between Consumer survey ran bi-weekly 04.07.20 16.08.20 Results collected: w/c 13th July,

455 views • 43 slides
Methodology Applications Series 2018-2019 Adaptation in the Social, Behavioral, and Education

Methodology Applications Series 2018-2019 Adaptation in the Social, Behavioral, and Education

Methodology Applications Series 2018-2019 Adaptation in the Social, Behavioral, and Education Sciences: Implications for Measurement, Intervention, &amp; Evaluation James A. Bovaird, PhD Founding Director, Nebraska Academy for Methodology,

852 views • 57 slides

More recommend