Getting System Sizing and Getting System Sizing and performance testing right performance testing right Steve Hazeltine Steve Hazeltine Sema Group Sema Group Andrew J ohnston Andrew J ohnston Independent Consultant, Sema Group Asscociate Asscociate Independent Consultant, Sema Group SEMA GROUP SEMA GROUP
Summary Summary � � The rentals business The rentals business � � Why prototype performance? Why prototype performance? � � The prototyping process The prototyping process � � Our results Our results � � Conclusions Conclusions SEMA GROUP SEMA GROUP
The Rentals Business The Rentals Business Sales Person Customer Check Availability Return Rent Confirm Order Stock SEMA GROUP SEMA GROUP
Why Prototype Performance? Why Prototype Performance? � � Balance costs against risks: Balance costs against risks: � Hardware Costs � Hardware Costs � Cut back to old system � Cut back to old system � User perception � User perception � Loss of business � Loss of business SEMA GROUP SEMA GROUP
Process Overview Process Overview Current System Load & Performance Calculate Choose Validate Required Platform Choice Capacity Performance of prototyped key transactions SEMA GROUP SEMA GROUP
Measuring Current System Load Measuring Current System Load Current System Load & Performance Calculate Choose Validate Required Platform Choice Capacity Performance of prototyped key transactions SEMA GROUP SEMA GROUP
Measuring the Transaction Profile Measuring the Transaction Profile Existing Application Log SEMA GROUP SEMA GROUP
Measuring the Transaction Profile Measuring the Transaction Profile Existing VB Driving Terminal software Emulator Application Access Log Database SEMA GROUP SEMA GROUP
Prototyping Key Transactions Prototyping Key Transactions Current System Load & Performance Calculate Choose Validate Required Platform Choice Capacity Performance of prototyped key transactions SEMA GROUP SEMA GROUP
Prototyping Key Transactions Prototyping Key Transactions Prototype VB Driving Terminal software Emulator Application � Used Development System Script � Partially tested software � Provided CPU and disk usage � CPU would be bottleneck SEMA GROUP SEMA GROUP
Calculating Required Capacity Calculating Required Capacity Current System Load & Performance Calculate Choose Validate Required Platform Choice Capacity Performance of prototyped key transactions SEMA GROUP SEMA GROUP
Calculating Required Capacity Calculating Required Capacity � � Lightly loaded prototype indicates Lightly loaded prototype indicates processor speed processor speed � � Prototype under load indicates total Prototype under load indicates total processor power required processor power required � � Memory from vendor recommendations Memory from vendor recommendations � � Disk from old system and vendor Disk from old system and vendor recommendations - prototype valuable recommendations - prototype valuable SEMA GROUP SEMA GROUP
Choose Platform Choose Platform Current System Load & Performance Calculate Choose Validate Required Platform Choice Capacity Performance of prototyped key transactions SEMA GROUP SEMA GROUP
Choose Processors Choose Processors Single Transaction Time 2s 110 MHz Sparc 5 Target Zone 3700/hour Supported Transaction Rate SEMA GROUP SEMA GROUP
Choose Processors Choose Processors 2 x 50 MHz 4 x 50 MHz Sparc 20 Sparc 20 Single Transaction Time 2s 110 MHz Sparc 5 Target Zone 3700/hour SEMA GROUP SEMA GROUP
Choose Processors Choose Processors 2 x 50 MHz 4 x 50 MHz Sparc 20 Sparc 20 Single Transaction Time 2s 110 MHz Sparc 5 2 x 70 MHz Sparc 20 Target Zone 3700/hour SEMA GROUP SEMA GROUP
Choose Platform Choose Platform � � Consider Consider � Cost � Cost � Error Margin � Error Margin � Growth (business and MIS) � Growth (business and MIS) � � Rent memory and processors if Rent memory and processors if uncertain uncertain SEMA GROUP SEMA GROUP
Choose Platform Choose Platform Current System Load & Performance Calculate Required Capacity Performance of prototyped key transactions SEMA GROUP SEMA GROUP
Choose Platform Choose Platform Current System Load & Performance Calculate Required Capacity Performance of prototyped key transactions SEMA GROUP SEMA GROUP
Choose Platform Choose Platform Current System Load & Performance Calculate Required Capacity Performance of prototyped key transactions SEMA GROUP SEMA GROUP
The Performance Test The Performance Test Current System Load & Performance Calculate Choose Validate Required Platform Choice Capacity Performance of prototyped key transactions SEMA GROUP SEMA GROUP
The Performance Test The Performance Test A VB Driving Terminal p software Emulator p l Control VB Driving Terminal i PC software Emulator c a VB Driving Terminal t software Emulator i o n Users Users Other Functions Subjective response SEMA GROUP SEMA GROUP
Results of Our Project Results of Our Project CPU % SEMA GROUP SEMA GROUP
Conclusions Conclusions � � Confirm the business case first Confirm the business case first � � Concentrate on bottlenecks Concentrate on bottlenecks � � Invest in test tools that will do the job Invest in test tools that will do the job � � Involve your users throughout Involve your users throughout SEMA GROUP SEMA GROUP
Recommend
More recommend