Motivation VM VM VM VM VMM 2 15-02-02 The Storage Performance - PowerPoint PPT Presentation

Storage Performance Analyzer (SPA) – Measuring, Monitoring, and Modeling of I/O Performance in Virtualized Environments Feb 2, 2015 Qais Noorshams, Axel Busch , Samuel Kounev, Ralf Reussner Austin, Texas, USA SOFTWARE DESIGN AND QUALITY GROUP INSTITUTE FOR PROGRAM STRUCTURES AND DATA ORGANIZATION, FACULTY OF INFORMATICS KIT – University of the State of Baden-Wuerttemberg and www.kit.edu National Research Center of the Helmholtz Association

Motivation VM VM VM VM VMM 2 15-02-02 The Storage Performance Analyzer (SPA)

Motivation VM VM VM VM VMM 3 15-02-02 The Storage Performance Analyzer (SPA)

Motivation VM VM VM VM VMM 4 15-02-02 The Storage Performance Analyzer (SPA)

Motivation VM VM VM VM VMM 5 15-02-02 The Storage Performance Analyzer (SPA)

Motivation VM VM VM VM VMM ● ● ● ● ● ● 15 R ● e ● s p o ● ● ● ● n s ● ● ● ● e 10 ● ● T ● i ● ● ● m ● ● ● ● e ● ● ● ● ● ● ● ● ( ● ● m ● ● ● ● ● ● s 5 ● ● ● ● ● ● ● ) ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 100 ● ● ● ● ● ● ● 80 ● ● ● ● ● ● ● Simultaneous Requests ● ● 60 ● ● ● ● 60 ● ● ● ● ● ● ● ● 40 40 ● ● R e ● ● q u e ● ● s 20 t S 20 z i e ( K B ) 0 0 6 15-02-02 The Storage Performance Analyzer (SPA)

Motivation VM VM VM VM VMM ● ● ● ● ● ● 15 R ● e ● s p o ● ● ● ● n s ● ● ● ● e 10 ● ● T ● i ● ● ● m ● ● ● ● e ● ● ● ● ● ● ● ● ( ● ● m ● ● ● ● ● ● s 5 ● ● ● ● ● ● ● ) ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 100 ● ● ● ● ● ● ● 80 ● ● ● ● ● ● ● Simultaneous Requests ● ● 60 ● ● ● ● 60 ● ● ● ● ● ● ● ● 40 40 ● ● R e ● ● q u e ● ● s 20 t S 20 z i e ( K B ) 0 0 7 15-02-02 The Storage Performance Analyzer (SPA)

Storage Performance Analyzer I Two part framework i) Benchmark harness with included I/O benchmarks ii) Tailored analysis library to analyze the results Tailored and pre-packaged for performance evaluation storage systems in distributed and virtualized environments Accepted in SPEC RG repository of peer-reviewed tools http://research.spec.org/tools/ Research ℠ 8 15-02-02 The Storage Performance Analyzer (SPA)

Storage Performance Analyzer II Design aspects and Practical benefits Synchronized execution on multiple targets Automation of experiment runs with parameter variation Persisting results and avoid piles of log files Easy and powerful statistical evaluation 9 15-02-02 The Storage Performance Analyzer (SPA)

Architecture Benchmark Harness Running on Target(s) Benchmark harness Benchmarking Component Coordinates the execution of Benchmark Benchmark Benchmark Driver attached benchmarks and monitors Remote Benchmark Execution Controller Written in high-level Optional programming language (Java) Monitoring Monitor Driver à Easy to debug Easy data persistence Persistence Lightweight SQLite Database Component SQLite Analysis Library Tailored analysis library Regression R Libraries Optimization Processes and evaluates the collected data and DataStore measurements Regression Interface Techniques Integrated into statistics tool R (http://www.r-project.org/) Regression Performance Modeling Modeling à Full control over the analysis Component 10 15-02-02 The Storage Performance Analyzer (SPA)

SPA in Action – Case Studies Run the benchmark and analyze the results I. System Analysis and Evaluation II. Statistical Analysis and Statistical Modeling III. System Analysis and Explicit Modeling ● ● ● ● ● ● 15 ● ● Response Time (ms) ● ● ● ● ● ● ● ● 10 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● IBM System z IBM DS8700 ● ● ● ● ● ● ● ● 5 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 100 ● ● ● ● ● ● ● 80 0 ● ● ● ● ● ● ● LPAR1 LPAR2 Simultaneous Requests Storage Controller ● ● ● ● 60 ● ● ● ● 60 ● ● ● ● ● ● ● ● ● ● ● ● ● 40 ● R 40 ● ● ● ● e q ● ● ● ● 15 u ● e ● Response Time (ms) 15 ● ● s t S 20 20 ● ● i z e App. Response Time (ms) App. ● ● ( K ● ● ● ● B ) ● ● ● ● 0 ● ● 0 ● ● ● 10 Volatile Non-Volatile ● ● 10 ● ● ● ● ● ● ● ● ● ● ● ● ● Piecewise ● ● ● ● LRM ● ● ● ● ● ● ● ● ● ● ● ● ● Fibre Channel ● ● ● ● ● ● ● ● ● ● ● ● ● ● 5 Cache ● ● ● Cache ● ● ● ● ● ● z/Linux z/Linux ● ● ● 5 ● ● ● ● ● ● linearity ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 100 ● ● ● ● ● ● ● 100 ● ● ● ● ● ● ● ● ● ● ● ● ● 0 ● ● ● 80 ● 80 ● ● ● ● ● ● ● ● ● ● ● ● s ● t s s t ● ● ● ● ● 60 e s ● 60 e 60 ● ● u 60 ● ● ● ● ● u q ● ● e q ● ● R e R ● ● ● s ● ● u s Switched Fibre Channel 40 u PR/SM (Hypervisor) 40 ● ● ● 40 o Request Size (KB) 40 ● ● ● e o R n e ● ● ● n e ● ● a a q l t MARS ● ● u t l u e ● ● m u Storage-Performance-Influencing Factors m s i ● ● S i t 20 S 20 S 20 20 z i e ( K B ) 0 0 Tree structure 0 0 CART Processors, Memory Harddisks (RAID) Step function Workload System Combination ● ● ● ● ● ● ● ● ● ● Boosting Response Time (ms) 15 ● ● ● ● 15 ● ● ● ● ● ● Inst.-based Requests M5 Response Time (ms) Locality ● Operating System Hardware ● ● ● ● ● ● ● 10 ● ● ● ● ● ● ● ● ● ● 10 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● Cubist ● ● ● ● ● ● ● ● ● ● ● ● 5 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 5 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 100 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 80 ● ● ● 100 ● ● ● ● ● ● ● ● Size Mix Pattern ● ● ● File System ● ● ● I/O Scheduler Simultaneous Requests ● ● ● 80 ● ● 60 0 ● ● ● ● ● ● 60 ● ● ● ● ● s s t ● ● ● ● ● ● 60 e 60 ● ● ● ● u ● ● 40 e q 40 ● ● ● ● ● ● R Request Size (KB) s ● ● 40 u ● ● Request Size (KB) 40 ● ● ● ● e o ● ● n ● t a 20 ● u l 20 ● ● m S i 20 20 Derived from Noorshams et al. (2012) 0 0 0 0 11 15-02-02 The Storage Performance Analyzer (SPA)

Conclusion Storage Performance Analyzer (SPA) • Systematic analysis of I/O performance in virtualized environments • Measuring, Monitoring, and Modeling of I/O Performance • Peer-reviewed tool allowing analysis with high degree of automation Download • SPA Project Website 
 http://storageperformanceanalyzer.github.io/SPA/ • Sources and prepared drops for common platforms • Documentation and examples • SPEC RG Tool Repository 
 http://research.spec.org/tools/ • Peer-reviewed tools Research ℠ http://www.descartes-research.net/tools/ 12 15-02-02 The Storage Performance Analyzer (SPA)