perfmon redux analyzing a cuda application with the
play

PerfMon redux: analyzing a CUDA application with the Windows PerfMon - PowerPoint PPT Presentation

Feb 04, 2024 •29 likes •279 views

S6287 PerfMon redux: analyzing a CUDA application with the Windows PerfMon redux: analyzing a CUDA application with the Windows Performance Monitor Richard Wilton Department of Physics and Astronomy Johns Hopkins University S6287: Analyzing

  1. S6287 PerfMon redux: analyzing a CUDA application with the Windows PerfMon redux: analyzing a CUDA application with the Windows Performance Monitor Richard Wilton Department of Physics and Astronomy Johns Hopkins University

  2. S6287: Analyzing a CUDA What to monitor and why application with PerfMon What is there to monitor? � � Speed (duration) � Resource utilization � Interactions between resources � Interactions between resources Why bother? � � Prove that things are operating as expected � Make things run faster � Find performance bottlenecks � Identify resource contention

  3. S6287: Analyzing a CUDA Setup for performance monitoring application with PerfMon Tools you need � � Microsoft Windows � NVidia GPU and CUDA toolkit (NVML) � Microsoft Visual Studio (PerfLib v2) � Microsoft Visual Studio (PerfLib v2) Monitoring setup � � Target machine with target hardware � Application “release” build � Choose your performance counters

  4. S6287: Analyzing a CUDA Choosing performance counters application with PerfMon Counters in the GPU group: � Clock speed (MHz): memory � Clock speed (MHz): SM � Fan speed (% maximum) � Global memory allocated (bytes) � � Global memory allocated (percent) Global memory allocated (percent) � Global memory free (bytes) � Global memory read/write activity (%) � GPU compute activity (%) � GPU temperature (°C) � GPU total power draw (watts) � PCIe receive throughput (KB/s) � PCIe transmit throughput (KB/s)

  5. S6287: Analyzing a CUDA Choosing performance counters application with PerfMon Monitoring everything at once is probably not a good idea.

  6. S6287: Analyzing a CUDA Application pipeline (circa 2013) application with PerfMon � CPU compute activity � GPU (CUDA) compute activity

  7. S6287: Analyzing a CUDA GPU activity application with PerfMon Device-related counters – device 0, 1, 2 � GPU compute activity % � Global memory read/write activity % Host-related counters � CPU activity % � CPU activity % � Host memory allocation

  8. S6287: Analyzing a CUDA GPU activity application with PerfMon Device-related counters – device 0 � GPU compute activity % � Global memory read/write activity % Host-related counters � CPU activity % � CPU activity % � Host memory allocation

  9. Sampling � Jaggedness S6287: Analyzing a CUDA application with PerfMon Device-related counters – device 0 � GPU compute activity % � Global memory read/write activity % Sampled at 1-second intervals Sampled at 1-second intervals Samples are “snapshots” (not averaged)

  10. S6287: Analyzing a CUDA Concurrency among multiple GPUs application with PerfMon Device-related counters – device 0, 1, 2 � GPU compute activity % � Global memory read/write activity % Host-related counters � CPU activity % � CPU activity % � Host memory allocation

  11. S6287: Analyzing a CUDA Concurrency among multiple GPUs application with PerfMon Device-related counters – device 0 � GPU compute activity % � Global memory read/write activity % Host-related counters � CPU activity % � CPU activity % � Host memory allocation

  12. S6287: Analyzing a CUDA Concurrency among multiple GPUs application with PerfMon Device-related counters – device 1 � GPU compute activity % � Global memory read/write activity % Host-related counters � CPU activity % � CPU activity % � Host memory allocation

  13. S6287: Analyzing a CUDA Concurrency among multiple GPUs application with PerfMon Device-related counters – device 2 � GPU compute activity % � Global memory read/write activity % Host-related counters � CPU activity % � CPU activity % � Host memory allocation

  14. S6287: Analyzing a CUDA Starving for CPU cycles application with PerfMon Device-related counters – device 0, 1, 2 � GPU compute activity % � Global memory read/write activity % Host-related counters � CPU activity % � CPU activity % � Host memory allocation

  15. S6287: Analyzing a CUDA Starving for CPU cycles application with PerfMon Device-related counters – device 0 � GPU compute activity % � Global memory read/write activity % Host-related counters � CPU activity % � CPU activity % � Host memory allocation

  16. S6287: Analyzing a CUDA Starving for CPU cycles application with PerfMon Device-related counters – device 0, 1, 2 � GPU compute activity % � Global memory read/write activity % Host-related counters � CPU activity % � CPU activity % � Host memory allocation

  17. S6287: Analyzing a CUDA Starving for CPU cycles application with PerfMon Device-related counters – device 0 � GPU compute activity % � Global memory read/write activity % Host-related counters � CPU activity % � CPU activity % � Host memory allocation

  18. S6287: Analyzing a CUDA Consuming a resource application with PerfMon Device-related counters – device 2 � GPU compute activity % � Global memory allocated (bytes) (image TBD) Host-related counters � CPU activity % � CPU activity %

  19. S6287: Analyzing a CUDA GPU mystery application with PerfMon Device-related counters – device 0, 1 � GPU compute activity % � Global memory read/write activity % � GPU temperature (°C) � GPU total power draw (watts) � GPU total power draw (watts) Host-related counters � CPU activity % � Host memory allocation

  20. S6287: Analyzing a CUDA GPU mystery application with PerfMon Device-related counters – device 0, 1 � GPU compute activity % � Global memory read/write activity % � GPU temperature (°C) � GPU total power draw (watts) � GPU total power draw (watts) Host-related counters � CPU activity % � Host memory allocation

  21. S6287: Analyzing a CUDA GPU mystery application with PerfMon Device-related counters – device 0, 1 � GPU compute activity % � Global memory read/write activity % � GPU temperature (°C) � GPU total power draw (watts) � GPU total power draw (watts) Host-related counters � CPU activity % � Host memory allocation

  22. S6287: Analyzing a CUDA GPU mystery application with PerfMon Device-related counters – device 0, 1 � GPU compute activity % � Global memory read/write activity % � GPU temperature (°C) � GPU total power draw (watts) � GPU total power draw (watts) Host-related counters � CPU activity % � Host memory allocation

  23. S6287: Analyzing a CUDA GPU mystery application with PerfMon Device-related counters – device 0, 1 � GPU compute activity % � Global memory read/write activity % � GPU temperature (°C) � GPU total power draw (watts) � GPU total power draw (watts) Host-related counters � CPU activity % � Host memory allocation

  24. S6287: Analyzing a CUDA PerfMon and CUDA application with PerfMon What is there to monitor? � � Speed (duration) � Resource utilization � Interactions between resources � Interactions between resources Why bother? � � Prove that things are operating as expected � Make things run faster � Find performance bottlenecks � Identify resource contention

  25. S6287: Analyzing a CUDA application with PerfMon Questions / Comments

Recommend

How to Write a Parallel GPU Application Using CUDA and Charm++ Presented by Lukasz Wesolowski

How to Write a Parallel GPU Application Using CUDA and Charm++ Presented by Lukasz Wesolowski

How to Write a Parallel GPU Application Using CUDA and Charm++ Presented by Lukasz Wesolowski Outline GPGPUs and CUDA Requirements for a GPGPU API (from a Charm++ standpoint) CUDA stream approach Charm++ GPU Manager 2 General

562 views • 11 slides
Details and description of Application CUDA Application and first results Fig. 2: An Example of

Details and description of Application CUDA Application and first results Fig. 2: An Example of

CUDA based implementation of parallelized Pollard's Rho algorithm for ECDLP M. Chinnici a , S. Cuomo b , M. Laporta c , B. Pennacchio d , A. Pizzirani e , S. Migliori f a,d ENEA- FIM-INFOPPQ, Casaccia Research Center, Via Anguillarese 301, 00123

448 views • 10 slides
Introduction to CUDA C What is CUDA? CUDA Architecture Expose general-purpose GPU

Introduction to CUDA C What is CUDA? CUDA Architecture Expose general-purpose GPU

Introduction to CUDA C What is CUDA? CUDA Architecture Expose general-purpose GPU computing as first-class capability Retain traditional DirectX/OpenGL graphics performance CUDA C Based on industry-standard C A handful of

1.31k views • 62 slides
Lecture 2.1 - Introduction to CUDA C CUDA C vs. Thrust vs. CUDA Libraries Objective To learn

Lecture 2.1 - Introduction to CUDA C CUDA C vs. Thrust vs. CUDA Libraries Objective To learn

GPU Teaching Kit Accelerated Computing Lecture 2.1 - Introduction to CUDA C CUDA C vs. Thrust vs. CUDA Libraries Objective To learn the main venues and developer resources for GPU computing Where CUDA C fits in the big picture 2 3

1.28k views • 12 slides
1 8 Months of Redux March 4, 2017 Yuri Takhteyev CTO + 19 Ranglers Redux at Rangle

1 8 Months of Redux March 4, 2017 Yuri Takhteyev CTO + 19 Ranglers Redux at Rangle

1 8 Months of Redux March 4, 2017 Yuri Takhteyev CTO + 19 Ranglers Redux at Rangle Weve been actively using Redux for a bit over 18 months. This is a good opportunity to re fl ect on what weve De fi ne learned. Prepare

545 views • 33 slides
CUDA/Ada An Ada binding to CUDA Reto B urki, Adrian-Ken R uegsegger University of Applied

CUDA/Ada An Ada binding to CUDA Reto B urki, Adrian-Ken R uegsegger University of Applied

Introduction Bindings in Ada CUDA/Ada Design CUDA Binding Conclusion CUDA/Ada An Ada binding to CUDA Reto B urki, Adrian-Ken R uegsegger University of Applied Sciences Rapperswil (HSR), Switzerland 1/16/2012 Master seminar: Program

469 views • 36 slides
Lecture 2.4 Introduction to CUDA C Introduction to the CUDA Toolkit Objective To become

Lecture 2.4 Introduction to CUDA C Introduction to the CUDA Toolkit Objective To become

GPU Teaching Kit Accelerated Computing Lecture 2.4 Introduction to CUDA C Introduction to the CUDA Toolkit Objective To become familiar with some valuable tools and resources from the CUDA Toolkit Compiler flags Debuggers

887 views • 34 slides
A CUDA FORTRAN PORT OF CLOVERLEAF GREG RUETSCH, NVIDIA CLOVERLEAF APPLICATION Component of

A CUDA FORTRAN PORT OF CLOVERLEAF GREG RUETSCH, NVIDIA CLOVERLEAF APPLICATION Component of

A CUDA FORTRAN PORT OF CLOVERLEAF GREG RUETSCH, NVIDIA CLOVERLEAF APPLICATION Component of Sandia's Mantevo benchmarks 2D structured grid hydrodynamic mini-app Double precision Explicit compressible Euler equations Finite volume

538 views • 25 slides
Data-Intensive Distributed Computing CS 431/631 451/651 (Fall 2019) Part 8: Analyzing Graphs,

Data-Intensive Distributed Computing CS 431/631 451/651 (Fall 2019) Part 8: Analyzing Graphs,

Data-Intensive Distributed Computing CS 431/631 451/651 (Fall 2019) Part 8: Analyzing Graphs, Redux (2/2) November 21, 2019 Ali Abedi These slides are available at https://www.student.cs.uwaterloo.ca/~cs451 This work is licensed under a

1.05k views • 50 slides
Advanced CUDA: Application Examples John E. Stone Theoretical and Computational Biophysics Group

Advanced CUDA: Application Examples John E. Stone Theoretical and Computational Biophysics Group

Advanced CUDA: Application Examples John E. Stone Theoretical and Computational Biophysics Group Beckman Institute for Advanced Science and Technology University of Illinois at Urbana-Champaign http://www.ks.uiuc.edu/Research/gpu/ GPGPU2:

1.06k views • 102 slides
Outline Overview Parallel Computing with GPU Introduction to CUDA CUDA Thread Model

Outline Overview Parallel Computing with GPU Introduction to CUDA CUDA Thread Model

Outline Overview Parallel Computing with GPU Introduction to CUDA CUDA Thread Model CUDA Memory Hierarchy and Memory Spaces CUDA Memory Hierarchy and Memory Spaces CUDA Synchronization 2110412 Parallel Comp Arch CUDA:

449 views • 12 slides
CUDA Application Examples John E. Stone Theoretical and Computational Biophysics Group Beckman

CUDA Application Examples John E. Stone Theoretical and Computational Biophysics Group Beckman

CUDA Application Examples John E. Stone Theoretical and Computational Biophysics Group Beckman Institute for Advanced Science and Technology University of Illinois at Urbana-Champaign http://www.ks.uiuc.edu/Research/gpu/ GPGPU 2015: Advanced

1.6k views • 140 slides
Data-Intensive Distributed Computing CS 431/631 451/651 (Winter 2019) Part 8: Analyzing Graphs,

Data-Intensive Distributed Computing CS 431/631 451/651 (Winter 2019) Part 8: Analyzing Graphs,

Data-Intensive Distributed Computing CS 431/631 451/651 (Winter 2019) Part 8: Analyzing Graphs, Redux (1/2) March 21, 2019 Adam Roegiest Kira Systems These slides are available at http://roegiest.com/bigdata-2019w/ This work is licensed under

925 views • 74 slides
Creating a modern web application using Symfony API Platform, ReactJS and Redux by Jesus Manuel

Creating a modern web application using Symfony API Platform, ReactJS and Redux by Jesus Manuel

Creating a modern web application using Symfony API Platform, ReactJS and Redux by Jesus Manuel Olivas & Eduardo Garcia @jmolivas | @enzolutions Who We Are? Jesus Manuel Olivas jmolivas@weknowinc.com jmolivas jmolivas

749 views • 59 slides
HPC Application Porting to CUDA at BSC Pau Farr, Marc Jord GTC 2016 - San Jose Agenda

HPC Application Porting to CUDA at BSC Pau Farr, Marc Jord GTC 2016 - San Jose Agenda

www.bsc.es HPC Application Porting to CUDA at BSC Pau Farr, Marc Jord GTC 2016 - San Jose Agenda WARIS-Transport PELE Atmospheric volcanic ash transport Protein-drug interaction simulation simulation Life Sciences

576 views • 30 slides
GPU Programming Alan Gray EPCC The University of Edinburgh Overview Motivation and need

GPU Programming Alan Gray EPCC The University of Edinburgh Overview Motivation and need

GPU Programming Alan Gray EPCC The University of Edinburgh Overview Motivation and need for CUDA Introduction to CUDA CUDA kernels, decompositions CUDA memory management C and Fortran OpenCL 2 NVIDIA CUDA

1.24k views • 37 slides
A High-Level Intro to CUDA CS5220 Fall 2015 What is CUDA? C ompute U nified D evice A

A High-Level Intro to CUDA CS5220 Fall 2015 What is CUDA? C ompute U nified D evice A

A High-Level Intro to CUDA CS5220 Fall 2015 What is CUDA? C ompute U nified D evice A rchitecture released in 2007 GPU Computing Extension of C/C++ requires NVCC (CUDA Compiler) and NVIDIA Graphics Card Historical

507 views • 38 slides
ACHIEVING DETERMINISTIC EXECUTION TIMES IN CUDA APPLICATIONS Aayush Rajoria, Ashok Kelur 20 th

ACHIEVING DETERMINISTIC EXECUTION TIMES IN CUDA APPLICATIONS Aayush Rajoria, Ashok Kelur 20 th

ACHIEVING DETERMINISTIC EXECUTION TIMES IN CUDA APPLICATIONS Aayush Rajoria, Ashok Kelur 20 th March 2019 CONTENTS CUDA Everywhere Deterministic Execution times Automotive Trade-offs Application execution flow Factors

451 views • 32 slides
S9391 GstCUDA: Easy GStreamer and CUDA Integration Eng. Daniel Garbanzo MSc. Michael Grner

S9391 GstCUDA: Easy GStreamer and CUDA Integration Eng. Daniel Garbanzo MSc. Michael Grner

S9391 GstCUDA: Easy GStreamer and CUDA Integration Eng. Daniel Garbanzo MSc. Michael Grner GTC March 2019 About RidgeRun GStreamer Overview CUDA Overview GstCUDA Introduction Agenda Application Examples Performance Statistics GstCUDA

618 views • 46 slides
CUDA 7 AND BEYOND MARK HARRIS, NVIDIA CUDA 7 Runtime C++11 cuSOLVER Compilation

CUDA 7 AND BEYOND MARK HARRIS, NVIDIA CUDA 7 Runtime C++11 cuSOLVER Compilation

CUDA 7 AND BEYOND MARK HARRIS, NVIDIA CUDA 7 Runtime C++11 cuSOLVER Compilation [&](char)c)){) ))for)(auto)x):)letters))) ))))if)(c)==)x))return)true;) ))return)false;) }) C++11 FEELS LIKE A NEW LANGUAGE Bjarne Stroustrup,

1.1k views • 37 slides
A statistical modeling framework for analyzing tree-indexed data Application to plant development

A statistical modeling framework for analyzing tree-indexed data Application to plant development

A statistical modeling framework for analyzing tree-indexed data Application to plant development at microscopic and macroscopic scales Pierre Fernique 1 , 2 edon 2 & Jean-Baptiste Durand 3 S upervised by Yann Gu 1 Universit e Montpellier

1.03k views • 89 slides
The Hydrogen Atom Redux The first three wavefunctions (n=1,2,3) of a 1D particle in a box of

The Hydrogen Atom Redux The first three wavefunctions (n=1,2,3) of a 1D particle in a box of

The Hydrogen Atom Redux The first three wavefunctions (n=1,2,3) of a 1D particle in a box of length L. n=1 1.0 0.5 (x/L) x/L 0.2 0.4 0.6 0.8 1.0 - 0.5 n=3 - 1.0 n=2 Physics 273 The Hydrogen Atom Redux 2 Example: Lets

823 views • 13 slides
Performance Evaluation of a Multithreaded GPU Using CUDA GPU architecture GeForce 8800 GPU

Performance Evaluation of a Multithreaded GPU Using CUDA GPU architecture GeForce 8800 GPU

Optimization Principles and Application Performance Evaluation of a Multithreaded GPU Using CUDA GPU architecture GeForce 8800 GPU 16 Streaming multiprocessors 8 Streaming processors pr SM 8192 registers pr SM 768 threads pr SM

211 views • 6 slides
Approaches to GPU computing Manuel Ujaldon Nvidia CUDA Fellow Computer Architecture Department

Approaches to GPU computing Manuel Ujaldon Nvidia CUDA Fellow Computer Architecture Department

Approaches to GPU computing Manuel Ujaldon Nvidia CUDA Fellow Computer Architecture Department University of Malaga (Spain) Talk outline [40 slides] 1. Programming choices. [30] 1. CUDA libraries and tools. [10] 2. Targeting CUDA to other

1.17k views • 49 slides

More recommend