Processing in Storage Class Memory Joel Nider Craig Mustard - PowerPoint PPT Presentation

Nov 02, 2022 •365 likes •630 views

Processing in Storage Class Memory Joel Nider Craig Mustard Andrada Zoltan Alexandra Fedorova Embedding Processors in SCM CPU Non-volatile RAM Storage Latency Is Decreasing Scaling Compute with Storage Storage Arrays Persistent Smart

Processing in Storage Class Memory Joel Nider Craig Mustard Andrada Zoltan Alexandra Fedorova
Embedding Processors in SCM CPU Non-volatile RAM
Storage Latency Is Decreasing
Scaling Compute with Storage Storage Arrays Persistent Smart Disks / SSD SCM PIM in RAM Volatile Smart Caches CPU + registers Latency
Scaling Compute with Storage Storage Arrays Persistent Smart Disks / SSD SCM PIM in RAM Volatile Smart Caches CPU + registers Latency
Benefits of PIM on SCM DPU SCM CPU Memory bus DRAM
Benefits of PIM on SCM CPU Memory bus
Benefits of PIM on SCM CPU Memory bus
Benefits of PIM on SCM DPU CPU Memory bus SCM
Benefits of PIM on SCM Core Density 64 4 GB Ratio: 1:64 MB SCM Capacity: DPU Count: CPU Memory bus
Benefits of PIM on SCM 128 8 GB Ratio: 1:64 MB SCM Capacity: DPU Count: CPU Memory bus
Benefits of PIM on SCM 256 16 GB Ratio: 1:64 MB SCM Capacity: DPU Count: CPU Memory bus
Benefits of PIM on SCM 512 32 GB Ratio: 1:64 MB SCM Capacity: DPU Count: CPU Memory bus
Benefits of PIM on SCM CPU Memory bus
PIM Design Points Address Inter-PIM Translation Communication Instruction Core Set Density
UPMEM Architecture and Limitations DPU DRAM
UPMEM Architecture and Limitations DPU SRAM Control DRAM DDR Interface External Bus
Interleaved Multithreading
UPMEM Architecture and Limitations Input data ABCDEFGHIJKLMNOPQRSTUV Memory bus DPU 0 DPU 1 DPU 2
UPMEM Architecture and Limitations A B C D E F G H Input data IJKLMNOPQRSTUVWXYZabcd Memory bus A DPU 0 B DPU 1 C DPU 2
UPMEM Architecture and Limitations A B C D E F G H I J K L M N O P Input data QRSTUVWXYZabcdefghijkl Memory bus AI DPU 0 BJ DPU 1 CK DPU 2
Raw Performance: Throughput 9 ranks x 64 DPUS = 576 DPUs 64KB SRAM 576 DPUs x 64MB = 36GB DRAM 64 MB 36 GB in 0.16 s = 252 GB/s DRAM DPU Top speed of DDR4-2400 channel: 19GB/s 16 threads @ 2KB per transfer
Use Case: Compression File Size DPUs spamfile 84 MB 172 mozilla 50 MB 105 nci 30 MB 64 dickens 10 MB 35 sao 7 MB 21 xml 5 MB 15 world192 1 MB 4 plrabn12 0.5 MB 2 terror2 0.1 MB 1
Wishlist Concurrent Data Triggered Functions Memory Access Mix Of Tuning For Memory Types Performance
Future Directions Hyperdimensional Computing Regular Expression ? Search
Thank you for watching Joel Nider joel@ece.ubc.ca Craig Mustard craigm@ece.ubc.ca Andrada Zoltan zoltandrada@gmail.com Alexandra Fedorova sasha@ece.ubc.ca

Recommend

Storage Class Memory Towards a disruptively low-cost solid-state non-volatile memory Science

Storage Class Memory Towards a disruptively low-cost solid-state non-volatile memory Science & Technology Almaden Research Center January 2013 Storage Class Memory Power & space in the server room The cache/memory/storage hierarchy

868 views • 27 slides

Architectural Principles for Database Systems on Storage-Class Memory Dr.-Ing. Ismail Oukid

Architectural Principles for Database Systems on Storage-Class Memory Dr.-Ing. Ismail Oukid Dissertationspreis Vortrag BTW Rostock, March 8, 2019 Storage-Class Memory SCM is byte-addressable non-volatile memory Main Memory High Performance

600 views • 25 slides

static vs automatic storage classes Three types of memory allocations static storage class

static vs automatic storage classes Three types of memory allocations static storage class means variable persists through static allocation: for globals and any static the life of the program variables in functions automatic storage

569 views • 9 slides

Memory Chapter 7 Encoding, Storage and Retrieval of Memor y Encoding Storage

Memory Chapter 7 Encoding, Storage and Retrieval of Memor y Encoding Storage Retrieval Forgetting Three Systems of Memory Sensory memory Iconic memory Echoic memory Working/ short-term memory - storage process

701 views • 19 slides

IEE5009 Autumn 2012 Memory Systems Storage Class Memory Chiao-Ying, Huang Department of

IEE5009 Autumn 2012 Memory Systems Storage Class Memory Chiao-Ying, Huang Department of Electronics Engineering National Chiao Tung University saomyhunag@gmail.com Chiao-Ying, Huang 2012 Outline Issues for Traditional Memory System

508 views • 26 slides

NRAM D Defines a a New C Categor gory o of Memory C Class S ss Storage Bill Gervasi

NRAM D Defines a a New C Categor gory o of Memory C Class S ss Storage Bill Gervasi Principal Systems Architect 11 April 2019 2 NR NRAM Technol ology ogy Value Te Test Propos osition on Results ts Age genda Marke

487 views • 29 slides

Introduction to I/O and File storage. Disk Management dollar/GB GB/dollar RAM

Secondary Storage Management Disks just like memory, only different Why have disks? Memory is small. Disks are large. Short term storage for memory contents (e.g., swap space). Reduce what must be kept in memory (e.g., code

404 views • 6 slides

Welcome to The Memory Class An Introduction to Memory Problems and the Memory Center Agenda For

Welcome to The Memory Class An Introduction to Memory Problems and the Memory Center Agenda For Todays Class Importance of the Questionnaire Description of the Memory Center Program Advanced Care Planning Lecture about Memory

695 views • 38 slides

Data Management Systems Storage Management The Memory hierarchy Memory hierarchy

Data Management Systems Storage Management The Memory hierarchy Memory hierarchy Capacity and latencies Segments and file storage Locality and replacement policies Database buffer cache Hardware evolution Storage

546 views • 18 slides

Storage, Data Organization, and Buffering Walid G. Aref Memory Hierarchy Archival Storage

Storage, Data Organization, and Buffering Walid G. Aref Memory Hierarchy Archival Storage Higher (e.g., tapes) Capacity Network Storage Block-oriented access Non- Disk Storage Volatile Solid-State Disks Main Memory Byte-oriented

816 views • 38 slides

Using a Shared Storage Class Memory Device to Improve the Reliability of RAID Arrays S.

Using a Shared Storage Class Memory Device to Improve the Reliability of RAID Arrays S. Chaarawi. U. of Houston J.-F. Pris, U. of Houston A. Amer, Santa Clara U. T. J. E. Schwarz, U. Catlica del Uruguay D. D. E. Long, U. C. Santa Cruz

709 views • 34 slides

Persistent storage just like memory, only different Just like diamonds last forever (?) memory is

Persistent storage just like memory, only different Just like diamonds last forever (?) memory is volatile very dense Persistent Storage 10 TBytes of storage fit here ...but much cheaper 10 TByte NAS drive is $ 300 on Amazon way cheaper than How

788 views • 10 slides

IO and Device Management IO Processing DMA Logical Structure of I/O Functionality

IO and Device Management IO Processing DMA Logical Structure of I/O Functionality Buffering Reading: Silberschatz Chapter 13 I/O Devices graphics keyboard mass storage CPU CPU mouse printer memory memory modem

399 views • 8 slides

Memory Memory processing is the ability to: Acquire (Short term memory) Manipulate

Memory Memory processing is the ability to: Acquire (Short term memory) Manipulate (Working memory) Retain (Long term memory) Memory Retrieve (Long term memory) processing A difficulty with any one or more of these skills

361 views • 6 slides

Memory Eric McCreath Research School of Computer Science Memory Hierarchy Different storage

Memory Eric McCreath Research School of Computer Science Memory Hierarchy Different storage technologies have different: access times, storage capacities, and costs per bit. In most computer systems there will be a range of different storage

619 views • 6 slides

Data Management Systems Storage Management Memory hierarchy Segments and file storage

Data Management Systems Storage Management Memory hierarchy Segments and file storage Database buffer cache Storage techniques in context Cloud native databases (Snowflake) Gustavo Alonso Institute of Computing Platforms

229 views • 12 slides

Last Class: Memory Management Allocating memory to processes Limited physical memory,

Last Class: Memory Management Allocating memory to processes Limited physical memory, internal and external fragmentation Paging and segmentation Address translation, efficiency Hardware support (e.g., TLB) Page

513 views • 13 slides

Virtual Memory 1 Virtual Memory Main memory is cache for secondary storage

Virtual Memory 1 Virtual Memory Main memory is cache for secondary storage Secondary storage (disk) holds the complete virtual address space Only a portion of the virtual address space lives in the physical address

558 views • 16 slides

Memory Allocation Memory What is memory? Storage for variables, data, code etc. How is

Memory Allocation Memory What is memory? Storage for variables, data, code etc. How is memory organized? Text Text (Code) Data Data (Constants) BSS BSS (Global and static variables) Heap Stack (Local variables)

597 views • 25 slides

Long-Term Memory Introduction STM versus LTM Episodic Memory Semantic Memory

3/16/17 Long-Term Memory Introduction STM versus LTM Episodic Memory Semantic Memory Procedural Memory Encoding in Long-Term Memory Depth of Processing (or Levels of Processing) Self Reference Effect

863 views • 19 slides

Memory Management Variable Storage Storage binding - binds the address attribute of a variable

Memory Management Variable Storage Storage binding - binds the address attribute of a variable to physical storage n Disregarding object attributes (fields) for now Allocation of space n Static (compile-time or load time) n Stack

1.27k views • 84 slides

Part III Part III Storage Management Storage Management Chapter 9: Virtual Memory Chapter 9:

Part III Part III Storage Management Storage Management Chapter 9: Virtual Memory Chapter 9: Virtual Memory 1 Fall 2010 Observations Observations A complete program does not have to be in memory because memory, because error

616 views • 50 slides

The Memory Hierarchy Today Storage technologies and trends Locality of reference

The Memory Hierarchy Today Storage technologies and trends Locality of reference Caching in the memory hierarchy Next time Cache memory Chris Riesbeck, Spring 2010 Original: Fabian Bustamante Saturday, October 29, 2011

849 views • 45 slides

Data Management Systems Storage Management Introduction and motivation Memory hierarchy

Data Management Systems Storage Management Introduction and motivation Memory hierarchy Segments and file storage Database buffer cache Storage techniques in context Gustavo Alonso Institute of Computing Platforms

250 views • 8 slides