Hardware Acceleration for RAID5/6, Deduplication & Security for - PowerPoint PPT Presentation

Hardware Acceleration for RAID5/6, Deduplication & Security for parallel workloads Vikas Aggarwal Storage Developer Conference Bangalore 2017

Team Members • Venkatesh Bolla • Achyutha Krishna • Anil Reddy Responsibilities: Storage software acceleration on OCTEON TX.

Outline • RAID 5/6 • Deduplication • Security • Open Source Storage Applications • OCTEON TX Acceleration blocks • Accelerated Data Flow • Observations

Offloading CPU intensive operations • RAID6 • XOR • Galois Field Multiplication • Deduplication • Fingerprint Generation • Fingerprint Lookup • Security • Encryption/Decryption of Data Blocks

Open Source Storage Software Offload Case Studies RAID DEDUPLICATION SECURITY MD RAID DM Dedup ecryptfs DM RAID OpenZFS DM Crypt btrFS btrFS OpenDedup

Linux MD RAID • Implements the following: • RAID 0, 1, 5, 6 • MDRAID can offload following to hardware using async_tx Linux offload infrastructure: • memcpy • XOR • Galois Field Arithmetic • Current Offload benefits the following RAID variants: • RAID 5, 6

Linux DM-dedup • Implements the following: • 4KB block fingerprint • Fingerprint to PBN(Physical block number) lookup • LBN to PBN(Physical block number) lookup • DM Dedup(modified) can offload following to hardware: • Fingerprint (Digest using MD5, SHA1, SHA2) • Fingerprint and LBN lookup. • Current Offload benefits the following: • Lookups.

Linux eCryptfs In-kernel standalone implementation. • Security gets inherited into incremental backups. • Cryptographic metadata is stored along with encrypted file. • • Supports Linux cryptographic ciphers. Utilizes Linux crypto framework • eCryptfs can offload following to hardware • AES CBC • DES3 CBC • AES XTS • Offload benefits: Encryption, Decryption. •

RAID Architecture

Linux MDRAID Offload

Dmdedup Architecture

DmDedup WRITE Offload Data Chunk Compute HASH Uniq WR Dup WR Hash->PBN Yes No LBN->PBN LBN->PBN DDF Offload Block dmdedup dmdedup code code DISK

DmDedup READ Offload Sector Compute LBN Hit Miss LBN->PBN dmdedup code DDF Offload Block DISK DATA END

Storage Security Offload

Accelerations Integrated

RAID offload relative CPU savings OCTEON TX %cpu idle 35 30 25 20 15 10 5 0 0 4 8 16 24 OCTEON TX-raid-offload(cpu savings) No. disks/raid6 grp

Dmdedup offload Ingest rate OCTEON TX throughput 6 5 5xGain 4 3 2 1 0 0GB 40GB 80GB 160GB 200GB x86_64 OCTEON TX OCTEON TX-offload

Dmdedup fio WRITE offload latency OCTEON TX 6 5 4 5xReduction 3 2 1 0 0 40GB 80GB 160GB 200GB x86_64 OCTEON TX OCTEON TX-offload

Ecryptfs OCTEON TX %cpu used 100 90 80 70 60 50 40 30 20 10 0 0 1 4 8 16 32 48 No. threads OCTEON TX OCTEON TX-offload

Dedup + RAID6, eCryptFS+RAID6 OCTEONTX OCTEON TX throughput %cpu idle Fio WRITE 90 80 70 60 50 40 30 20 10 0 50GB, 4Tx5GB 50GB, 8Tx2GB 100GB, 16Tx2GB OCTEON TX OCTEON TX-offload

Status • Status of Work – Preliminary performance results. More in future summits. • Upstream the drivers. • Other Platforms: • DPDK+SPDK • ODP

Q & A Vikas Aggarwal Vikas.Aggarwal@Cavium.com

Hardware Acceleration for RAID5/6, Deduplication & Security for - PowerPoint PPT Presentation

Hardware Acceleration for RAID5/6, Deduplication & Security for parallel workloads Vikas Aggarwal Storage Developer Conference Bangalore 2017 Team Members Venkatesh Bolla Achyutha Krishna Anil Reddy Responsibilities: Storage

parallel workloads Vikas Aggarwal Storage Developer Conference Bangalore 2017 Team Members

Hardware Acceleration: An Essential Part of Cyber Security in High-Speed Networks Ji

acceleration of security protocols Boris Pismenny (Mellanox) Declan Doherty (Intel) Hemant

Hardware Acceleration of Cryptography Patrick Schaumont Professor Bradley Department of ECE

Understanding Hardware Acceleration on Mobile Browsers Ariya Hidayat Magical Advice Use

acceleration Proceedings of netdev 0.1, Feb 14-17, 2015, Ottawa, On, Canada NSS acceleration

Sec Secure ure Hardware Hardware and Hardware and Hardware- En Enabled abled Security

Summary Security: Applications & Aspects Part I Cryptographic Features Introduction

Endorse Brand - free Hardware Security Web + Hardware Security is much, much more than just:

DATA FLOW ORIENTED HARDWARE DESIGN OF RNS-BASED POLYNOMIAL MULTIPLICATION FOR SHE ACCELERATION

HARDSPLOIT Framework for Hardware Security Audit a bridge between hardware & a so0ware

Hardware Acceleration of Hardware Acceleration of Graphics and Imaging Graphics and Imaging

Amandeep Chhabra, Adil Sadik, Manu Dhundi,Prabhat Godse What is Hardware Acceleration of Market

Genesis: A Hardware Acceleration Framework for Genomic Data Analysis Tae Jun Ham , David

CrypTech October 2018 Barcelona Hardware Security Module From Wikipedia: A hardware security

Cryptech The Open Hardware Security Module Platform Joachim Strmbergson ::1 Assured AB

Hardware Acceleration of Feature Detection and Description Algorithms on LowPower Embedded

Programmable Hardware Acceleration Vinay Gangadhar PhD Final Examination Thursday, Nov 16 th ,

Hardware Acceleration for Programs in SSA Form Manuel Mohr, Artjom Grudnitsky, Tobias

TECH 5 - Beyond WAN Acceleration: Using Riverbed for more than just Using Riverbed for more than

Hardware Acceleration of Transactional Memory on Commodity Systems Jared Casper , Tayo Oguntebi,

Compilation and Hardware Support for Approximate Acceleration Thierry Moreau , Adrian Sampson,

Hardware Acceleration of Transactional Memory on Commodity Systems Jared Casper , Tayo Oguntebi,

Hardware Acceleration of Pulsar Search on FPGAs using OpenCL Oliver Sinnen Haomiao Wang &

Hardware Acceleration for RAID5/6, Deduplication & Security for - PowerPoint PPT Presentation

Hardware Acceleration for RAID5/6, Deduplication & Security for parallel workloads Vikas Aggarwal Storage Developer Conference Bangalore 2017 Team Members Venkatesh Bolla Achyutha Krishna Anil Reddy Responsibilities: Storage

parallel workloads Vikas Aggarwal Storage Developer Conference Bangalore 2017 Team Members

Hardware Acceleration: An Essential Part of Cyber Security in High-Speed Networks Ji

acceleration of security protocols Boris Pismenny (Mellanox) Declan Doherty (Intel) Hemant

Hardware Acceleration of Cryptography Patrick Schaumont Professor Bradley Department of ECE

Understanding Hardware Acceleration on Mobile Browsers Ariya Hidayat Magical Advice Use

acceleration Proceedings of netdev 0.1, Feb 14-17, 2015, Ottawa, On, Canada NSS acceleration

Sec Secure ure Hardware Hardware and Hardware and Hardware- En Enabled abled Security

Summary Security: Applications &amp; Aspects Part I Cryptographic Features Introduction

Endorse Brand - free Hardware Security Web + Hardware Security is much, much more than just:

DATA FLOW ORIENTED HARDWARE DESIGN OF RNS-BASED POLYNOMIAL MULTIPLICATION FOR SHE ACCELERATION

HARDSPLOIT Framework for Hardware Security Audit a bridge between hardware &amp; a so0ware

Hardware Acceleration of Hardware Acceleration of Graphics and Imaging Graphics and Imaging

Amandeep Chhabra, Adil Sadik, Manu Dhundi,Prabhat Godse What is Hardware Acceleration of Market

Genesis: A Hardware Acceleration Framework for Genomic Data Analysis Tae Jun Ham , David

CrypTech October 2018 Barcelona Hardware Security Module From Wikipedia: A hardware security

Cryptech The Open Hardware Security Module Platform Joachim Strmbergson ::1 Assured AB

Hardware Acceleration of Feature Detection and Description Algorithms on LowPower Embedded

Programmable Hardware Acceleration Vinay Gangadhar PhD Final Examination Thursday, Nov 16 th ,

Hardware Acceleration for Programs in SSA Form Manuel Mohr, Artjom Grudnitsky, Tobias

TECH 5 - Beyond WAN Acceleration: Using Riverbed for more than just Using Riverbed for more than

Hardware Acceleration of Transactional Memory on Commodity Systems Jared Casper , Tayo Oguntebi,

Compilation and Hardware Support for Approximate Acceleration Thierry Moreau , Adrian Sampson,

Hardware Acceleration of Transactional Memory on Commodity Systems Jared Casper , Tayo Oguntebi,

Hardware Acceleration of Pulsar Search on FPGAs using OpenCL Oliver Sinnen Haomiao Wang &amp;

Summary Security: Applications & Aspects Part I Cryptographic Features Introduction

HARDSPLOIT Framework for Hardware Security Audit a bridge between hardware & a so0ware

Hardware Acceleration of Pulsar Search on FPGAs using OpenCL Oliver Sinnen Haomiao Wang &