Tutorial on Floating-Point Analysis and Reproducibility Tools for - PowerPoint PPT Presentation

Oct 23, 2022 •223 likes •311 views

Tutorial on Floating-Point Analysis and Reproducibility Tools for Scientific Software Ignacio Laguna, Harshitha Menon Lawrence Livermore National Laboratory Michael Bentley, Ian Briggs, Pavel Panchekha, Ganesh Gopalakrishnan University of Utah

Tutorial on Floating-Point Analysis and Reproducibility Tools for Scientific Software Ignacio Laguna, Harshitha Menon Lawrence Livermore National Laboratory Michael Bentley, Ian Briggs, Pavel Panchekha, Ganesh Gopalakrishnan University of Utah Hui Guo, Cindy Rubio González University of California at Davis Michael O. Lam James Madison University 1 http://fpanalysistools.org/ → Tutorial Material → LANL
Ignacio Harshitha Michael Pavel Ganesh Ian Laguna Menon Bentley Panchekha Gopalakrishnan Briggs Cindy Rubio Hui Guo Michael Lam González 2 http://fpanalysistools.org/ → Tutorial Material → LANL
Objective of the Tutorial Demonstrate tools can be used today GPUs Exceptions Data races Reproducibility & Floating-Point Compilers Floating-point ND non-determinism Analysis Optimizations (ND) MPI & OpenMP Mixed-precision Benchmarks 3 http://fpanalysistools.org/ → Tutorial Material → LANL
Everything is here: fpanalysistools.org Tutorial Material → LANL 4 http://fpanalysistools.org/ → Tutorial Material → LANL
AWS is Used to Run Exercises You will need: ● Username, password, IP address ○ Accessing the AWS instance via ssh: ● ssh [USERNAME]@[IP ADDRESS] 5 http://fpanalysistools.org/ → Tutorial Material → LANL
Directory Structure /home/user1/ |---Module-TOOL1 |---exercise-1 |---exercise-2 |---exercise-3 |---Module-TOOL2 |---exercise-1 |---exercise-2 |---exercise-3 ... 6 http://fpanalysistools.org/ → Tutorial Material → LANL
Agenda Time Module Presenter 9:00 - 9:10am Introduction (housekeeping) Ignacio 9:10 - 9:30am Floating-point background Ganesh 9:30 - 10:00am FPChecker : floating-point exceptions, GPUs, CUDA Ignacio 10:00 - 10:15am Break or Q&A 10:15 - 10:45am ARCHER : data races, OpenMP Ian 10:45 - 11:30am FLiT : floating-point variability, compiler optimizations Ian 11:30 - 12:00pm ReMPI : MPI, floating-point variability Ignacio, Ian 12:00 - 12:15pm Q&A 7 http://fpanalysistools.org/ → Tutorial Material → LANL

Recommend

Numerical reproducibility of high-performance computations using floating-point or interval

Numerical reproducibility issues in floating-point arithmetic Numerical reproducibility issues in interval arithmetic Conclusions Numerical reproducibility of high-performance computations using floating-point or interval arithmetic Nathalie

695 views • 52 slides

Lecture 3 Floating Point Representations 1 Floating-point arithmetic We often incur

ECE 0142 Computer Organization Lecture 3 Floating Point Representations 1 Floating-point arithmetic We often incur floating-point programming. Floating point greatly simplifies working with large (e.g., 2 70 ) and small (e.g., 2 -17 )

638 views • 30 slides

for Optimization and Analysis of Floating-Point Computations Heiko Becker, Pavel Panchekha, Eva

Combining Tools for Optimization and Analysis of Floating-Point Computations Heiko Becker, Pavel Panchekha, Eva Darulova, Zachary Tatlock FM 2018, 17.07.2018 Floating-Point Computations Are Ubiquitous 2 Floating-Point Computations are Tricky

341 views • 18 slides

Floating-point numbers Fractional binary numbers IEEE floating-point standard Floating-point

Floating-point numbers Fractional binary numbers IEEE floating-point standard Floating-point operations and rounding Lessons for programmers Many more details we will skip (its a 58-page standard) See CSAPP 2.4 for more detail. 1

381 views • 15 slides

15-213 The course that gives CMU its Zip! Floating Point Sept 6, 2006 Topics Topics

15-213 The course that gives CMU its Zip! Floating Point Sept 6, 2006 Topics Topics IEEE Floating Point Standard Rounding Floating Point Operations Mathematical properties class03.ppt 15-213, F06 Floating Point

1.03k views • 34 slides

Floating point Today ! IEEE Floating Point Standard ! Rounding ! Floating Point Operations !

Floating point Today ! IEEE Floating Point Standard ! Rounding ! Floating Point Operations ! Mathematical properties Next time ! The machine model Chris Riesbeck, Fall 2011 Monday, October 3, 2011 Checkpoint Monday, October 3, 2011 IEEE

1.07k views • 28 slides

2/10/2020 Today: Floating Point Background: Fractional binary numbers IEEE floating point

2/10/2020 Today: Floating Point Background: Fractional binary numbers IEEE floating point standard: Definition Floating Point Example and properties Rounding, addition, multiplication CSci 2021: Machine Architecture and

411 views • 7 slides

9/20/2018 Today: Floating Point Background: Fractional binary numbers IEEE floating point

9/20/2018 Today: Floating Point Background: Fractional binary numbers IEEE floating point standard: Definition Floating Point Example and properties Rounding, addition, multiplication CSci 2021: Machine Architecture and

339 views • 7 slides

Tutorial: CP by Systematic Search Over Real-Number and Floating-Point Domains Michel RUEHER

Tutorial: CP by Systematic Search Over Real-Number and Floating-Point Domains Michel RUEHER University Nice Sophia-Antipolis I3S CNRS, France CP meets CAV 25 June 29 June 2012 Turun, Turkey Outline Continuous CSP M. Rueher

888 views • 78 slides

CS 356 Unit 3 IEEE 754 Floating Point Representation 3.2 Floating Point Used to represent

3.1 CS 356 Unit 3 IEEE 754 Floating Point Representation 3.2 Floating Point Used to represent very small numbers (fractions) and very large numbers Avogadros Number: +6.0247 * 10 23 Plancks Constant: +6.6254 * 10 -27

789 views • 33 slides

www. cs. utah. edu / fv pruners.github.io subcontract collaborations with students, Utah

The Grass is Really Green on the Other Side Empirical vs. Rigorous in Floating-Point Precision Analysis, Reproducibility, Resilience Ganesh Gopalakrishnan CISE School of Computing, University of Utah, Salt Lake City , UT 84112 www. cs. utah. edu

740 views • 45 slides

Machine numbers: how floating point numbers are stored? Floating-point number representation

Machine numbers: how floating point numbers are stored? Floating-point number representation What do we need to store when representing floating point numbers in a computer? ! = 1. & 2 ! Initially, different floating-point

379 views • 18 slides

Floating point How arithmetic operations mathematics involving floating point numbers

Numerical and Scientific Computing with Applications David F . Gleich CS 314, Purdue September 7, 2016 In this class: Floating point How arithmetic operations mathematics involving floating point numbers work. Next class IEEE

812 views • 11 slides

Unit 3 IEEE 754 Floating Point Representation 3.2 Floating Point Used to represent very

3.1 Unit 3 IEEE 754 Floating Point Representation 3.2 Floating Point Used to represent very small numbers (fractions) and very large numbers Avogadros Number: +6.022 10 23 Boltzmanns Constant: +1.38 10 -23 32 or

1.13k views • 38 slides

Floating Point Data CSCI 125 & 161 / ENGR 144 Floating point numbers are not exact

Floating Point Data CSCI 125 & 161 / ENGR 144 Floating point numbers are not exact Value 0.1 is very close to 1/10, but not Lecture 13 precisely equal to it 0.1 10 = 0.000110011001100110011... 2 Cannot rely on accuracy of

313 views • 3 slides

ECS 231 Computer Arithmetic 1 / 27 Outline Floating-point numbers and representations 1

ECS 231 Computer Arithmetic 1 / 27 Outline Floating-point numbers and representations 1 Floating-point arithmetic 2 Floating-point error analysis 3 Further reading 4 2 / 27 Outline Floating-point numbers and representations 1

438 views • 27 slides

Formal verification of floating-point algorithms John Harrison Intel Corporation Floating

Formal verification of floating-point algorithms 1 Formal verification of floating-point algorithms John Harrison Intel Corporation Floating point algorithm verification HOL Light Floating point numbers and formats HOL floating

636 views • 28 slides

Debugging Floating-Point Debugging Floating-Point Debugging Floating-Point Math in Racket Math

Debugging Floating-Point Debugging Floating-Point Debugging Floating-Point Math in Racket Math in Racket Math in Racket Neil Toronto RacketCon 2013 Racket Floating-Point Support Racket Floating-Point Support Racket Floating-Point Support

914 views • 88 slides

DLX Floating Point Extend MIPS Pipeline to Floating Point Operations Functional units

DLX Floating Point Extend MIPS Pipeline to Floating Point Operations Functional units more complex than simple integer ALU Require several clock cycles for a FP arithmetic operation Add: 4 cycles, Multiply: 7 cycles, Divide: 25

377 views • 22 slides

Toward a Standard Benchmark Format and Suite for Floating-Point Analysis Nasrine Damouche,

Toward a Standard Benchmark Format and Suite for Floating-Point Analysis Nasrine Damouche, Matthieu Martel, Pavel Panchekha , Chen Qiu, Alexander Sanchez-Stern, Zachary Tatlock. Incredible progress Optimization Automatic Verification STOKE

817 views • 23 slides

Computing with Floating Point Its not Dark Magic, its Science Florent de Dinechin, Ar

Computing with Floating Point Its not Dark Magic, its Science Florent de Dinechin, Ar enaire Project, ENS-Lyon Florent.de.Dinechin@ens-lyon.fr CERN seminar, January 11, 2004.99999 1 Introduction: Floating point ? 2 Floating-point as

651 views • 63 slides

Floating Point CSE 238/2038/2138: Systems Programming Instructor: Fatma CORUT ERGN Slides

Floating Point CSE 238/2038/2138: Systems Programming Instructor: Fatma CORUT ERGN Slides adapted from Bryant & OHallarons slides Today: Floating Point Background: Fractional binary numbers IEEE floating point standard:

803 views • 52 slides

7. Floating-point Numbers II p 1 , the precision (number of places), e min , the smallest

Floating-point Number Systems A Floating-point number system is defined by the four natural numbers: 2 , the base, 7. Floating-point Numbers II p 1 , the precision (number of places), e min , the smallest possible exponent, e max , the

296 views • 14 slides

Sinking Point Dynamic precision tracking for floating-point Bill Zorn Dan Grossman Zach

Sinking Point Dynamic precision tracking for floating-point Bill Zorn Dan Grossman Zach Tatlock billzorn@cs.washington.edu IEEE 754 floating-point Fast, portable, implemented in hardware Every operation is completely specified

481 views • 19 slides