Fu Fundamentals of Pr Programming (Py Python)
Floating-Point Operations
Ali Taheri Sharif University of Technology
Spring 2019
Floating-Point Operations Ali Taheri Sharif University of - - PowerPoint PPT Presentation
Fu Fundamentals of Pr Programming (Py Python) Floating-Point Operations Ali Taheri Sharif University of Technology Spring 2019 Outline 1. Fixed-Point Representation 2. Floating-Point Representation 3. Arithmetic Errors 4. The math
Spring 2019
2
ALI TAHERI - FUNDAMENTALS OF PROGRAMMING [PYTHON] Spring 2019
3
ALI TAHERI - FUNDAMENTALS OF PROGRAMMING [PYTHON] Spring 2019
4
ALI TAHERI - FUNDAMENTALS OF PROGRAMMING [PYTHON] Spring 2019
5
ALI TAHERI - FUNDAMENTALS OF PROGRAMMING [PYTHON] Spring 2019
0.1 + 0.1 + 0.1 == 0.3 7/5 - 1 == 2/5 1 - 1/3 == 2/3
abs(a-b) < 1e-4
6
ALI TAHERI - FUNDAMENTALS OF PROGRAMMING [PYTHON] Spring 2019
import math