Performance Evaluation for Gradual Typing Asumu Takikawa Daniel - PowerPoint PPT Presentation

Jun 14, 2023 •403 likes •829 views

Performance Evaluation for Gradual Typing Asumu Takikawa Daniel Feltey *Ben Greenman Max S. New Jan Vitek Matthias Felleisen 9 years of sound gradual typing Gradual Typing for Functional Languages, Jeremy Siek & Walid Taha. SFP '06

Performance Evaluation for Gradual Typing Asumu Takikawa Daniel Feltey *Ben Greenman Max S. New Jan Vitek Matthias Felleisen
9 years of sound gradual typing Gradual Typing for Functional Languages, Jeremy Siek & Walid Taha. SFP '06 Interlanguage Migration: From Scripts to Programs, Sam Tobin-Hochstadt & Matthias Felleisen. OOPSLA '06
9 years of sound gradual typing Micro Macro
Micro - focus on single-module programs - type system catches incompatibilities - all values implicitly type DYN
Macro - multi-module, untyped programs - eliminate a class of errors - each module fully typed/untyped
9 years of sound gradual typing SFP'06 ICFP'09 POPL'10 ML'07 ESOP'12 ICFP'14 POPL'15 ECOOP'07 ESOP'09 ECOOP'10 POPL'12 DLS'13 ECOOP'15 POPL'07 DLS'08 SAC'09 ECOOP'11 SFP'12 OOPSLA'14 OOPSLA'06 STOP'09 POPL'10 ESOP'13 ECOOP'08 OOPSLA'09 OOPSLA'12 SFP'07 POPL'08 FOOL'10 PLDI'11 ECOOP'15 Over 50 publications since 2006 http://github.com/samth/gradual-typing-bib
Performance?
Performance? 4x 10x 22x 33x
9 years of publications and nobody publishes evaluations because performance sucks
Gradual Typing ... is practical?
Gradual Typing ... is practical?
Performance? Soundness?
Types without Soundness - catch "obvious" logical errors - serve as documentation - may not be correct, or complete
Types + Soundness ! eliminate a class of errors from typed code typed
Every typed language... Rests on an untyped runtime
Option 1: Trusted Computing Base (Bogus)
Option 2: Check Everything (Safe & very slow)
Types + Soundness (revised) eliminate a class of errors from typed code identify errors at typed-untyped boundaries
Option 1: Trusted Computing Base Option 2: Check Everything
The Reality of (Macro) Gradual Typing
The Reality of (Macro) Gradual Typing
The Reality of (Macro) Gradual Typing
The Reality of (Macro) Gradual Typing
The Reality of (Macro) Gradual Typing
The Reality of (Macro) Gradual Typing
The Reality of (Macro) Gradual Typing
Recap - Gradual type systems have "bad" performance - Type soundness is imperative - Issue: typed-untyped boundaries
The Reality of (Macro) Gradual Typing
The Reality of (Macro) Gradual Typing
The Reality of (Macro) Gradual Typing ?
Proposal I. Define "boundary" II. Run the entire lattice III. Define "performant" IV. Report the % of performant variations
To be continued... If you agree , then use our framework If you disagree , then propose an alternative Bottom line: no more "footnotes" on performance!
How to Scale? - Hire a cluster - Random sampling - Offer fewer configurations - Tools to identify / exclude configs.
Gradual Typing: Promise Sound Expressive Performant
Boundaries Integer , please Here! Thanks! 2
Boundaries Integer , please Here! TYPE ERROR lol
Boundaries List of Integer , please Here! Thanks! [ 2 , 2 , 2 ]
Boundaries Function , please Use it well ... +
Reinheitsgebot 1 barrel of wine + 1 teaspoon of sewage = 1 barrel of sewage

Recommend

Gradual Information Flow Typing Tim Disney Cormac Flanagan University of California Santa Cruz

Gradual Information Flow Typing Tim Disney Cormac Flanagan University of California Santa Cruz January 29th, 2011 - STOP 2011 Combining gradual typing with information flow Gradual Information + Typing Flow = More secure software

1.1k views • 82 slides

Gradual Typing with Inference Jeremy Siek University of Colorado at Boulder joint work with

Gradual Typing with Inference Jeremy Siek University of Colorado at Boulder joint work with Manish Vachharajani Overview Motivation Background Gradual Typing Unification-based inference Exploring the Solution Space Type

1.25k views • 83 slides

Is Sound Gradual Typing Dead? Asumu Takikawa Daniel Feltey Ben Greenman Max S. New Jan Vitek

Is Sound Gradual Typing Dead? Asumu Takikawa Daniel Feltey Ben Greenman Max S. New Jan Vitek Matthias Felleisen Gradual typing thesis 1. People write untyped code 2. Static types help maintain software 3. Sound types can be added

754 views • 72 slides

The Recursive Union of Some Gradual Types Jeremy G. Siek Sam Tobin-Hochstadt Indiana

The Recursive Union of Some Gradual Types Jeremy G. Siek Sam Tobin-Hochstadt Indiana University, Bloomington 1/ 24 Gradual Typing Goal: support the entire spectrum in one language. Program Dependent Static Dynamic Logics Types Typing

382 views • 24 slides

Gradual typing is morally incorrect; were all monsters now Timothy Jones and Michael Homer

Gradual typing is morally incorrect; were all monsters now Timothy Jones and Michael Homer Victoria University of Wellington {tim,mwh}@ecs.vuw.ac.nz October 27, 2015 Introduction Meaning in the gradually typed world A type assertion

547 views • 43 slides

T Gradual typing for R Jan Vitek, Northeastern University Types enhance productivity The Iron

This is is not a type: T Gradual typing for R Jan Vitek, Northeastern University Types enhance productivity The Iron Rolling Mill by Adolf Menzel function ( x ) { var y = x ? 2 : Y if x y += ES else y += 40 return y } Types

779 views • 31 slides

A Gradual Typing Poem Sam Tobin-Hochstadt & Robby Finder 1 The Problem Write a function

A Gradual Typing Poem Sam Tobin-Hochstadt & Robby Finder 1 The Problem Write a function that accepts the specification of an infinite regular tree and turn it into a representation of the tree 2 The Problem Write a function that accepts

565 views • 37 slides

Typing and ML Typing and ML A name for a set of values and some operations which can be

Typing Typing Typing and ML Typing and ML A name for a set of values and some operations which can be performed on that set of values. CSC324 A collection of computational entities that share some common property. Winter 2007

412 views • 9 slides

Gradual Python with Colored Local Type Inference Joe Angell April 29, 2009 Joe Angell Gradual

Gradual Python with Colored Local Type Inference Joe Angell April 29, 2009 Joe Angell Gradual Python with Colored Local Type Inference Motivation Python programmers use dynamic typing Lets type check what we can, and what the programmer

303 views • 11 slides

What is a performance evaluation? Performance Management v. Performance Evaluation Evaluation

3/16/2015 Employee Performance Evaluations and Their Importance Presented by Summer Randall March 18, 2015 What is a performance evaluation? Performance Management v. Performance Evaluation Evaluation Management One time event Ongoing

175 views • 6 slides

Consistent Subtyping for All Ningning Xie Xuan Bi Bruno C. d. S. Oliveira 16 April, 2018 The

Consistent Subtyping for All Ningning Xie Xuan Bi Bruno C. d. S. Oliveira 16 April, 2018 The University of Hong Kong ESOP 2018, Thessaloniki, Greece 1 Gradual Typing 101 The key external feature of every gradual type system is the

853 views • 61 slides

How to Evaluate the Performance of Gradual Type Systems Ben Greenman Asumu Takikawa Max S. New

How to Evaluate the Performance of Gradual Type Systems Ben Greenman Asumu Takikawa Max S. New Daniel Feltey Robert Bruce Findler Jan Vitek Matthias Felleisen 1 Contribution: Our paper presents the first systematic method to measure the

701 views • 47 slides

Title goes here Tools for Performance Evaluation Timing and performance evaluation has been

Title goes here Tools for Performance Evaluation Timing and performance evaluation has been an art Experiences and Lessons Learned Resolution of the clock with a Portable Interface to Issues about cache effects Hardware Performance

594 views • 5 slides

Telematics 2 & Performance Evaluation Chapter 4 Introduction to Performance Evaluation

Telematics 2 & Performance Evaluation Chapter 4 Introduction to Performance Evaluation Telematics 2 / Performance Evaluation (WS 17/18): 04 PE Introduction 1 Overview q Goals of Performance Evaluation q Basic Notions: System and Model

317 views • 27 slides

MEKONOMEN GROUP January June 2020 August 21, 2020 1 Q2 2020 STRONG PERFORMANCE Gradual

MEKONOMEN GROUP January June 2020 August 21, 2020 1 Q2 2020 STRONG PERFORMANCE Gradual recovery from Covid-19 impact throughout the quarter Forceful actions to reduce costs and adapt operations Strong profitability through cost focus

508 views • 27 slides

Typing and ML Typing and ML Definition Program organization and documentation A name for a

Typing Typing Uses/Merits Uses/Merits Type errors Type errors Typing and ML Typing and ML Definition Program organization and documentation A name for a set of values and some operations A type error occurs when execution of

725 views • 5 slides

4. Performance Analysis of Parallel Programs 4.1 Performance Evaluation of Computer User

4. Performance Analysis of Parallel Programs 4.1 Performance Evaluation of Computer User criteria: - Small response times Computing center criteria: - High throughputs 4.1.1 Evaluation of CPU Performance 4.1.1 Evaluation of CPU Performance

478 views • 24 slides

The effectiveness of gradual learning EN S EMBLE METH ODS IN P YTH ON Romn de las Heras

The effectiveness of gradual learning EN S EMBLE METH ODS IN P YTH ON Romn de las Heras Data Scientist, SAP / Agile Solutions Collective vs gradual learning Collective Learning Gradual Learning Principle: wisdom of the crowd Principle:

461 views • 23 slides

Fararano Fararano DFAP DFAP Final Performance Final Performance Evaluation Evaluation TANGO

Fararano Fararano DFAP DFAP Final Performance Final Performance Evaluation Evaluation TANGO International Meet our Presenters John Dunlop Mission Director, USAID Madagascar Kevin Henry Team Leader, Madagascar DFAP Evaluation Independent

788 views • 40 slides

Performance Evaluation of Performance Evaluation of Phasor Measurement Systems Phasor

PNNL-SA-60867 Panel: International Experience in PMU Applications Performance Evaluation of Performance Evaluation of Phasor Measurement Systems Phasor Measurement Systems Henry Huang (PNNL), Bogdan Kasztenny (GE), Vahid Madani (PG&E), Ken

452 views • 29 slides

Model Evaluation Model Evaluation Metrics for Performance Evaluation How to evaluate the

Model Evaluation Model Evaluation Metrics for Performance Evaluation How to evaluate the performance of a model? Methods for Performance Evaluation How to obtain reliable estimates? Methods for Model Comparison How to

636 views • 36 slides

The JMT Simulator for The JMT Simulator for Performance Evaluation of Performance Evaluation of

Politecnico di Milano - DEI Milan, Italy The JMT Simulator for The JMT Simulator for Performance Evaluation of Performance Evaluation of Non-Product-Form Queueing Networks Non-Product-Form Queueing Networks Marco Bertoli, Giuliano Casale,

475 views • 32 slides

Njira DFAP Final Performance Njira DFAP Final Performance Evaluation Presentation Evaluation

Njira DFAP Final Performance Njira DFAP Final Performance Evaluation Presentation Evaluation Presentation TANGO International Meet our Presenters Lori Du Trieuille, BHA Malawi Team Leader, USAID/ BHA Steve Sibande, Food Security Monitoring

417 views • 39 slides

Performance Evaluation of Policies Performance Evaluation of Policies and Programmes Adam B.

Performance Evaluation of Policies Performance Evaluation of Policies and Programmes Adam B. Jaffe Director, Motu Economic and Public Policy Research Treasury/MBIE Seminar Treasury/MBIE Seminar 27 August 2013 Background g

446 views • 22 slides