Towards statistically solid thinking about validation - PowerPoint PPT Presentation

Sep 23, 2023 •128 likes •296 views

Towards statistically solid thinking about validation Rick.Donnelly@wsp.com | WSP | 6 May 2020 Traditional practice 2 Top five criteria (n=9) 3 Three revelations Rethinking validation: 1. Differentiate by count type 2. Trimming outliers

Towards statistically solid thinking about validation Rick.Donnelly@wsp.com | WSP | 6 May 2020
Traditional practice 2
Top five criteria (n=9) 3
Three revelations Rethinking validation: 1. Differentiate by count type 2. Trimming outliers 3. Using meta-networks 4
Not all counts are created equal 5
Recent outcome 6
Potential error in counts Implications for counts: Assumptions: • Data are normally distribution • Distribution has mean μ and standard deviation σ • Observations are independent of one another 7
Alternative view 8
Some traditional stats Root mean squared error: Percent root mean squared error: 9
Outlier effects on RMSE and percent RMSE 10
Optimal counts? 11
Meta-networks 1. Include only freeways, expressways, major arterials 2. Collapse freeway interchanges to single point 3. Meta-nodes: where these arcs intersect 4. Meta-links: single bidirectional arc between meta-nodes 5. One count per meta-link → independent observations by definition 6. Validate and visualize at the meta-network level 12
Forecasting errors 13
In perspective... 14
Telecommuting trends over time 15
Questions? 16

Recommend

!"#$!#!%& Critical thinking Validation = critical assessment How good is my

!"#$!#!%& EMBO Course on SAS, EMBL-HH, 2 November 2014 Applied common sense The why, what and how of validation Gerard J. Kleywegt Protein Data Bank in Europe (pdbe.org) EMBL-EBI, Cambridge, UK Validation according to the dictionary

407 views • 19 slides

Statistically-Significant Correlations 11 Oct, 2014 0F 2014 NNN4 Statistically-Significant

Statistically-Significant Correlations 11 Oct, 2014 0F 2014 NNN4 Statistically-Significant Correlations 1 0F 2014 NNN4 Statistically-Significant Correlations 2 Statistically-Significant Exact Solutions Correlations For N random pairs

511 views • 16 slides

A model of solid-liquid separation of mining slurries: experimental validation and scale-up M.

A model of solid-liquid separation of mining slurries: experimental validation and scale-up M. Larenas & P. Garrido Centro de Investigacin JRI mlarenas@jri.cl, pgarrido@jri.cl www.ci-jri.cl Contents Context The model Experimental

802 views • 22 slides

On Statistically Secure Obfuscation with Approximate Correctness Zvika Brakerski 1 Christina

1 On Statistically Secure Obfuscation with Approximate Correctness Zvika Brakerski 1 Christina Brzuska 2 Nils Fleischhacker 3 1 Weizmann Institute of Science 2 Technical University Hamburg 3 Saarland University August 15, 2016 2 Statistically

1.12k views • 46 slides

Solid results and excellent free cash flow Next generation thinking | Sustainable delivery

2020 Q2 & HY Results Solid results and excellent free cash flow Next generation thinking | Sustainable delivery Audiocast, 28 July 2020 Peter Oosterveer (CEO) & Jurgen Pullens (Director IR) FIRST HALF YEAR RESULTS 2020 Disclaimer

581 views • 20 slides

Form Validation 1 CS380 What is form validation? 2 validation: ensuring that form's values

Form Validation 1 CS380 What is form validation? 2 validation: ensuring that form's values are correct some types of validation: preventing blank values (email address) ensuring the type of values integer, real number,

284 views • 24 slides

Data Mining II Model Validation Heiko Paulheim Why Model Validation? We have seen so far

Data Mining II Model Validation Heiko Paulheim Why Model Validation? We have seen so far Various metrics (e.g., accuracy, F-measure, RMSE, ) Evaluation protocol setups Split Validation Cross Validation Special

1.04k views • 55 slides

*There was a statistically significant increase for all four measures [p<0.001] Brookfield S.

*There was a statistically significant increase for all four measures [p<0.001] Brookfield S. Understanding and Facilitating Adult Learning: A Comprehensive Analysis of Principles and Effective Practices. San Francisco: Jossey-Bass; 1986. Kaufman

444 views • 19 slides

Chapter 5 Analysis: Four Level for Validation Vis/Visual Analytics, Chap 5 Validation 1 CGGM

Chapter 5 Analysis: Four Level for Validation Vis/Visual Analytics, Chap 5 Validation 1 CGGM Lab., CS Dept., NCTU Jung Hong Chuang Contents Why Validate? Validation Approaches Domain Why is Validation Abstraction

724 views • 47 slides

SALT 20 was statistically significant from placebo for the 8 and 12 mg BID cohorts in alopecia

Abstract: American Academy of Dermatology Annual Meeting 2020 New CTP-543 (Oral JAK1/2 Inhibitor) Phase 2 Analyses: SALT 20 was statistically significant from placebo for the 8 and 12 mg BID cohorts in alopecia areata trial James Cassella, PhD;

318 views • 16 slides

Capital Quality Validation Webinar Sept. 17, 2020 Agenda Validation Overview

Capital Quality Validation Webinar Sept. 17, 2020 Agenda Validation Overview Validation Timeline Authorized Representative Validation Process How to Log In to QuickBase How to Reset Your Password How to

451 views • 43 slides

ECSEL JU IMPACT OF FUNDING TOOLS BERT DE COLVENAER THINKING TOGETHER THINKING TOGETHER

ECSEL JU IMPACT OF FUNDING TOOLS BERT DE COLVENAER THINKING TOGETHER THINKING TOGETHER THINKING TOGETHER THINKING TOGETHER WORKING TOGETHER 3Ccar CAMMI DENSE ENLIGHT iFEST ME3GAS PARSIMO RobustSENSE SYSMODEL 3DAM CESAR DESERVE

738 views • 11 slides

Explaining Cortical Adaptation with a Statistically Optimized Normalization Mo del Martin

Explaining Cortical Adaptation with a Statistically Optimized Normalization Mo del Martin W ain wrigh t Eero Simoncelli Vision Sciences Cen ter for Neural Science Harv ard Univ ersit y Couran t Institute New Y ork

390 views • 15 slides

Solid Texture Synthesis Solid Texture Synthesis Solid Texture Synthesis from 2D Exemplars from

Solid Textures Solid Textures Solid Texture Synthesis Solid Texture Synthesis Solid Texture Synthesis from 2D Exemplars from 2D Exemplars from 2D Exemplars Johannes Kopf, University of Konstanz Chi-Wing Fu, Hong Kong Sc & Tech Daniel

268 views • 10 slides

Occams Razor Sampling Bias : generate the data carefuly Data Snooping : handle the data

recap: Validation and Cross Validation Validation Cross Validation D ( N ) D 1 D 2 D N D train Learning From Data D ( N K ) g 1 g 2 g N Lecture 14 ( x 1 , y 1 ) ( x 2 , y 2 ) ( x N , y N ) Three Learning Principles D

486 views • 15 slides

AngularJS & Bootstrap Form Validation HTML default validation Browsers have built-in

AngularJS & Bootstrap Form Validation HTML default validation Browsers have built-in HTML validation These work when the type attribute is given to an input element We might want better validation than is provided by the web

328 views • 13 slides

Module 4 19/05/2015 2 Agenda 1. What is validation? 2. Three-part empathy 3. What is

VALIDATION SKILLS Module 4 19/05/2015 2 Agenda 1. What is validation? 2. Three-part empathy 3. What is involved? 4. Why, when and how to use validation 3 What is validation? Validation = saying something People with BPD are much

265 views • 8 slides

Verification and Validation Steven Zeil February 13, 2013 Verification and Validation

Verification and Validation Verification and Validation Steven Zeil February 13, 2013 Verification and Validation Outline The Process 1 Non-Testing V&V 2 Code Review Mathematically-based verification Static analysis tools

790 views • 55 slides

VALIDATION The goal of validation is to judge the quality of the soft- ware from the users

VALIDATION The goal of validation is to judge the quality of the soft- ware from the users point of view; e.g., reliability. The goal of all validation techniques is: to reveal failures, to localize the faults that caused the

281 views • 14 slides

LaGov LaGov Version 2.2 Updated: 12/17/08 Visit our website for Blueprint Presentations,

Inventory and Warehouse Management Inventory and Warehouse Management Inventory and Warehouse Management Validation Session Validation Session Validation Session LOG- -IM/WM IM/WM- -Validation Validation LOG LOG-IM/WM-Validation January

1.59k views • 146 slides

ALL THINGS Lindy Strong DNA & OUR THINKING DNA & Our Thinking The following section

RESTORATION OF ALL THINGS Lindy Strong DNA & OUR THINKING DNA & Our Thinking The following section has several quotes directly for this book It also contains a 21 day brain detox plan DNA & Our Thinking To quote Caroline

1.4k views • 106 slides

FY20 Solid FY 20 Solid Was Waste te & Re & Recy cycl clin ing g Ser Servi vices

1 Bo Boar ard d of of Cou ounty nty Com ommissioners missioners FY FY20 20 Bu Budget et Work orkshop shop Au Augus ust t 27 27, 20 , 2019 9 Ro Room om 430, , 12:3 :30PM PM FY20 Solid FY 20 Solid Was Waste te &

303 views • 13 slides

SoLid Recent results from the SM1 run Antonin Vacheret for the SoLid collaboration AAP 2015

SoLid Recent results from the SM1 run Antonin Vacheret for the SoLid collaboration AAP 2015 Arlington, Virginia, USA Outline The SoLid experiment & technology New results from the first SoLid module summary and outlook 2 The

508 views • 27 slides

Workshop on process validation General concepts on process validation Kowid Ho Scope /

Workshop on process validation General concepts on process validation Kowid Ho Scope / background Process evaluation/validation of biotechnology derived proteins used as active substance in the manufacture of medicinal products (i.e.

346 views • 16 slides