Pathfinder Verification and Validation www.thunderheadeng.com - PowerPoint PPT Presentation

Dec 20, 2023 •420 likes •867 views

Pathfinder Verification and Validation www.thunderheadeng.com Quality Assurance Process Source Code Control Continuous Integration Entire system rebuilt after every change Automated Testing Tests run automatically after every

Pathfinder Verification and Validation www.thunderheadeng.com
Quality Assurance Process • Source Code Control • Continuous Integration – Entire system rebuilt after every change • Automated Testing – Tests run automatically after every build – 117 test cases in 2012 – 308 test cases in 2014 • Testing Dashboard • Automated Error Reporting – Reports categorized and scheduled weekly www.thunderheadeng.com
Source Control www.thunderheadeng.com
www.thunderheadeng.com
Automated Tests - Dashboard www.thunderheadeng.com
Verification and Validation Guide www.thunderheadeng.com
Error Handling www.thunderheadeng.com
Verification Tests • IMO • RIMEA • NIST Tech Note 1822 • SFPE Handbook www.thunderheadeng.com
Verification Tests • Locomotion • Wayfinding • Behavior www.thunderheadeng.com
How do we apply this to development? www.thunderheadeng.com
Pedestrian Acceleration Problems of Forensic Sciences 2012, vol. 91 Jakub Zębala, Piotr Ciępka, Adam Reza Institute of Forensic Research, Kraków, Poland www.thunderheadeng.com
Walking Sprinting www.thunderheadeng.com
Acceleration to Ordinary Walking, Lower Bound 1.2 1.00E+01 8.00E+00 1 6.00E+00 0.8 4.00E+00 0.6 Position Velocity 2.00E+00 Acceleration y = 0.9587x + 0.0317 Linear (Velocity) 0.4 0.00E+00 0.2 -2.00E+00 0 -4.00E+00 -0.2 0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 -0.2 -6.00E+00 www.thunderheadeng.com
Hallway Experiment D1 D2 www.thunderheadeng.com
Hallway Results D1 D2 t v a a/v t_accel Richard1 4.24 3.55 7.79 1.3 0.9 0.7 1.4 Richard2 4.25 3.63 7.88 1.3 1.0 0.8 1.2 Richard3 4.4 3.9 8.3 1.2 1.2 1.0 1.0 Jon1 3.81 3.61 7.42 1.3 3.2 2.5 0.4 Jon2 4.11 3.55 7.66 1.3 1.1 0.9 1.1 Brian1 3.45 3.35 6.8 1.4 6.8 5.0 0.2 Brian2 3.67 3.11 6.78 1.5 1.3 0.9 1.1 Brian3 3.23 3.13 6.36 1.5 7.3 5.0 0.2 Charlie1 4.2 3.74 7.94 1.2 1.3 1.1 0.9 Charlie2 4.38 3.81 8.19 1.2 1.1 0.9 1.1 Joe 3.97 3.7 7.67 1.2 2.3 1.9 0.5 Dan1 3.83 3.25 7.08 1.4 1.2 0.9 1.2 Dan2 3.82 3.07 6.89 1.5 1.0 0.7 1.5 Average 2.3 1.7 0.9 www.thunderheadeng.com
Flow vs. Acceleration www.thunderheadeng.com
Agent Acceleration • Changed default value • Exposed parameter for user input • Re-run verification problems • Update tests with new results www.thunderheadeng.com
Improving Locally-Quickest Door Choice www.thunderheadeng.com
Proposed Solution • Use actual door flowrates to estimate queue wait times www.thunderheadeng.com
Measuring Flowrate www.thunderheadeng.com
Moving Average www.thunderheadeng.com
Low-Pass Filter www.thunderheadeng.com
Low-Pass Filter www.thunderheadeng.com
Low-Pass Filter www.thunderheadeng.com
Door Choice Improvements • Use actual flowrate to calculate local queue time • Optimal flow used if no queue formed • Re-run verification problems • Update tests with new results www.thunderheadeng.com
Thank You Questions? www.thunderheadeng.com

Recommend

Verification and Validation Steven Zeil February 13, 2013 Verification and Validation

Verification and Validation Verification and Validation Steven Zeil February 13, 2013 Verification and Validation Outline The Process 1 Non-Testing V&V 2 Code Review Mathematically-based verification Static analysis tools

790 views • 55 slides

Verification & Validation Verification is getting the system right : Verification and

Verification & Validation Verification is getting the system right : Verification and Validation Does the program you built do what you designed it to do? Dr. James A. Bednar Validation is getting the right system : jbednar@inf.ed.ac.uk

331 views • 8 slides

Verification and Validation of a Verification and Validation of a Fault- -Tolerant Architectural

Verification and Validation of a Verification and Validation of a Fault- -Tolerant Architectural Abstraction Tolerant Architectural Abstraction Fault Patrick H. S. Brito - Unicamp, Brazil Rogrio de Lemos - University of Kent, UK Eliane

381 views • 21 slides

Verification Verification and and Validation Validation 1 /41 1 /41 C2 C2 Overview

C2 C2 Verification Verification and and Validation Validation 1 /41 1 /41 C2 C2 Overview Overview It is very simple to create a simulation ! It is very difficult difficult to model something to model something accurately .

736 views • 41 slides

Verification and Validation for Safety in Robots Kerstin Eder Design Automation and Verification

Verification and Validation for Safety in Robots Kerstin Eder Design Automation and Verification Trustworthy Systems Laboratory Verification and Validation for Safety in Robots, Bristol Robotics Laboratory Verification and Validation for Safety

1.29k views • 72 slides

Validation and Verification Using Spatial Logic Framework for Building Layouts By Abhinav

Validation and Verification Using Spatial Logic Framework for Building Layouts By Abhinav Fatehpuria Vineet Gupta 12/ 6/ 2005 ENPM 643 System Validation & Verification 1 Agenda Background Project Description Floor Plan

340 views • 32 slides

INDEPENDENT VERIFICATION AND VALIDATION OBJECTIVES To Define Independent Verification &

INDEPENDENT VERIFICATION AND VALIDATION OBJECTIVES To Define Independent Verification & Validation (IV&V) and its Benefits To Understand the Federal Requirements for IV&V To Provide the Federal Perspective on IV&V

489 views • 38 slides

Geant4 Physics Validation and Geant4 Physics Validation and Verification Verification Ions

Geant4 Physics Validation and Geant4 Physics Validation and Verification Verification Ions Ions Koi, Tatsumi SLAC/SCCS Koi, Tatsumi SLAC/SCCS Neutron & Ion Models High Precision neutron down to thermal energy Inventory Elastic

416 views • 31 slides

The purpose of the Presentation is to introduce the Verification Validation Reporting

The purpose of the Presentation is to introduce the Verification Validation Reporting and Tracking System (VVRTS) with a sample video demonstration. 1.1 System Overview The purpose of the Verification and Validation Reporting and

78 views • 3 slides

INDEPENDENT INTEGRATED VERIFICATION AND VALIDATION (I 2 V 2 ) INDEPENDENT VERIFICATION and

INDEPENDENT INTEGRATED VERIFICATION AND VALIDATION (I 2 V 2 ) INDEPENDENT VERIFICATION and VALIDATION (IV&V) System System Validation Requirements Test Verification Software Software Validation Test Requirements Verification

443 views • 25 slides

Tuesday 9 th April 2013 Process Validation-Enhanced Approach Continuous Process Verification

EMA Expert Workshop on Validation of Manufacturing for Biological Medicinal Products Tuesday 9 th April 2013 Process Validation-Enhanced Approach Continuous Process Verification Brendan Hughes Agenda Definition and purpose of validation

730 views • 18 slides

Pathfinder Orientation v Being an Engaged Pathfinder v Best Practices v Partnering with City of

Pathfinder Orientation v Being an Engaged Pathfinder v Best Practices v Partnering with City of Scottsdale Preserve Coordinators Being An Engaged Pathfinder : A. Commitment to Mission v Pathfinders help ensure that Preserve visitors have a safe,

853 views • 25 slides

SOFTWARE VERIFICATION AND VALIDATION BY: MITCHELL LANE TOPICS T erms and Methods

SOFTWARE VERIFICATION AND VALIDATION BY: MITCHELL LANE TOPICS T erms and Methods Historic Failures Licenses and certifjcation Warranties Ethical Evaluations Software Validation- Does the model accurately represent the

442 views • 17 slides

Chapter 10 Verification and Validation of Simulation Models Banks, Carson, Nelson & Nicol

Chapter 10 Verification and Validation of Simulation Models Banks, Carson, Nelson & Nicol Discrete-Event System Simulation Purpose & Overview The goal of the validation process is: To produce a model that represents true

518 views • 28 slides

Verification and validation of Geant4 Bertini cascade Aatos Heikkinen, Pekka Kaitaniemi Helsinki

Verification and validation of Geant4 Bertini cascade Aatos Heikkinen, Pekka Kaitaniemi Helsinki Institute of Physics P.O.B. 64, FIN-00014 University of Helsinki, FINLAND email: aatos.heikkinen@cern.ch A. Heikkinen: Verification and validation

285 views • 9 slides

INDEPENDENT VERIFICATION AND CODING VALIDATION (IV & V) FOR APR-DRG Effective September 1,

INDEPENDENT VERIFICATION AND CODING VALIDATION (IV & V) FOR APR-DRG Effective September 1, 2014 Who are we? eQHealth has a 16 year partnership with Mississippi Division of Medicaid (DOM) as the Utilization Management and Quality

575 views • 35 slides

Verification and Validation Ian Sommerville, SW Engineering, 7th/8th edition Ch 22 Why Test? 2

Verification and Validation Ian Sommerville, SW Engineering, 7th/8th edition Ch 22 Why Test? 2 Why Test? 3 Software is Buggy! On average, 1-5 errors per 1KLOC Windows 2000 35M LOC 63,000 known bugs at the time of release

823 views • 49 slides

concepts and cri riteria towards a 0-deaths strategy Validation and verification process Phd.

Road safety through FEM sim imulations: concepts and cri riteria towards a 0-deaths strategy Validation and verification process Phd. Eng. Monica Meocci September, 16 - 2019 The FEM Methods The Finite Element Method (FEM) is now regularly

505 views • 46 slides

Pathfinder Peer Exchange Webinar January 16, 2019 This webinar will be recorded. Agenda

Pathfinder Peer Exchange Webinar January 16, 2019 This webinar will be recorded. Agenda Pathfinder: National Experience Roemer Alfelor, FHWA Shawn DeVinny, NWS NWP States Experiences, Outcomes and Impacts of Pathfinder

806 views • 34 slides

From robot swarms to ethical robots: the challenges of verification and validation - part 1

From robot swarms to ethical robots: the challenges of verification and validation - part 1 Swarm Engineering Alan FT Winfield RoboCheck Winter School, Bristol Robotics Laboratories University of York http://www.brl.ac.uk 1 Dec 2015 This

578 views • 43 slides

Mark Validation System API & Alternative Rights Verification Not Another Mark Service

Mark Validation System API & Alternative Rights Verification Not Another Mark Service Fills a localised niche market Supplementary to TMCH Intended to cover the local industry Companies Unregistered Marks MVS API

473 views • 10 slides

S V V .lu software verification & validation Automated Testing of Autonomous Driving

S V V .lu software verification & validation Automated Testing of Autonomous Driving Assistance Systems Lionel Briand VVIoT, Sweden, 2018 Collaborative Research @ SnT Research in context Addresses actual needs Well-defined

945 views • 63 slides

Construction Restart Readiness Assessment Steve Cabano - Pathfinder James Cravens - Pathfinder

Construction Restart Readiness Assessment Steve Cabano - Pathfinder James Cravens - Pathfinder Mike Pappas CII 19 May 2020 CII COVID-19 Web Seminar Series Agenda Topic Introduction Industry Perspective The Construction Readiness

874 views • 54 slides

Verification and validation of the computer codes Marin Kri tof, NNEES Content of the lecture

IAEA Safety Assessment Education and Training (SAET) Programme Joint ICTP-IAEA Essential Knowledge Workshop on Deterministic Safety Assessment and Engineering Aspects Important to Safety Verification and validation of the computer codes Marin

629 views • 44 slides