SOM approach methods: Expert evaluation questionnaire formats - PowerPoint PPT Presentation

Mar 18, 2024 •183 likes •278 views

SOM approach methods: Expert evaluation questionnaire formats Prepared by ACTION WP6 (SYKE and HELCOM) Liisa Saikkonen liisa.saikkonen@ymparisto.fi HELCOM EN ESA 3 2019 How to carry out expert evaluations? 1. Present survey formats

SOM approach – methods: Expert evaluation questionnaire formats Prepared by ACTION WP6 (SYKE and HELCOM) Liisa Saikkonen liisa.saikkonen@ymparisto.fi HELCOM EN ESA 3 2019
How to carry out expert evaluations? 1. Present survey formats that we have come up with: - activity-pressure contributions to assess how much different activities contribute to different pressures - Measure group pressure reduction from activities to assess the effect that measures have on pressures caused by different activities These will be further linked to pressure targets and state to calculate the sufficiency of measures (forthcoming). 2. How to carry out expert evaluations in practice? 2
Geographic scale for activity-pressure contributions:sub-basins 1. North: Bothnian Sea, The Quark, Bothnian Bay 2. Åland Sea including Archipelago Sea Coastal waters 3. Northeast: Gulf of Riga, Gulf of Finland 4. Central: North Baltic Proper, Western Gotland Basin 5. South: Eastern Gotland Basin, Gdansk Basin, Bornholm Basin, Arkona Basin 6. Southwest: Kattegat, Great Belt, The Sound, Kiel Bay, Bay of Mecklenburg Activity-pressure contributions are the same for all sub-sub-basins within one sub-basin! 3
Activity-pressure contribution 4
Measure group % -effect on pressure from activity: Options A and B - probability scales 5
Measure group % -effect on pressure from activity: Option C - probability scale with dynamic bins First ask what is - most likely pressure reduction % (M) - lowest possible pressure reduction % (L) - highest possible pressure reduction % (H) Let’s say the expert answers M=6.5%, L=0% and H=15% Then create probability scale based on these… 6
Measure group % -effect on pressure from activity: Option C – probability scale with dynamic bins 7
How to carry out expert evaluations in practice? ● web surveys, consensus vote, or some other practice? ● Should we set priors based on existing data and models? How? ● Supporting data/model results to support expert evaluation? ● How to collect data/model results from Action WPs and SOM groups to support the expert elicitations? ● Guidance? ● All comments, insights and recommendations are appreciated! 8
9

Recommend

ICS 667 Advanced HCI Design Methods 09. Empirical Evaluation Dan Suthers Spring 2005 Methods

ICS 667 Advanced HCI Design Methods 09. Empirical Evaluation Dan Suthers Spring 2005 Methods Continued Analytic Evaluation From expert or theory driven Models, Metrics, Heuristics Empirical Evaluation (Testing)

742 views • 27 slides

SunyoungKim,PhD Todays agenda Evaluation Expert evaluation o Cognitive

Human-Computer Interaction 22. Evaluating User Interface: Expert Evaluation SunyoungKim,PhD Todays agenda Evaluation Expert evaluation o Cognitive Walkthrough o Heuristic Evaluation Design process (Koberg & Bagnall) Why

865 views • 54 slides

Questionnaire Design Research Methods. Questionnaire Design 1 1 Objectives To understand:

Questionnaire Design Research Methods. Questionnaire Design 1 1 Objectives To understand: Objectives of questionnaires Advantages and disadvantages Design of questionnaires Type of questions used Common problems and

1.03k views • 99 slides

SIG ECI Questionnaire for ECI Questionnaire Questionnaire for Early Career Investigators ready

COST ACTION CA15137 MC meeting, Podgorica, 7 - 8 March 2019 SIG ECI Questionnaire for ECI Questionnaire Questionnaire for Early Career Investigators ready Draws from interviews of SIG ECI Stphani e and Karolina: first draft

721 views • 6 slides

Econometric Methods of Program Evaluation Manuel Arellano CEMFI February 2015 I. Structural and

Econometric Methods of Program Evaluation Manuel Arellano CEMFI February 2015 I. Structural and treatment effect approaches The classic approach to quantitative policy evaluation in economics is the structural approach . Its goals are to

990 views • 98 slides

Networking A novel approach to research presentations for networks: an evaluation of Visual

Primary Health Care Research and Development 2001; 2 : 205207 Networking A novel approach to research presentations for networks: an evaluation of Visual Presentation with Expert Review (ViPER) Michael Moore Three Swans Surgery, Salisbury,

164 views • 3 slides

Good practices in CITI-VAL - Results of the questionnaire - Based research Content I.

Good practices in CITI-VAL - Results of the questionnaire - Based research Content I. Introduction 1. the project 2. the questionnaire aspects, goals, basics II. Evaluation 1. facts basic information: country-wise, number of

1.3k views • 22 slides

ICS 667 Advanced HCI Design Methods 08. Intro to Evaluation Analytic Evaluation Dan Suthers

ICS 667 Advanced HCI Design Methods 08. Intro to Evaluation Analytic Evaluation Dan Suthers Spring 2005 Outline Introduction to Evaluation Types of Evaluation etc. Usability Specifications Analytic Methods Metrics and

519 views • 21 slides

Where are we now? A report from the MetBioNet Amino Acid questionnaire Claire Hart Sheffield

Where are we now? A report from the MetBioNet Amino Acid questionnaire Claire Hart Sheffield Childrens Hospital Overview Aim of questionnaire was to look at current practice amongst labs analysing amino acids What methods and protocols

690 views • 29 slides

How to Take Expert Possible Faults and . . . Uncertainty into Account: What Is the Cost of . . .

Need for Expert Estimates Expert Estimates . . . Traditional Approach . . . Analysis of the . . . How to Take Expert Possible Faults and . . . Uncertainty into Account: What Is the Cost of . . . Combining The Costs: . . . Economic Approach

234 views • 19 slides

Conceptual / Background Questionnaire (Students Questionnaire) CAMBODIA OVERVIEWS Country

10 13 September, 2018, Penang, Malaysia Capacity development workshop Conceptualization, Measurement and Use of Contextual Data Knowledge and Experience Sharing by Cambodia Conceptual / Background Questionnaire (Students Questionnaire)

226 views • 18 slides

Approach to lung opacities This is hard! You will not be an expert today Approach

10/9/2019 Algorithmic Approach to Lung Opacities Brett M. Elicker, MD University of California, San Francisco Approach to lung opacities This is hard! You will not be an expert today Approach Practice Think like a

446 views • 29 slides

Approach to lung opacities This is hard! You will not be an expert today Approach

10/12/2018 Algorithmic Approach to Lung Opacities Brett M. Elicker, MD University of California, San Francisco Approach to lung opacities This is hard! You will not be an expert today Approach Practice Think like a

424 views • 38 slides

HGBs approach to physician engagement and retention State Medical Board Questionnaire

HGBs approach to physician engagement and retention State Medical Board Questionnaire Impact on Patients Medical errors 2 Excessive referrals, 3 imaging, medications 4 Decreased patient satisfaction 5 2. Kwah et al., 2016.

279 views • 24 slides

Participatory Approach to Evaluation: Democratizing Evaluation and Embodying Social Inclusion

Participatory Approach to Evaluation: Democratizing Evaluation and Embodying Social Inclusion CESBC Webinar October 10, 2019 MONA LEE, JANICE DUDDY, PAUL KERBER Poll: Have you ever used a participatory evaluation approach? No

573 views • 30 slides

Setting expectations Economic Evaluation Not possible to be an expert in economic in

10/9/17 Incorporating Setting expectations Economic Evaluation Not possible to be an expert in economic in Clinical & evaluation in one hour However, you will Translation Research 1) Understand the major types of economic

476 views • 8 slides

How Does Questionnaire Design Affect Party ID? Kyley McGeeney Senior Director of Survey Methods

How Does Questionnaire Design Affect Party ID? Kyley McGeeney Senior Director of Survey Methods Jennifer Miller-Gonzalez, Haley Tran PRIVILEGED AND CONFIDENTIAL 1 Background What were looking at and why Background Introduction Lots of

598 views • 15 slides

Application of Multi-criteria Decision Analysis Methods to Comparative Evaluation of Nuclear

Application of Multi-criteria Decision Analysis Methods to Comparative Evaluation of Nuclear Energy System/ Scenario Options: KIND approach and KIND evaluation tool Presented by Vladimir KUZNETSOV (IAEA, NENP/INPRO) Multi-Criteria Decision

2.81k views • 44 slides

Sharing information to improve evaluation Choosing evaluation methods to suit the complex

Sharing information to improve evaluation Choosing evaluation methods to suit the complex ecologies of the particular intervention and evaluation How the BetterEvaluation platform can support appropriate evaluation design Patricia Rogers -

839 views • 39 slides

Comparative study between expert and non expert biomedical writings: their morphology and

Introduction Material and Methods Results and Discussion Conclusion and Perspectives Comparative study between expert and non expert biomedical writings: their morphology and semantics Jolanta Chmielik 1 , Natalia Grabar 1 , 2 1 INSERM UMRS

521 views • 18 slides

SENSORY EVALUATION .. Basics of Sensory evaluation, Tools, Techniques, Methods and

SENSORY EVALUATION .. Basics of Sensory evaluation, Tools, Techniques, Methods and Interpretation 1 SENSORY EVALUATION Sensory evaluation is a scientific discipline that analyses and measures human responses to the composition and

758 views • 39 slides

Introduction to Prospector Tao Zhang (zt@wpi.edu) 1 CS538 Expert System 2/14/2002 An ES in

Introduction to Prospector Tao Zhang (zt@wpi.edu) 1 CS538 Expert System 2/14/2002 An ES in the Geology Domain ! Prospect Evaluation ! Regional Resource Evaluation ! Drilling-site Selection ! Training 2 CS538 Expert System 2/14/2002

723 views • 17 slides

UNECE Level Crossing Expert Group Enforcement Sub-group Informal Document No. 7 (Enforcement)

UNECE Level Crossing Expert Group Enforcement Sub-group Informal Document No. 7 (Enforcement) - Update Fifth meeting of the expert group Geneva, June 15 th and 16 th 2015 1 12 member states responded to the second detailed questionnaire.

315 views • 13 slides

the completeness and data quality from birth registration in Latin America United Nations Expert

United Nations Expert Group Meeting on evaluation of vital statistics data from civil registration Lessons learned with the use of demographic methods and multiple sources of data to evaluate the completeness and data quality from birth

570 views • 29 slides