a new era of large scale replication and collaboration
play

A new era of large-scale replication and collaboration? - PowerPoint PPT Presentation

Jan 06, 2023 •311 likes •567 views

A new era of large-scale replication and collaboration? http://www.slideshare.net/holcombea Alex.Holcombe@sydney.edu.au @ceptional Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php Where science is not

  1. A new era of large-scale replication and collaboration? http://www.slideshare.net/holcombea Alex.Holcombe@sydney.edu.au @ceptional Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  2. Where science is not self-correcting False positive zones - researcher degrees of freedom high ( p- hacking ) - victory declared whenever null hypothesis is rejected, where size of effect, plausibility considered unimportant. The newer the domain, the more cutting-edge the techn Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  3. #AcademicNoir "This one's Psych Science. 1998. Put your money on ‘will replicate’?” "What, you think I was born yesterday?” "Fine," muttered the bookie. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  4. Well, Mr. Hacker, your luck is about to run out. Down at the journals, they’re running a new game. They call it ‘preregistration’. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  5. https://osf.io/tvyxz/wiki/home/ 5 Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  6. https://osf.io/tvyxz/wiki/home/ 6 Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  7. https://osf.io/tvyxz/wiki/home/ Here’s how you Here, check our can replicate our 100% P-hacking Free numbers. result. 7 Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  8. "This one's Psych Science. 1998. Put your money on ‘will replicate’?” "What, you think I was born yesterday?” "Fine," muttered the bookie. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  9. Reproducibility workshop 26 Nov 9 http://bizlab.unsw.edu.au/website/conference-2015.php

  10. Failed to replicate m y result? Have you considered the unknown m oderators? Reproducibility workshop 26 Nov 10 http://bizlab.unsw.edu.au/website/conference-2015.php

  11. Any one of us alone, he’ll say we messed up. But if we all run the replication together, we can show the big guy we’re right. Reproducibility workshop 26 Nov 11 http://bizlab.unsw.edu.au/website/conference-2015.php

  12. Meta-analysis forest plot Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  13. Meta-analysis forest You m essed plot up! Failed to replicate m y result? Have you considered the unknown m oderators? Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  14. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  15. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  16. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  17. A new era of large-scale replication and collaboration? Preregistration Can we do this bottom-up Large-scale replication Open data Open protocol and code Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  18. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  19. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  20. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  21. s at Perspectives on Psychological Science, open scienc Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  22. “No data, no paper. And make that the raw data, alright? I don’t want a bunch of p-hacked p-values. stinkin’ summaries. ” Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  23. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  24. Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

  25. How open science wins Tech work at grassroots Cultural change • Altmetrics • Early adopters • Streamlining • Researcher training repositories • Advocacy, lobbying • Software for reproducible research • Journals strengthen sharing policies Research funders ramp up requirement that code, data be posted CC-BY Alex Holcombe Reproducibility workshop 26 Nov http://bizlab.unsw.edu.au/website/conference-2015.php

Recommend

Large-scale emission from FR I jets Pol Bordas with the collaboration of V. Bosch-Ramon & M.

Large-scale emission from FR I jets Pol Bordas with the collaboration of V. Bosch-Ramon & M.

Large-scale emission from FR I jets Pol Bordas with the collaboration of V. Bosch-Ramon & M. Perucho Barcelona June 2011, mircoles 29 de junio de 2011 Large-scale emission in FR I jets Pol Bordas, HEPRO III OUTLINE The FR I/II

424 views • 27 slides
communication and collaboration models Look at several levels minutiae to large scale

communication and collaboration models Look at several levels minutiae to large scale

CSCW Issues and Theory All com puter system s have group im pact chapter 14 not just groupware Ignoring this leads to the failure of system s communication and collaboration models Look at several levels minutiae to large scale

217 views • 7 slides
FINANCING LARGE SCALE SOLAR Large Scale Solar Conference - Sydney Gloria Chan Director, Large

FINANCING LARGE SCALE SOLAR Large Scale Solar Conference - Sydney Gloria Chan Director, Large

FINANCING LARGE SCALE SOLAR Large Scale Solar Conference - Sydney Gloria Chan Director, Large Scale Solar Lead April 2017 CONTENTS 1. Introduction to CEFC 2. Investment trends 3. The future of large scale solar 4. Pathway to sustainable

664 views • 21 slides
Collaboration at Scale: The Innovation Competency 13-Feb-2019 Collaboration at Scale Designed

Collaboration at Scale: The Innovation Competency 13-Feb-2019 Collaboration at Scale Designed

Collaboration at Scale: The Innovation Competency 13-Feb-2019 Collaboration at Scale Designed for Scrum-centric organizations with more than 10 Scrum teams, the Collaboration at Scale webinar series provides focused, outcome-driven solutions

636 views • 28 slides
Analysis of Large-Scale Scalar Data Using Hixels Joshua A. Levine 2 , in collaboration with D.

Analysis of Large-Scale Scalar Data Using Hixels Joshua A. Levine 2 , in collaboration with D.

LDAV 2011 Analysis of Large-Scale Scalar Data Using Hixels Joshua A. Levine 2 , in collaboration with D. Thompson 1 , J.C. Bennett 1 , P.-T. Bremer 3 , A. Gyulassy 1 , P.P. Pbay 4 , V. Pascucci 1 1 2 3 4 HPC Has Lead to Increases in Both Data

449 views • 32 slides
Collaboration with ISPs for Large-Scale Deployment of eduroam in Japan Hideaki Goto NII /

Collaboration with ISPs for Large-Scale Deployment of eduroam in Japan Hideaki Goto NII /

31st APAN meeting Feb. 21-25, 2011, Hong Kong Collaboration with ISPs for Large-Scale Deployment of eduroam in Japan Hideaki Goto NII / Tohoku University, Japan 1 eduroam JP National eduroam operation and promotion 19 institutions

165 views • 12 slides
Large-Scale Self-Supervised Robotic Learning Chelsea Finn In collaboration with Sergey Levine

Large-Scale Self-Supervised Robotic Learning Chelsea Finn In collaboration with Sergey Levine

Large-Scale Self-Supervised Robotic Learning Chelsea Finn In collaboration with Sergey Levine and Ian Goodfellow Generalization in Reinforcement Learning to object instances to tasks and environments Oh et al. 16 Pinto & Gupta 16

601 views • 25 slides
INCORPORATING LARGE-SCALE CITIZEN INCORPORATING LARGE-SCALE CITIZEN DELIBERATION INTO

INCORPORATING LARGE-SCALE CITIZEN INCORPORATING LARGE-SCALE CITIZEN DELIBERATION INTO

INCORPORATING LARGE-SCALE CITIZEN INCORPORATING LARGE-SCALE CITIZEN DELIBERATION INTO ENVIRONMENTAL CONFLICT RESOLUTION America Speaks presentation to the 2008 ECR Conference Table Introductions Please form groups of 4-5 and give: Your name

848 views • 41 slides
Large-Scale Survey Interviewing Following Large Scale Survey Interviewing Following the 2008

Large-Scale Survey Interviewing Following Large Scale Survey Interviewing Following the 2008

Large-Scale Survey Interviewing Following Large Scale Survey Interviewing Following the 2008 WenChuan Earthquake Zhang Huafeng and Jon Pedersen International Blaise Users Conference (IBUC) Baltimore, USA , 1 Introduction Two household

712 views • 22 slides
On relativistic effects and large scale cosmology In collaboration with Enea Di Dio (INAF,

On relativistic effects and large scale cosmology In collaboration with Enea Di Dio (INAF,

On relativistic effects and large scale cosmology In collaboration with Enea Di Dio (INAF, Trieste) Matteo Viel (SISSA, Trieste) Carlo Baccigalupi (SISSA, Trieste) Ruth Durrer (Universit de Genve) Eleonora Villa (SISSA, Trieste)

681 views • 38 slides
Asynchronous Replication and Bayou Asynchronous Replication and Bayou Asynchronous Replication

Asynchronous Replication and Bayou Asynchronous Replication and Bayou Asynchronous Replication

Asynchronous Replication and Bayou Asynchronous Replication and Bayou Asynchronous Replication Asynchronous Replication Idea: build available/scalable information services with read-any-write-any replication and a weak consistency model. - no

738 views • 48 slides
GDR ADN, 2-4 mai 2012 Replication in eukaryotic genomes Specific features of eukaryotic

GDR ADN, 2-4 mai 2012 Replication in eukaryotic genomes Specific features of eukaryotic

GDR ADN, 2-4 mai 2012 Replication in eukaryotic genomes Specific features of eukaryotic replication: - multiple replication origins - large variability in the timing of activation and in the efficiency of a given origin O1 O2 3 5 3

130 views • 11 slides
Large-scale production of graphene: Introduction Large-scale production of graphene: what is

Large-scale production of graphene: Introduction Large-scale production of graphene: what is

Large-scale production of graphene: Introduction Large-scale production of graphene: what is graphene? Graphene is a truly 2D system made of Carbon atoms arranged in an honeycomb hexagonal lattice Zero-gap semiconductor with a low-energy linear

268 views • 6 slides
Smart Synchronization on Social Collaboration Jason J. Jung ( )

Smart Synchronization on Social Collaboration Jason J. Jung ( )

Smart Synchronization on Social Collaboration Jason J. Jung ( ) http://intelligent.pe.kr/ j2jung@gmail.com ETRI@Korea Jan 15th, 2016 Background Large scale organization (a number of users & a large amount of data)

892 views • 51 slides
in Tashkent CSEP 545 Transaction Processing Sameh Elnikety Replication for Performance

in Tashkent CSEP 545 Transaction Processing Sameh Elnikety Replication for Performance

Database Replication in Tashkent CSEP 545 Transaction Processing Sameh Elnikety Replication for Performance Expensive Limited scalability 2 DB Replication is Challenging Single database system Large, persistent state Transactions

762 views • 73 slides
Ethics in Techniques for large-scale data Graham J.L. Kemp TECHNIQUES FOR LARGE-SCALE DATA

Ethics in Techniques for large-scale data Graham J.L. Kemp TECHNIQUES FOR LARGE-SCALE DATA

Ethics in Techniques for large-scale data Graham J.L. Kemp TECHNIQUES FOR LARGE-SCALE DATA Masters level course: Chalmers MPALG and MPSOF programmes (DAT345) GU Applied Data Science programme (DIT871) Learning outcomes include:

305 views • 18 slides
Large-Scale Deep Learning for Intelligent Computer Systems Jeff Dean In collaboration with many

Large-Scale Deep Learning for Intelligent Computer Systems Jeff Dean In collaboration with many

Large-Scale Deep Learning for Intelligent Computer Systems Jeff Dean In collaboration with many other people at Google Web Search and Data Mining Web Search and Data Mining Really hard without understanding Not there yet, but making

1.13k views • 97 slides
An Email Contact Protocol Experiment in a Large-Scale Survey of U.S. in a Large Scale Survey of

An Email Contact Protocol Experiment in a Large-Scale Survey of U.S. in a Large Scale Survey of

An Email Contact Protocol Experiment in a Large-Scale Survey of U.S. in a Large Scale Survey of U.S. Government Employees DC-AAPOR Summer Conference Preview/Review Bureau of Labor Statistics Conference Center Washington DC Washington, DC

1.17k views • 25 slides
Efficient Large-Scale Graph Processing on Hybrid CPU and GPU Systems A. Gharaibeh, E.

Efficient Large-Scale Graph Processing on Hybrid CPU and GPU Systems A. Gharaibeh, E.

Efficient Large-Scale Graph Processing on Hybrid CPU and GPU Systems A. Gharaibeh, E. Santos-Neto, L. Costa, M. Ripeanu. IEEE TPC, 2014 Sami (sa894) - R244: Large-scale data processing and optimization Efficient Large-Scale Graph Processing on

381 views • 25 slides
Motivation Large-scale distributed systems becoming more common multiple datacenters, cloud

Motivation Large-scale distributed systems becoming more common multiple datacenters, cloud

Census: Location-Aware Membership Management for Large-Scale Distributed Systems James Cowling Dan R. K. Ports Barbara Liskov Raluca Ada Popa Abhijeet Gaikwad* MIT CSAIL *cole Centrale Paris Motivation Large-scale distributed systems

606 views • 48 slides
Large-Scale Electronic Voting Protocols Mike Carpenter Introduction What is meant by large-scale

Large-Scale Electronic Voting Protocols Mike Carpenter Introduction What is meant by large-scale

Large-Scale Electronic Voting Protocols Mike Carpenter Introduction What is meant by large-scale electronic voting protocol: Primarily Internet-based Users voting from their own devices (such as home PC/laptop) Aimed toward actual

721 views • 21 slides
Todays Topics - Chapter 15 Slide 1 performance enhancement Replication Replication of

Todays Topics - Chapter 15 Slide 1 performance enhancement Replication Replication of

Distributed Systems Lecture 5 1 Replication 15.1 Group Communications 15.2 Fault Services 15.3 Todays Topics - Chapter 15 Slide 1 performance enhancement Replication Replication of read-only data is simple, but replication

726 views • 14 slides
Large-Scale Deep Learning with TensorFlow for Building Intelligent Systems Jeff Dean Google

Large-Scale Deep Learning with TensorFlow for Building Intelligent Systems Jeff Dean Google

Large-Scale Deep Learning with TensorFlow for Building Intelligent Systems Jeff Dean Google Brain Team g.co/brain In collaboration with many other people at Google We can now store and perform computation on large datasets, using things like

1.49k views • 127 slides
Internet Topology Generation for Large Scale BGP Simulation Jean-Michel Fourneau - Houssame

Internet Topology Generation for Large Scale BGP Simulation Jean-Michel Fourneau - Houssame

Internet Topology Generation for Large Scale BGP Simulation Jean-Michel Fourneau - Houssame Yahiaoui Outlook BGP: Border Gateway Protocol Large Scale Simulation: motivations Large Scale BGP Simulation Model Realistic Topologies

550 views • 17 slides

More recommend