sharing reproducible python environments with binder
play

Sharing Reproducible Python Environments with Binder Sarah Gibson - PowerPoint PPT Presentation

Jun 30, 2023 •148 likes •543 views

Sharing Reproducible Python Environments with Binder Sarah Gibson Pronouns: she/her @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310 What is Reproducibility? @drsarahlgibson @mybinderteam #EuroPython

  1. Sharing Reproducible Python Environments with Binder Sarah Gibson Pronouns: she/her @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  2. What is Reproducibility? @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  3. Data Same Different Same Analysis Reproducible Replicable Different Robust Generalisable Kirstie Whitaker’s talk at PyData LDN: https://youtu.be/IG3PcZ6EhiU https://the-turing-way.netlify.app/reproducible-research/overview/overview- @drsarahlgibson @mybinderteam #EuroPython definitions.html#table-of-definitions-for-reproducibility https://doi.org/10.5281/zenodo.3937310

  4. Data Same Different Repeatable Same Analysis Reproducible Replicable Different Robust Generalisable Kirstie Whitaker’s talk at PyData LDN: https://youtu.be/IG3PcZ6EhiU https://the-turing-way.netlify.app/reproducible-research/overview/overview- @drsarahlgibson @mybinderteam #EuroPython definitions.html#table-of-definitions-for-reproducibility https://doi.org/10.5281/zenodo.3937310

  5. Held to higher standards than Is not considered others Publication bias for promotion towards novel Barriers to findings reproducible Requires additional research Plead the 5th skills Takes time Support additional users Kirstie Whitaker’s talk at PyData LDN: @drsarahlgibson @mybinderteam #EuroPython https://youtu.be/IG3PcZ6EhiU https://doi.org/10.5281/zenodo.3937310

  6. Market Research @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  7. Have you ever heard…? “Oh, it worked on my computer?” @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  8. Have you ever heard…? “Oh, it worked yesterday?” @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  9. + CI “Oh, it worked on “Oh, it worked my computer?” yesterday?” @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  10. Binder @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  11. – Project Binder is a global community – The mybinder.org service allows anyone to launch a complete, interactive computing environment from their browser @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  12. gw-openscience.org/tutorials/ @drsarahlgibson @mybinderteam #EuroPython 📹 flickr.com/photos/cwkarl/24984166005 https://doi.org/10.5281/zenodo.3937310

  13. mybinder.org Courtesy of Juliette Taka @drsarahlgibson @mybinderteam #EuroPython https://twitter.com/mybinderteam/status/1082556317842264064 https://doi.org/10.5281/zenodo.3937310

  14. Courtesy of Juliette Taka @drsarahlgibson @mybinderteam #EuroPython https://twitter.com/mybinderteam/status/1082556317842264064 https://doi.org/10.5281/zenodo.3937310

  15. mybinder.org Courtesy of Juliette Taka @drsarahlgibson @mybinderteam #EuroPython https://twitter.com/mybinderteam/status/1082556317842264064 https://doi.org/10.5281/zenodo.3937310

  16. mybinder.org Courtesy of Juliette Taka @drsarahlgibson @mybinderteam #EuroPython https://twitter.com/mybinderteam/status/1082556317842264064 https://doi.org/10.5281/zenodo.3937310

  17. • Launched by Jeremy Freeman in 2015 • First Binder and Jupyter meeting in January 2017 • First half of 2017 spent redeveloping the backend into what is now BinderHub • Sept 24, 2017 – Moore Foundation Binder proposal accepted @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  18. mybinder.org @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310 https://binderhub.readthedocs.io

  19. Technology @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  20. BinderHub Clone GitHub Repo 1 @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  21. BinderHub 1 Clone GitHub Repo Build image according to 2 instructions contained within the repo @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  22. BinderHub 1 Clone GitHub Repo Build image according to 2 instructions contained within the repo Execute image 3 @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  23. BinderHub 1 Clone GitHub Repo Build image according to 2 instructions contained within the repo Allocate computational Execute image 4 3 resources @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  24. What is a JupyterHub? BinderHub JupyterHub is a way Clone GitHub Repo 1 to help your humans use your computers. With notebooks! Build Container according to 2 instructions contained within the repo Allocate computational All icons were obtained from Flaticon (https://www.flaticon.com/packs/essential-collection) Execute image 4 3 resources @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  25. BinderHub 1 Clone GitHub Repo Build image according to 2 instructions contained within the repo Allocate computational Execute image 4 3 resources @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  26. BinderHub 1 Clone GitHub Repo Build image according to Make image accessible at 2 5 instructions mybinder.org/some_url contained within the repo Allocate computational Execute image 4 3 resources @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  27. BinderHub Redirect User to mybinder.org/some_url 1 Clone GitHub Repo 6 Build image according to Make image accessible at 2 5 instructions mybinder.org/some_url contained within the repo Allocate computational Execute image 4 3 resources @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  28. Scaling up with the Federation @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  29. https://blog.jupyter.org/a-2019-retrospective-from- @drsarahlgibson @mybinderteam #EuroPython the-binder-project-57a449517362 https://doi.org/10.5281/zenodo.3937310

  30. On-prem @ Leibniz Institute for Social Sciences https://binderhub.readthedocs.io/en/latest/federation/ @drsarahlgibson @mybinderteam #EuroPython federation.html#federation-joining https://doi.org/10.5281/zenodo.3937310

  31. User Survey @drsarahlgibson @mybinderteam #EuroPython 📹 Photo by Luke Chesser on Unsplash https://doi.org/10.5281/zenodo.3937310

  32. From 346 responses @drsarahlgibson @mybinderteam #EuroPython https://github.com/sgibson91/mybinder.org-user-survey-nlp https://doi.org/10.5281/zenodo.3937310

  33. From 346 responses @drsarahlgibson @mybinderteam #EuroPython https://github.com/sgibson91/mybinder.org-user-survey-nlp https://doi.org/10.5281/zenodo.3937310

  34. If you could change one thing about Binder, what would it be? From 346 responses @drsarahlgibson @mybinderteam #EuroPython https://github.com/sgibson91/mybinder.org-user-survey-nlp https://doi.org/10.5281/zenodo.3937310

  35. Picking up speed UPSTREAM @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  36. Community Guidance We have written advice on best practices for achieving faster launch times https://discourse.jupyter.org/t/how-to-reduce-mybinder-org- @drsarahlgibson @mybinderteam #EuroPython repository-startup-time/4956 https://doi.org/10.5281/zenodo.3937310

  37. Community – Value meeting communities where they are – Diversify our skills @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

  38. Find out more and get involved – GitHub: https://github.com/jupyterhub/binderhub – Website: https://mybinder.readthedocs.io and https://mybinder.org – Discourse: https://discourse.jupyter.org/c/binder – Gitter: https://gitter.im/jupyterhub/binder – Twitter: @mybinderteam – Binder tutorial: bit.ly/zero-to-binder-python – Build a BinderHub: bit.ly/zero-to-binderhub-workshop @drsarahlgibson @mybinderteam #EuroPython https://doi.org/10.5281/zenodo.3937310

Recommend

Floating Content: Infrastructure-less Information Sharing in Urban Environments Jussi

Floating Content: Infrastructure-less Information Sharing in Urban Environments Jussi

Floating Content: Infrastructure-less Information Sharing in Urban Environments Jussi Kangasharju, Jrg Ott, Ossi Karkulahti Esa Hyyti, Jorma Virtamo, Pasi Lassila Tobias Vaegs Infrastructure-less Content Sharing Ad-hoc local social

548 views • 16 slides
Floating Content: Infrastructure-less Information Sharing in Urban Environments Jussi

Floating Content: Infrastructure-less Information Sharing in Urban Environments Jussi

Floating Content: Infrastructure-less Information Sharing in Urban Environments Jussi Kangasharju, Jrg Ott, Ossi Karkulahti Esa Hyyti, Jorma Virtamo, Pasi Lassila Infrastructure-less Content Sharing Ad-hoc local social network-style

275 views • 14 slides
Sharing Computation Results about Solid Materials Using the Crystallographic Interchange

Sharing Computation Results about Solid Materials Using the Crystallographic Interchange

Sharing Computation Results about Solid Materials Using the Crystallographic Interchange Framework (CIF) Saulius Graulis Lausanne, 2015 Vilnius University Institute of Biotechnology 1 / 21 Data Sharing and Reproducible Research . . . the

551 views • 21 slides
A talker on Docker: How containers can make your work more reproducible, accessible, and ready

A talker on Docker: How containers can make your work more reproducible, accessible, and ready

A talker on Docker: How containers can make your work more reproducible, accessible, and ready for production. Finbarr Timbers, Analyst, Darkhorse Analytics 1 Three stories. 2 One: Moving a nonlinear regression from Excel to Python. 3 One:

844 views • 63 slides
Reproducible Research with Stata using version control, GitHub, and MarkDoc E. F. Haghish Nov.

Reproducible Research with Stata using version control, GitHub, and MarkDoc E. F. Haghish Nov.

Reproducible Research with Stata Reproducible Research with Stata using version control, GitHub, and MarkDoc E. F. Haghish Nov. 17th, 2016 Reproducible Research with Stata Reproducible Analysis Overview Definition Figure 1: Reproducible

1.25k views • 42 slides
Mayfly Reproducible Research in Minutes Reproducible Research is

Mayfly Reproducible Research in Minutes Reproducible Research is

Mayfly Reproducible Research in Minutes Reproducible Research is the new paradigm Step 1: Configure Environment And more graphics should be interac@ve

329 views • 5 slides
Binder-Grade Bumping and High Binder Content to Improve Performance of RAP-RAS Mixtures Erdem

Binder-Grade Bumping and High Binder Content to Improve Performance of RAP-RAS Mixtures Erdem

Binder-Grade Bumping and High Binder Content to Improve Performance of RAP-RAS Mixtures Erdem Coleri Shashwath Sreedhar, Sogol Haddadi, Matthew Haynes, and Sunny Lewis Other contribut Other butor ors TAC members: Larry Ilg ODOT

712 views • 34 slides
Reproducible installation of applications using zc.buildout Thomas Lotze Europython 2012

Reproducible installation of applications using zc.buildout Thomas Lotze Europython 2012

Reproducible installation of applications using zc.buildout Thomas Lotze Europython 2012 tl@gocept.com July 5, Florence, Italy Outline Overview: Scope 1 Sketch: Simple example of a buildout 2 Close-up: How zc.buildout installs Python code

1.85k views • 150 slides
Long Lasting Asphalt Binder Systems and Evolving Binder Specifications Shane Underwood, Ph.D.

Long Lasting Asphalt Binder Systems and Evolving Binder Specifications Shane Underwood, Ph.D.

transportationstudies.asu.edu Long Lasting Asphalt Binder Systems and Evolving Binder Specifications Shane Underwood, Ph.D. Assistant Professor, School of Sustainable Engineering and the Built Environment Co-Director, The National Center of

311 views • 27 slides
Conducting Reproducible Research with Umbrella: Tracking, Creating, and Preserving Execution

Conducting Reproducible Research with Umbrella: Tracking, Creating, and Preserving Execution

Conducting Reproducible Research with Umbrella: Tracking, Creating, and Preserving Execution Environments Haiyan Meng, Alexander Vyushkov, Matthias Wolf, Anna Woodard and Douglas Thain University of Notre Dame Notre Dame, Indiana, USA October

521 views • 22 slides
Regulatory Binder By: Sam Payn Regulatory Binder Goals To learn about regulatory binders.

Regulatory Binder By: Sam Payn Regulatory Binder Goals To learn about regulatory binders.

Regulatory Binder By: Sam Payn Regulatory Binder Goals To learn about regulatory binders. To learn about Essential documents for the regulatory binder Put together a regulatory binder Purpose The purpose of the Regulatory Binder is

187 views • 14 slides
Python Tidbits Python created by that guy ---> Python is named after Monty Pythons

Python Tidbits Python created by that guy ---> Python is named after Monty Pythons

Python Tidbits Python created by that guy ---> Python is named after Monty Pythons Flying Circus 1991 Python 0.9.0 Released 2008 Python 2.6 / 3.0rc2 Current Python 2.7.1 / 3.2 *7 th most popular language

753 views • 37 slides
CS1520 Recitation: VirtualENV Jeongmin Lee What is it Virtualenv is a tool to create isolated

CS1520 Recitation: VirtualENV Jeongmin Lee What is it Virtualenv is a tool to create isolated

CS1520 Recitation: VirtualENV Jeongmin Lee What is it Virtualenv is a tool to create isolated Python environments What is it Virtualenv is a tool to create isolated Python environments environments : version, dependencies, packages

400 views • 15 slides
Strategic Discovery and Sharing of Vulnerabilities in Competitive Environments Arman Khouzani,

Strategic Discovery and Sharing of Vulnerabilities in Competitive Environments Arman Khouzani,

Strategic Discovery and Sharing of Vulnerabilities in Competitive Environments Arman Khouzani, Viet Pham, Carlos Cid Information Security Group Royal Holloway University of London arman.khouzani@rhul.ac.uk , viet.pham.2010@live.rhul.ac.uk ,

277 views • 13 slides
Reproducible research in practice ifgi Institute for Geoinformatics University of Mnster

Reproducible research in practice ifgi Institute for Geoinformatics University of Mnster

Reproducible research in practice ifgi Institute for Geoinformatics University of Mnster Edzer Pebesma Reproducible Research Workshop, UZH, Sep 13-14, 2016 1 / 23 Overview 1. Who am I? 2. What is reproducible research? What is

465 views • 25 slides
Everything Goes Through The Binder A Hack in Three Acts Act I Know Your Droid Act II

Everything Goes Through The Binder A Hack in Three Acts Act I Know Your Droid Act II

MAN IN THE BINDER: HE WHO CONTROLS IPC, CONTROLS THE DROID Everything Goes Through The Binder A Hack in Three Acts Act I Know Your Droid Act II Atuack Your Droid Act III Prepare Your Droid Meet The Cast The Authors Nitay

1.16k views • 61 slides
What is a Regulatory Binder? Paperwork required to keep updated on studies where patients are

What is a Regulatory Binder? Paperwork required to keep updated on studies where patients are

Regulatory Binder: 1.26.15 Sara L. Douglas, PhD, RN Amy R. Lipson, PhD Information in this Presentation Is Up-to-Date as of 8.18.17 What is a Regulatory Binder? Paperwork required to keep updated on studies where patients are being consented

343 views • 16 slides
1 Parallelism in Python The Problem with Shared State Python provides two mechanisms for

1 Parallelism in Python The Problem with Shared State Python provides two mechanisms for

Python Example of a MapReduce Application The mapper and reducer are both self contained Python programs Read from standard input and write to standard output ! Mapper Tell Unix: this is Python #!/usr/bin/env python3 The emit function

464 views • 3 slides
ECE 20875 Python for Data Science Milind Kulkarni and Chris Brinton Data Structures coding in

ECE 20875 Python for Data Science Milind Kulkarni and Chris Brinton Data Structures coding in

ECE 20875 Python for Data Science Milind Kulkarni and Chris Brinton Data Structures coding in python Standard Integrated Development Environments (IDEs) IDLE: Pythons own, basic IDE PyCharm: Code completion, unit tests,

372 views • 10 slides
SPM and Data Sharing Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College

SPM and Data Sharing Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College

SPM and Data Sharing Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London Brainhack Warwick, 3 rd March 2017 Reproducible Research An article about computational science in a scientific publication is not the

590 views • 32 slides
I N N O V A T I O N W O R L D W I D E CARDBOARD ECO BINDER A NEW CONCEPT OF

I N N O V A T I O N W O R L D W I D E CARDBOARD ECO BINDER A NEW CONCEPT OF

I N N O V A T I O N W O R L D W I D E CARDBOARD ECO BINDER A NEW CONCEPT OF BINDING SHEETS ENVIRONMENTALLY FRIENDLY, COST EFFECTIVE AND INNOVATIVE USE AN ALTERNATIVE TO TRADITIONAL METAL OF PLASTIC COIL BINDERS. The patent

283 views • 7 slides
Getting Started with Python The Python Interpreter A piece of software that executes

Getting Started with Python The Python Interpreter A piece of software that executes

Object-Oriented Programming in Python Goldwasser and Letscher Chapter 2 Getting Started with Python The Python Interpreter A piece of software that executes commands for the Python language Start the interpreter by typing python at a

862 views • 27 slides
Field Validation Database for Binder Testing Procedures Recommended by NCHRP 9-10 Wilfung

Field Validation Database for Binder Testing Procedures Recommended by NCHRP 9-10 Wilfung

Field Validation Database for Binder Testing Procedures Recommended by NCHRP 9-10 Wilfung Martono H.U.Bahia University of Wisconsin-Madison ETG Meeting Fall 2003 Las Vegas, NV Background ! Need for Field Validation of ! Binder repeated

743 views • 23 slides
Reproducible research in practice M ADAGASCAR software package Sergey Fomel Jackson School of

Reproducible research in practice M ADAGASCAR software package Sergey Fomel Jackson School of

Reproducible Research M ADAGASCAR Project Reproducible research in practice M ADAGASCAR software package Sergey Fomel Jackson School of Geosciences The University of Texas at Austin July 1, 2010 S. Fomel SciPy 2010 Reproducible Research M

431 views • 16 slides

More recommend