discovery environment
play

Discovery Environment Extensible Data Science workbench and - PowerPoint PPT Presentation

Aug 06, 2023 •155 likes •335 views

Discovery Environment Extensible Data Science workbench and data-centric collaboration platform powered by iRODS CyVerse Discovery Environment Development Team University of Arizona Agenda Discovery Environment (DE) Overview Overview

  1. Discovery Environment Extensible Data Science workbench and data-centric collaboration platform powered by iRODS CyVerse Discovery Environment Development Team University of Arizona

  2. Agenda • Discovery Environment (DE) Overview • Overview • Features • Technology Choices • Terrain API • Overview • Available Documentation • Brief Demonstration • Visual Interactive Computing Environment (VICE) • Overview • Architecture • Demonstration

  3. Motivation • • • • • •

  4. Requirements • Scalable • Extensible • Low barrier of entry • High productivity

  5. Overview - Usage Statistics

  6. Data Management • CyVerse Data Store • Share data sets • Search all data that is accessible • Automatically detect format and type of data in files • Third party and built-in data visualization tools • Genome browsers (Ensembl, UCSC, JBrowse, etc) with byte-range service • Tabular data view • Metadata management, tags and comments

  7. Tools and Apps • Graphical user interface to apps • Apps can target several different platforms • Add your own tools and apps • Apps can be chained together in a pipeline • GPU support for VICE • More than 500 apps with documentation and example data sets • Almost 300 distinct Docker images

  8. Analyses • What’s an analysis? • Control resource allocation (CPU, RAM, Disk) • Output files are uploaded to the CyVerse Data Store • Parameters are recorded • You’ll be notified when an analysis completes • Batch processing

  10. Terrain - Goals • Avoid the monolith trap • Scalability • Extensibility • Customization

  11. Terrain - Documentation • Avoid the monolith trap • https://de.cyverse.org/terrain/docs • Interactive console • Dynamic documentation • Work in progress • https://cyverse-de.github.io/api • Ignore the authentication instructions • Mostly complete • Documentation for some endpoints is outdated

  12. Terrain Demonstration Documentation, Console, Command Line

  13. • Work with software and data interactively • Visualize • Experiment • Discover

  15. Demonstration Discovery Environment Inception

  16. Future • Integrate 3rd Party storage providers • BYOC • Improved UX • Singularity support • 3rd party install

Recommend

Discovery of novel human intestinal maltase i nhibitors on WISDOM environment and in vitro

Discovery of novel human intestinal maltase i nhibitors on WISDOM environment and in vitro

Discovery of novel human intestinal maltase i nhibitors on WISDOM environment and in vitro confirmation Hwa-Ja Ryu, Hanh Thi Thanh Nguyen, Sehoon Lee, Soon wook Hwang, Ana Lucia Dacosta, Vincent Breton, Doman Kim Phases of a pharmaceutical

333 views • 22 slides
Galaxy & Discovery CARPET TILES Galaxy and Discovery carpet tiles 1 New carpet tiles

Galaxy & Discovery CARPET TILES Galaxy and Discovery carpet tiles 1 New carpet tiles

Galaxy & Discovery CARPET TILES Galaxy and Discovery carpet tiles 1 New carpet tiles collections Inspiration While thinking about business environment, we are always exploring new dimensions of the existing elements, with the goal to

572 views • 26 slides
Share Virtual Discovery Environment in Linked Data (SHARE-VDE) Short Summary Michele Casalini

Share Virtual Discovery Environment in Linked Data (SHARE-VDE) Short Summary Michele Casalini

Share Virtual Discovery Environment in Linked Data (SHARE-VDE) Short Summary Michele Casalini SWIB18 What is SHARE-VDE? SHARE-VDE is a library-driven initiative to establish an effective working environment for the use of linked data by

123 views • 9 slides
Cyverse Discovery Environment: UNCs Implementation of the Community Edition 228 DAVIS LIBRARY,

Cyverse Discovery Environment: UNCs Implementation of the Community Edition 228 DAVIS LIBRARY,

Cyverse Discovery Environment: UNCs Implementation of the Community Edition 228 DAVIS LIBRARY, CB# 3355 UNIVERSITY OF NORTH CAROLINA AT CHAPEL HILL Don Sizemore, Mike Conway, Tony Edgin CHAPEL HILL, NC 27599-3355 WWW.ODUM.UNC.EDU

702 views • 13 slides
Watson Discovery Spring 2020 Discovery pipeline Using NLU, document conversion, and UI tools

Watson Discovery Spring 2020 Discovery pipeline Using NLU, document conversion, and UI tools

Watson Discovery Spring 2020 Discovery pipeline Using NLU, document conversion, and UI tools Watson Discovery use cases The need to search thousands of product reviews at once: Create a Discovery collection and build a UI to query the

657 views • 9 slides
Working Together on Data Science Data-Driven Discovery Initiative @ Moore Foundation Chris

Working Together on Data Science Data-Driven Discovery Initiative @ Moore Foundation Chris

Working Together on Data Science Data-Driven Discovery Initiative @ Moore Foundation Chris Mentzel, Program Director Who We Are Science Patient Care Environment Bay Area Marine Data-Driven TMT EPiQS Microbes Discovery Practices

348 views • 12 slides
From Search to Discovery in our Future Library From Search to Discovery W e see a spectrum of

From Search to Discovery in our Future Library From Search to Discovery W e see a spectrum of

From Search to Discovery in our Future Library From Search to Discovery W e see a spectrum of di ff erence between Search & Discovery, Search being more targeted and specific and Discovery being more open and vague. This slide also

650 views • 53 slides
Share the joy of discovery. Fostering Curiosity Joy of discovery Inquisitiveness

Share the joy of discovery. Fostering Curiosity Joy of discovery Inquisitiveness

Share the joy of discovery. Fostering Curiosity Joy of discovery Inquisitiveness Promoting Innovation Risk-taking Continuously raise the bar Empowerment through inclusivity Access for everyone Welcoming

532 views • 15 slides
Home Learning Event NSS Discovery: National benchmarking February 2020 What is NSS Discovery?

Home Learning Event NSS Discovery: National benchmarking February 2020 What is NSS Discovery?

Hospital at Home Learning Event NSS Discovery: National benchmarking February 2020 What is NSS Discovery? NSS Discovery is a management information system that provides approved users with access to a range of comparative health

579 views • 8 slides
Value-Driven Development with Continuous Discovery Introductions Prabhat Sinha Hello

Value-Driven Development with Continuous Discovery Introductions Prabhat Sinha Hello

Value-Driven Development with Continuous Discovery Introductions Prabhat Sinha Hello Vishnu Vijayan Padmanabhan Nice to meet you Jordan Ryan Agenda Why Discovery? Discovery Workshops Shortcomings of Discovery Workshops Agile

785 views • 56 slides
RNA Search and Whirlwind tour of ncRNA search & discovery Motif Discovery RNA motif

RNA Search and Whirlwind tour of ncRNA search & discovery Motif Discovery RNA motif

Outline RNA Search and Whirlwind tour of ncRNA search & discovery Motif Discovery RNA motif description (Covariance Model Review) Algorithms for searching Rigorous & heuristic filtering Motif discovery Lecture

809 views • 27 slides
Discovery & Monetisation Tom Greenaway Google @tcmg But fjrst Can someone please

Discovery & Monetisation Tom Greenaway Google @tcmg But fjrst Can someone please

Discovery & Monetisation Tom Greenaway Google @tcmg But fjrst Can someone please take notes? Why Discovery & Monetisation? Discovery Discovery Existing Efgorus Schema.org: https://schema.org/VideoGame Properuies: actor,

160 views • 13 slides
UN Environment Program UN Environment Program UN Environment Program UN Environment Program UN

UN Environment Program UN Environment Program UN Environment Program UN Environment Program UN

UN Environment Program UN Environment Program UN Environment Program UN Environment Program UN Environment Program I show and tell data stories. Census microdata 1950-2015 91 million rows The Guardian I make data tangible and relatable .

846 views • 43 slides
Im Impact of f Discovery ry Populist sentiment against Standard Oil was particularly strong

Im Impact of f Discovery ry Populist sentiment against Standard Oil was particularly strong

Im Impact of f Discovery ry Populist sentiment against Standard Oil was particularly strong at the time of the Spindletop discovery and the mega-corporation could not move in on the discovery due to state of Texas anti-trust laws. This

496 views • 4 slides
Higgs discovery and BSM Mihoko M. Nojiri 12 11 12 Higgs discovery at the

Higgs discovery and BSM Mihoko M. Nojiri 12 11 12 Higgs discovery at the

Higgs discovery and BSM Mihoko M. Nojiri 12 11 12 Higgs discovery at the LHC Higgs boson: The Last missing particle of the SM particles Probably starting point of the Beyond the stard model why we think

437 views • 31 slides
DOCTRINE OF CHRISTIAN DISCOVERY Taking on the Doctrine of Discovery Conference August

DOCTRINE OF CHRISTIAN DISCOVERY Taking on the Doctrine of Discovery Conference August

DOCTRINE OF CHRISTIAN DISCOVERY Taking on the Doctrine of Discovery Conference August 19, 2018 Joe Heath General Counsel, Onondaga Nation Tree of Peace by Oren Lyons Think back: a vanishing point of reference: 1768

600 views • 24 slides
UNESCO Discovery Centre reference image of education space UNESCO Discovery Centre Discovery

UNESCO Discovery Centre reference image of education space UNESCO Discovery Centre Discovery

UNESCO Discovery Centre reference image of education space UNESCO Discovery Centre Discovery Centre - Concept Design UNESCO Discovery Centre Discovery Centre - Concept Design UNESCO Discovery Centre Business Plan to cater for 55k-60k

363 views • 22 slides
E-Discovery Challenges In Healthcare Objectives To Identify and Discuss: E-Discovery? What

E-Discovery Challenges In Healthcare Objectives To Identify and Discuss: E-Discovery? What

E-Discovery Challenges In Healthcare Objectives To Identify and Discuss: E-Discovery? What is it? Are Healthcare Entities Ready? Unique Challenges to Healthcare 2 E-Discovery What is it? Lots of Definitions Electronic

218 views • 7 slides
FLSA Collective Action Discovery Strategies Discovery Tactics Before and After Conditional

FLSA Collective Action Discovery Strategies Discovery Tactics Before and After Conditional

Presenting a live 90 minute webinar with interactive Q&A FLSA Collective Action Discovery Strategies Discovery Tactics Before and After Conditional Certification of the Opt In Class WEDNES DAY, NOVEMBER 2, 2011 1pm Eastern |

676 views • 64 slides
FLSA Collective Action Discovery Strategies Discovery Tactics Before and After Conditional

FLSA Collective Action Discovery Strategies Discovery Tactics Before and After Conditional

Presenting a live 90 minute webinar with interactive Q&A FLSA Collective Action Discovery Strategies Discovery Tactics Before and After Conditional Certification of the Opt In Class WEDNES DAY, JANUARY 19, 2011 1pm Eastern |

1.1k views • 75 slides
Incremental Graph-Based Discovery of Relational Concepts Ana Cecilia Tenorio, Eduardo F. Morales

Incremental Graph-Based Discovery of Relational Concepts Ana Cecilia Tenorio, Eduardo F. Morales

Incremental Graph-Based Discovery of Relational Concepts Ana Cecilia Tenorio, Eduardo F. Morales Instituto Nacional de Astrofsica, ptica y Electrnica (INAOE) Mxico Overview Explore the environment and gather information from

397 views • 23 slides
Foundations of Causal Discovery Frederick Eberhardt KDD Causality Workshop 2016 Causal Discovery

Foundations of Causal Discovery Frederick Eberhardt KDD Causality Workshop 2016 Causal Discovery

Foundations of Causal Discovery Frederick Eberhardt KDD Causality Workshop 2016 Causal Discovery data sample x y z w samples 2 Causal Discovery assumptions, e.g. causal Markov causal faithfulness functional form etc.

1.66k views • 144 slides
Discovery Logic / NIH Discovery Logic, Inc. Established in 2001 SBA 8(a) Certified in

Discovery Logic / NIH Discovery Logic, Inc. Established in 2001 SBA 8(a) Certified in

Discovery Logic / NIH Discovery Logic, Inc. Established in 2001 SBA 8(a) Certified in 2003 Woman-Owned Business Small Disadvantaged Business (SDB) GSA Schedule Unlimited ID/IQ Prime Contractor to HHS and

324 views • 10 slides
Motif Discovery Upper Bound An Upper Bound on the Hardness of Exact Matrix Based Motif Discovery

Motif Discovery Upper Bound An Upper Bound on the Hardness of Exact Matrix Based Motif Discovery

Motif Discovery Upper Bound An Upper Bound on the Hardness of Exact Matrix Based Motif Discovery Paul Horton & Wataru Fujibuchi Computational Biology Research Center Tokyo, Japan p. 1 Talk Outline Motivate Motif Discovery

438 views • 28 slides

More recommend