Evaluation and Reproducibility of Numerical Simulations Stephan - PowerPoint PPT Presentation

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations Stephan Rave living knowledge Software Tool Seminar Münster WWU Münster WS14/15 October 15, 2014

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 2 /14 Outline ◮ Greenhorn Mistakes... ◮ Creation and Management of Simulation Datasets for the MULTIBAT project living knowledge WWU Münster ◮ Reproducibility Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 3 /14 Greenhorn Mistakes living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 3 /14 Greenhorn Mistakes ◮ Write super cool program. living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 3 /14 Greenhorn Mistakes ◮ Write super cool program. ◮ Hmm, will take a few days. living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 3 /14 Greenhorn Mistakes ◮ Write super cool program. ◮ Hmm, will take a few days. ◮ Lock laptop in office over the weekend. living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 3 /14 Greenhorn Mistakes ◮ Write super cool program. ◮ Hmm, will take a few days. ◮ Lock laptop in office over the weekend. living knowledge WWU Münster ◮ Weekend! :) Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 3 /14 Greenhorn Mistakes ◮ Write super cool program. ◮ Hmm, will take a few days. ◮ Lock laptop in office over the weekend. living knowledge WWU Münster ◮ Weekend! :) ◮ Monday morning: Error! Calculation terminated! :( Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 4 /14 Greenhorn Mistakes II living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 4 /14 Greenhorn Mistakes II ◮ Write super cool program. living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 4 /14 Greenhorn Mistakes II ◮ Write super cool program. ◮ Let’s test it first on a small grid ... living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 4 /14 Greenhorn Mistakes II ◮ Write super cool program. ◮ Let’s test it first on a small grid ... ◮ Start giant computation on office machine. living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 4 /14 Greenhorn Mistakes II ◮ Write super cool program. ◮ Let’s test it first on a small grid ... ◮ Start giant computation on office machine. living knowledge WWU Münster ◮ Weekend! :) Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 4 /14 Greenhorn Mistakes II ◮ Write super cool program. ◮ Let’s test it first on a small grid ... ◮ Start giant computation on office machine. living knowledge WWU Münster ◮ Weekend! :) ◮ Monday morning: Updates installed, calculation terminated! :( Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 5 /14 Intermezzo: Screen living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 6 /14 Greenhorn Mistakes III living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 6 /14 Greenhorn Mistakes III ◮ Write super cool program and test it. living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 6 /14 Greenhorn Mistakes III ◮ Write super cool program and test it. ◮ Start giant computation on BIGDADDY or METATRON. living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 6 /14 Greenhorn Mistakes III ◮ Write super cool program and test it. ◮ Start giant computation on BIGDADDY or METATRON. ◮ Weekend! :) (Each hour, nervously test with screen if everything is still ok.) living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 6 /14 Greenhorn Mistakes III ◮ Write super cool program and test it. ◮ Start giant computation on BIGDADDY or METATRON. ◮ Weekend! :) (Each hour, nervously test with screen if everything is still ok.) ◮ Monday morning: Cool, error really goes down! living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 6 /14 Greenhorn Mistakes III ◮ Write super cool program and test it. ◮ Start giant computation on BIGDADDY or METATRON. ◮ Weekend! :) (Each hour, nervously test with screen if everything is still ok.) ◮ Monday morning: Cool, error really goes down! living knowledge ◮ Advisor: What about the L 2 -norm? WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 6 /14 Greenhorn Mistakes III ◮ Write super cool program and test it. ◮ Start giant computation on BIGDADDY or METATRON. ◮ Weekend! :) (Each hour, nervously test with screen if everything is still ok.) ◮ Monday morning: Cool, error really goes down! living knowledge ◮ Advisor: What about the L 2 -norm? WWU Münster ◮ Days later: Yes, also in L 2 -norm! Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 6 /14 Greenhorn Mistakes III ◮ Write super cool program and test it. ◮ Start giant computation on BIGDADDY or METATRON. ◮ Weekend! :) (Each hour, nervously test with screen if everything is still ok.) ◮ Monday morning: Cool, error really goes down! living knowledge ◮ Advisor: What about the L 2 -norm? WWU Münster ◮ Days later: Yes, also in L 2 -norm! ◮ Advisor: The plot would look much nicer if it was green! Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 6 /14 Greenhorn Mistakes III ◮ Write super cool program and test it. ◮ Start giant computation on BIGDADDY or METATRON. ◮ Weekend! :) (Each hour, nervously test with screen if everything is still ok.) ◮ Monday morning: Cool, error really goes down! living knowledge ◮ Advisor: What about the L 2 -norm? WWU Münster ◮ Days later: Yes, also in L 2 -norm! ◮ Advisor: The plot would look much nicer if it was green! ◮ After deadline: Green plot. Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 7 /14 The Punchline living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 7 /14 The Punchline Separate simulation from evaluation and visualization! living knowledge WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 7 /14 The Punchline Separate simulation from evaluation and visualization! living knowledge ◮ Generate as much data as you can! WWU Münster Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 7 /14 The Punchline Separate simulation from evaluation and visualization! living knowledge ◮ Generate as much data as you can! WWU Münster ◮ But keep in mind what you want to know! Stephan Rave (stephan.rave@wwu.de)

W ESTFÄLISCHE W ILHELMS -U NIVERSITÄT M ÜNSTER Evaluation and Reproducibility of Numerical Simulations 7 /14 The Punchline Separate simulation from evaluation and visualization! living knowledge ◮ Generate as much data as you can! WWU Münster ◮ But keep in mind what you want to know! ◮ Some questions will only arise later on! Stephan Rave (stephan.rave@wwu.de)