pipelining quality
play

Pipelining quality best practices, lessons learned and tools for - PowerPoint PPT Presentation

Jun 05, 2023 •131 likes •297 views

Pipelining quality best practices, lessons learned and tools for continuous delivery processes 25. Oktober 2017, Markus Tiede Basler Versicherungen AG Wir machen Sie sicherer. Wir machen Sie sicherer. @MarkusTiede Wir machen Sie sicherer.

  1. Pipelining quality best practices, lessons learned and tools for continuous delivery processes 25. Oktober 2017, Markus Tiede – Basler Versicherungen AG Wir machen Sie sicherer. Wir machen Sie sicherer.

  2. @MarkusTiede Wir machen Sie sicherer.

  3. Bird's eye view http://www.datacenterjournal.com/wp-content/uploads/2016/11/devops111116.png 25.10.17 www.baloise.ch 3

  4. 01 Galileo „ OOTB approach n large-scale insurance enterprise project n 4 products CM Portal n 8 Scrum teams for "customization" n ± 75 people n POs, SMs, Architects, Developer, Tester, Business Analysts n 1-2 team(s) per product n cross-functional team(s): integration, release www.baloise.ch 25.10.17 4

  5. 02 Overall process „ "classic" SCRUM n two week sprints (sync) n but: harmonized releases n decoupled from sprint(s) n everything digital n knowledge / documentation base n deeply integrated / coupled n application lifecycle n CRs, User Stories, Bugs, … n SourceCodeManagement n Continuous Integration www.baloise.ch 25.10.17 5

  6. 03 A journey to production „ knowledge and automation is key: Confluence Dashboard www.baloise.ch 25.10.17 6

  7. 04 Jenkins pipelines ( scripted and declarative ) „ orchestration of environment(s) – CI as code (Job DSL) LB / SSO PC BC CM Portal o1 o1 o1 o1 o2 o2 o2 o2 coo coo coo o3 www.baloise.ch 25.10.17 7

  8. 05 Agile testing pyramid (per coordinate) „ goal: fail fast / fail early www.baloise.ch 25.10.17 8

  9. LB / SSO PC BC CM Portal 06 Coordinates (stack : env) o1 o1 o1 o1 „ allow (massive) parallism + bubbling o2 o2 o2 o2 coo coo coo o3 TEST INT ACC PROD Project+0 TEST INT ACC Project+1 TEST INT ACC Project+2 TEST INT Project+3 12 x 12 = 144 individual nodes www.baloise.ch 25.10.17 9

  10. TEST INT ACC PROD Project+0 07 Releases TEST INT ACC Project+1 „ different flavours TEST INT ACC Project+2 TEST INT n MAJ.MIN.MIC.FIX Project+3 n HOTFIX ( e.g. 4.0.1.2 ) n 8 – 12h (full regression) n MICRO n < 1 week n MINOR n < 1 month n MAJOR n < 1 year www.baloise.ch 25.10.17 10

  11. 08 Change and data flow „ multi-master branches and tags per repo 2.3.2.0.rc1 2.4.0.0.rc2 2.4.0.0.rc1 www.baloise.ch 25.10.17 11

  12. 09 Change and data flow „ "Golden master / copy"-approach Project+0 TEST INT ACC PROD Project+1 TEST INT ACC Project+2 TEST INT ACC Project+3 TEST INT www.baloise.ch 25.10.17 12

  13. 10 Tools „ inspection, analysis, monitoring n low level – log mining n high level – "pure path" analysis n custom level – knowledge graph www.baloise.ch 25.10.17 13

  14. 11 2do „ aka – pain points n Environment as code n Puppet, Anisble & Co n Code Review per Feature Branch n automated and manual n (Test) Data Management n all or nothing – x TB of data n Highly interconnected data n Legacy systems / processes (Batches) www.baloise.ch 25.10.17 14

  15. 12 Summary „ take away n 100% digital – linked resources; knowledge base n simultanuous release (train) vs. agile shippable artifact n Multi-(Stack)-(Jenkins)-Pipelines n Agile Test-Pyramid n SCM „tag“ driven deployments n Data Management: Golden Data / Master approach n Build your own knowledge graph: neo4j www.baloise.ch 25.10.17 15

  16. https://github.com/baloise Making you safer.

Recommend

Pipelining Instruction Pipelining is the use of pipelining to allow more than one instruction to

Pipelining Instruction Pipelining is the use of pipelining to allow more than one instruction to

Pipelining Instruction Pipelining is the use of pipelining to allow more than one instruction to be in some stage of execution at the same time. Ferranti ATLAS (1963): Pipelining reduced the average time per instruction by

1.85k views • 147 slides
Lecture 2 (I ): Lecture 2 (I ): Pipelining &amp; Retiming Pipelining &amp; Retiming

Lecture 2 (I ): Lecture 2 (I ): Pipelining &amp; Retiming Pipelining &amp; Retiming

Lecture 2 (I ): Lecture 2 (I ): Pipelining &amp; Retiming Pipelining &amp; Retiming Hsie-Chia Chang E-mail : hcchang@mail.nctu.edu.tw Fall 2006 Outline Outline Pipelining of FI R Digital filters Data-Broadcast Structures

455 views • 28 slides
Computer Systems Lecture 15 Pipelining and Hazards CS 230 - Spring 2020 3-1 Pipelining CS

Computer Systems Lecture 15 Pipelining and Hazards CS 230 - Spring 2020 3-1 Pipelining CS

CS 230 Introduction to Computers and Computer Systems Lecture 15 Pipelining and Hazards CS 230 - Spring 2020 3-1 Pipelining CS 230 - Spring 2020 3-2 ISA Requirements for Pipelining Constant length instructions (fetch, decode)

628 views • 38 slides
Pipelining 1 Today Quiz Introduction to pipelining 2 Pipelining L L a a Logic

Pipelining 1 Today Quiz Introduction to pipelining 2 Pipelining L L a a Logic

Pipelining 1 Today Quiz Introduction to pipelining 2 Pipelining L L a a Logic (10ns) t t c c 10ns L L a a Logic (10ns) t t c c 20ns L L a a Logic (10ns) t t c c 30ns Whats the latency for one unit of

706 views • 27 slides
EE 457 Unit 6a Basic Pipelining Techniques 2 Pipelining Introduction Consider a drink

EE 457 Unit 6a Basic Pipelining Techniques 2 Pipelining Introduction Consider a drink

1 EE 457 Unit 6a Basic Pipelining Techniques 2 Pipelining Introduction Consider a drink bottling plant Filling the bottle = 3 sec. Placing the cap = 3 sec. Labeling = 3 sec. Would you want Machine 1 = Does all three (9

776 views • 45 slides
Overview General Principles of Pipelining Goal Computer Architecture: Pipelining

Overview General Principles of Pipelining Goal Computer Architecture: Pipelining

Overview General Principles of Pipelining Goal Computer Architecture: Pipelining Difficulties Creating a Pipelined Y86-64 Processor CSci 2021: Machine Architecture and Organization Rearranging SEQ March 25th-27th, 2020 Inserting

558 views • 6 slides
Pipelining is Hazardous! Hazards are situations where pipelining does not work as elegantly as

Pipelining is Hazardous! Hazards are situations where pipelining does not work as elegantly as

Pipelining is Hazardous! Hazards are situations where pipelining does not work as elegantly as we would like Three kinds Structural hazards -- we have run out of a hardware resource. Data hazards -- an input is not available on

356 views • 22 slides
Pipelining Raul Queiroz Feitosa Parts of these slides are from the support material provided by

Pipelining Raul Queiroz Feitosa Parts of these slides are from the support material provided by

Pipelining Raul Queiroz Feitosa Parts of these slides are from the support material provided by W. Stallings Objective To present the Pipelining concept, its limitations and the techniques for performance optimization 2 Pipelining Outline

736 views • 30 slides
Overview Basics of Pipelining Pipeline Hazards Appendix A Pipeline Implementation

Overview Basics of Pipelining Pipeline Hazards Appendix A Pipeline Implementation

Overview Basics of Pipelining Pipeline Hazards Appendix A Pipeline Implementation p p Pipelining + Exceptions Pipelining: Basic and Intermediate Pipeline to handle Multicycle Operations Concepts 1 2 Unpipelined

507 views • 14 slides
Pipelining PIPELINING what Seymour Cray taught the laundry industry How to correctly pipeline

Pipelining PIPELINING what Seymour Cray taught the laundry industry How to correctly pipeline

Pipelining PIPELINING what Seymour Cray taught the laundry industry How to correctly pipeline circuits Ive got 3 months Worth of laundry Funny, considering that hes only got To do tonight one outfit Acknowledgement: The

566 views • 7 slides
Appendix A Pipelining: Basic and Intermediate C Concepts t 1 Overview Basics of

Appendix A Pipelining: Basic and Intermediate C Concepts t 1 Overview Basics of

Appendix A Pipelining: Basic and Intermediate C Concepts t 1 Overview Basics of Pipelining Pipeline Hazards Pipeline Implementation Pipelining + Exceptions Pipeline to handle Multicycle Operations p y p 2 1

509 views • 40 slides
1 What Limits Performance? Stalls (Data Hazards) Data hazards Code Instruction depends on

1 What Limits Performance? Stalls (Data Hazards) Data hazards Code Instruction depends on

Instruction Scheduling Background: Pipelining Basics Last time Idea Register allocation Begin executing an instruction before completing the previous one Today Without Pipelining With Pipelining Instruction scheduling The

389 views • 7 slides
Unit 5: Pipelining Load-use stalling Pipelined multi-cycle operations Control hazards

Unit 5: Pipelining Load-use stalling Pipelined multi-cycle operations Control hazards

This Unit: Pipelining App App App Single-cycle &amp; multi-cycle datapaths System software Latency vs throughput &amp; performance Basic pipelining CIS 501: Computer Architecture Mem CPU I/O Data hazards Bypassing Unit

522 views • 24 slides
Computer Architecture Summer 2020 Pipelining Tyler Bletsch Duke University Includes material

Computer Architecture Summer 2020 Pipelining Tyler Bletsch Duke University Includes material

ECE/CS 250 Computer Architecture Summer 2020 Pipelining Tyler Bletsch Duke University Includes material adapted from Dan Sorin (Duke) and Amir Roth (Penn). This Unit: Pipelining Basic Pipelining Application Pipeline control OS

821 views • 68 slides
Basic Pipelining Wrap-up Exploiting ILP (from Slide Set 20) Chapter 6 and beyond 1 2

Basic Pipelining Wrap-up Exploiting ILP (from Slide Set 20) Chapter 6 and beyond 1 2

Slide Set #21: Basic Pipelining Wrap-up Exploiting ILP (from Slide Set 20) Chapter 6 and beyond 1 2 Pipelining Big Picture Remember the single-cycle implementation Improve performance by increasing instruction throughput

392 views • 5 slides
Chapter Six 1 2004 Morgan Kaufmann Publishers Pipelining The laundry analogy for

Chapter Six 1 2004 Morgan Kaufmann Publishers Pipelining The laundry analogy for

Chapter Six 1 2004 Morgan Kaufmann Publishers Pipelining The laundry analogy for pipelining: 2 2004 Morgan Kaufmann Publishers Pipelining Improve performance by increasing instruction throughput Single cycle 2400 ps

621 views • 41 slides
Chapter 3: Pipelining and Parallel Processing Keshab K. Parhi Outline Introduction

Chapter 3: Pipelining and Parallel Processing Keshab K. Parhi Outline Introduction

Chapter 3: Pipelining and Parallel Processing Keshab K. Parhi Outline Introduction Pipelining of FIR Digital Filters Parallel Processing Pipelining and Parallel Processing for Low Power Pipelining for Lower Power

1.09k views • 32 slides
Lecture 10: Processor design pipelining Overlapping the execution of instructions

Lecture 10: Processor design pipelining Overlapping the execution of instructions

Lecture 10: Processor design pipelining Overlapping the execution of instructions Pipeline hazards Different types How to remove them Inf2C Computer Systems - 2011-2012 1 Pipelining Classic case: make all instructions

337 views • 15 slides
Appendix A Appendix A Pipelining: Basic and Intermediate Concepts p 1 Overview Basics of

Appendix A Appendix A Pipelining: Basic and Intermediate Concepts p 1 Overview Basics of

Appendix A Appendix A Pipelining: Basic and Intermediate Concepts p 1 Overview Basics of Pipelining B i f Pi li i Pipeline Hazards Pipeline Implementation Pipelining + Exceptions Pipelining + Exceptions Pipeline

1.39k views • 80 slides
lecture 15 MIPS data path and control 3 Multicycle model: Pipelining March 7, 2016

lecture 15 MIPS data path and control 3 Multicycle model: Pipelining March 7, 2016

lecture 15 MIPS data path and control 3 Multicycle model: Pipelining March 7, 2016 Pipelining - factory assembly line (Henry Ford - 100 years ago) - car wash - cafeteria - ..... Main idea: achieve efficiency by minimizing

364 views • 35 slides
Power-Optimal Pipelining in Deep Submicron Technology Seongmoo Heo and Krste Asanovi Computer

Power-Optimal Pipelining in Deep Submicron Technology Seongmoo Heo and Krste Asanovi Computer

ISLPED 2004 8/10/2004 Power-Optimal Pipelining in Deep Submicron Technology Seongmoo Heo and Krste Asanovi Computer Architecture Group, MIT CSAIL Traditional Pipelining Goal: Maximum performance Vdd Clk-Q Setup Propagation Delay Clk

615 views • 27 slides
Pipelining: Its Natural! Laundry Example Ann, Brian, Cathy, Dave each have one load of

Pipelining: Its Natural! Laundry Example Ann, Brian, Cathy, Dave each have one load of

Pipelining: Its Natural! Laundry Example Ann, Brian, Cathy, Dave each have one load of clothes to wash, dry, and fold Washer takes 30 minutes, Dryer takes 40 minutes, Folder takes 20 minutes Pipelining doesnt help latency of 6

603 views • 25 slides
CIS 371 Computer Organization and Design Unit 5: Pipelining Based on slides by Prof. Amir Roth

CIS 371 Computer Organization and Design Unit 5: Pipelining Based on slides by Prof. Amir Roth

CIS 371 Computer Organization and Design Unit 5: Pipelining Based on slides by Prof. Amir Roth &amp; Prof. Milo Martin CIS 371: Comp. Org. | Prof. Milo Martin | Pipelining 1 This Unit: Pipelining Processor performance App App App

1.45k views • 109 slides
Retiming &amp; Pipelining over Global Retiming &amp; Pipelining over Global Interconnects

Retiming &amp; Pipelining over Global Retiming &amp; Pipelining over Global Interconnects

Retiming &amp; Pipelining over Global Retiming &amp; Pipelining over Global Interconnects Interconnects Jason Cong Jason Cong Computer Science Department Computer Science Department University of California, Los Angeles University of

750 views • 36 slides

More recommend