Docker meets Python A look on the Docker SDK for Python pip - PowerPoint PPT Presentation

Agenda 1.Who am I? 2.The Docker Daemon/Service and Ways to communicate with it 3.Docker SDK for Python! a. Where and how to get it b. Code Examples 4.Ideas for Usecases a. Using Python as Container-Starting-Script … end extend it b. Get Container-Logs for further processing c. pyTest with different Python Versions 5.Wrap Up 6.Q&A accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 2

About me – Hi, my name is Jan! • 32 Years old, Not married yet, but engaged • Data Science Consultant @ accantec consulting AG • We focus on Data – BI, Data Engineering & Data Science • https://accantec.de accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 3

Your friendly house guest – The Whale! The Docker Daemon/Service: Reachable per default from within your System (localhost) ▪ Reachable per configuration from the outside ▪ accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 6

Ways to communicate with it * Docker CLI ($docker run hello-world) https://docs.docker.com/engine/reference/commandline/cli/ GUI ** ** Kitematic https://kitematic.com/ ** Docker Extension for VS Code CLI * WebGUI *** https://github.com/microsoft/vscode-docker accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 9

Ways to communicate with it * Docker CLI ($docker run hello-world) https://docs.docker.com/engine/reference/commandline/cli/ GUI ** ** Kitematic https://kitematic.com/ ** Docker Extension for VS Code CLI * WebGUI *** https://github.com/microsoft/vscode-docker *** Portainer https://www.portainer.io/ accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 10

Get the Docker SDK for Python Officially available for Python and Golang • https://docs.docker.com/develop/sdk/ pip/pip3 install docker • Package on conda-forge available too • https://anaconda.org/conda-forge/docker-py accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 14

Code Examples Taken from https://docs.docker.com/develop/sdk/examples/ * Docker CLI Docker SDK – Python $ docker run hello-world import docker client = docker.from_env() print (client.containers.run('hello-world ‘ )) $ docker pull alpine import docker client = docker.from_env() image = client.images.pull("alpine") print (image.id) * Code Examples on Website are in Python 2 Syntax … I don ´ t know why ☺ accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 15

Hint! Docker CLI Docker SDK – Python $ docker image […] import docker $ docker images client = docker.from_env() client.images .[…] $ docker container […] import docker client = docker.from_env() container = client.containers .[…] https://docker-py.readthedocs.io/en/stable/client.html https://docs.docker.com/engine/reference/commandline/container/ https://docs.docker.com/engine/reference/commandline/image/ https://docs.docker.com/engine/reference/commandline/images/ accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 16

Using Python as Container-Starting-Script https://hub.docker.com/_/postgres $ docker run – name test-db -e POSTGRES_PASSWORD=EuroPython -d postgres $ docker run --name test-db – e POSTGRES_PASSWORD=EuroPython -v /some/where/data:/var/lib/postgresql /data […….] postgres accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 18

Using Python as Container-Starting-Script import docker var1 = "..." var2 = ["...", "123"] var3 = "..." client = docker.from_env() client.containers.run('postgres', name=var1, environment=var2, mounts=var3, detach=True) accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 20

Extend it to … [...] client = docker.from_env() myContainer = client.containers.get('myTestContainer') myContainer.stop() client.containers.prune() newImage = client.images.build('path/to/Dockerfile') newImageID = newImage.id() [...] accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 21

Get Container-Logs import docker client = docker.from_env() container = client.containers.run('ubuntu', detach=True) f = open("myContainerLog", "w") for line in container.logs(stream=True): f.write(line) f.close() accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 22

Wrap Up Depending on your Task at Hand: - Python might be a better choice then e.g. bash Scripts - Docker SDK might be a better choice then „ import os “ or equivalents accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 26

Wrap Up Depending on your Task at Hand: - Python might be a better choice then e.g. bash Scripts - Docker SDK might be a better choice then „ import os “ or equivalents Hope you now have: - An (high level) Idea about the Docker SDK for Python - Some inspiration for your Day-to-Day work with Docker and Python accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 27

Wrap Up Depending on your Task at Hand: - Python might be a better choice then e.g. bash Scripts - Docker SDK might be a better choice then „ import os “ or equivalents Hope you now have: - An (high level) Idea about the Docker SDK for Python - Some inspiration for your Day-to-Day work with Docker and Python Last Hint: - Read the Docker Docs accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de | Mail: info@accantec.de 28

Docker meets Python A look on the Docker SDK for Python pip - PowerPoint PPT Presentation

Docker meets Python A look on the Docker SDK for Python pip install docker Jan Wagner Data Science Consultant accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de |

Python, Docker, Kubernetes, Python, Docker, Kubernetes, and beyond? and beyond? Peter Bbics

Docker@OVH with Mesos/Marathon June 28th 2016 @devatoria @brouberol Devops / Python charmer

Production-ready Docker packaging for Python Itamar Turner-Trauring https://pythonspeed.com

Setup docker rm $(docker ps -aq) docker network rm my_net Demo - Install and activate yum -y

docker service is the new docker run Getting Started with Docker Clustering Mike Goelzer /

DOCKER AND PYTHON Making them play nicely and securely for Data Science and Machine Learning

An introduction to cgroups and cgroupspy tags = [python, docker, coreos',

Bioinformatics CS300 Crash course: Transcription and Translation Running Python in Docker or

docker for data science Data science academy - HelloFresh Max Halford June 2017 0 why use

INTRODUCTION TO DOCKER ADRIAN MOUAT SO WHAT IS DOCKER? SIMILAR TO A LIGHTWEIGHT VM Both

Docker Provider The Docker provider is used to interact with Docker containers and images. It uses

Docker: Testing the Waters LA-UR 15-25901 1 LA-UR 15-25901 Docker: Theres No Containing

Docker Orchestration: Beyond the Basics Aaron Lehmann Software Engineer, Docker About me

Extending Python with Rust Introduction and a hands-on demo of writing Python extension in Rust

Docker Review Basic Commands docker image ls # list images currently present locally docker

A talker on Docker: How containers can make your work more reproducible, accessible, and ready

Docker in the EGI Docker in the EGI Federated Cloud Federated Cloud Carlos Gimeno

Docker for fun and profit Solomon Hykes* about Docker: "It uses Linux containers and the

Docker for Developers Michael Hrivnak Principal Software Engineer - Red Hat Inc.

Python Evangelism 101 or Python Meets The Enterprise Peter Wang Teaching Languages

Containers, Docker, and Security: State of the Union 1 / 38 Who am I? Jrme Petazzoni

USING DOCKER SAFELY ADRIAN MOUAT NLUUG 28 MAY 2015 LOT OF NEGATIVE COMMENTS ON DOCKER SECURITY

The Modern Platform in 2020 Justin Cormack Who am I? Engineer at Docker in Cambridge, UK. Docker

Orchestration in Docker Swarm mode, Docker services and declarative application deployment Mike

Docker meets Python A look on the Docker SDK for Python pip - PowerPoint PPT Presentation

Docker meets Python A look on the Docker SDK for Python pip install docker Jan Wagner Data Science Consultant accantec group | Alstertor 17 | 20095 Hamburg | Tel.: +49 (40) 67 59 59 0 | Fax.: +49 (40) 67 59 59 29 | www.accantec.de |

Python, Docker, Kubernetes, Python, Docker, Kubernetes, and beyond? and beyond? Peter Bbics

Docker@OVH with Mesos/Marathon June 28th 2016 @devatoria @brouberol Devops / Python charmer

Production-ready Docker packaging for Python Itamar Turner-Trauring https://pythonspeed.com

Setup docker rm $(docker ps -aq) docker network rm my_net Demo - Install and activate yum -y

docker service is the new docker run Getting Started with Docker Clustering Mike Goelzer /

DOCKER AND PYTHON Making them play nicely and securely for Data Science and Machine Learning

An introduction to cgroups and cgroupspy tags = [python, docker, coreos',

Bioinformatics CS300 Crash course: Transcription and Translation Running Python in Docker or

docker for data science Data science academy - HelloFresh Max Halford June 2017 0 why use

INTRODUCTION TO DOCKER ADRIAN MOUAT SO WHAT IS DOCKER? SIMILAR TO A LIGHTWEIGHT VM Both

Docker Provider The Docker provider is used to interact with Docker containers and images. It uses

Docker: Testing the Waters LA-UR 15-25901 1 LA-UR 15-25901 Docker: Theres No Containing

Docker Orchestration: Beyond the Basics Aaron Lehmann Software Engineer, Docker About me

Extending Python with Rust Introduction and a hands-on demo of writing Python extension in Rust

Docker Review Basic Commands docker image ls # list images currently present locally docker

A talker on Docker: How containers can make your work more reproducible, accessible, and ready

Docker in the EGI Docker in the EGI Federated Cloud Federated Cloud Carlos Gimeno

Docker for fun and profit Solomon Hykes* about Docker: &quot;It uses Linux containers and the

Docker for Developers Michael Hrivnak Principal Software Engineer - Red Hat Inc.

Python Evangelism 101 or Python Meets The Enterprise Peter Wang Teaching Languages

Containers, Docker, and Security: State of the Union 1 / 38 Who am I? Jrme Petazzoni

USING DOCKER SAFELY ADRIAN MOUAT NLUUG 28 MAY 2015 LOT OF NEGATIVE COMMENTS ON DOCKER SECURITY

The Modern Platform in 2020 Justin Cormack Who am I? Engineer at Docker in Cambridge, UK. Docker

Orchestration in Docker Swarm mode, Docker services and declarative application deployment Mike

Docker for fun and profit Solomon Hykes* about Docker: "It uses Linux containers and the