Infrastructure at your Service. Oracle over Docker. Oracle over Docker

Transcription

1 Infrastructure at your Service.

2 Infrastructure at your Service. About me David Hueber COO Principal Consultant Mobile Page

3 Who we are dbi services Experts At Your Service > 40 specialists in IT infrastructure > Certified, experienced, passionate Based In Switzerland > 100% self-financed Swiss company > Over CHF 6 mio. turnover Leading In Infrastructure Services > More than 100 customers in CH, D, & F > Over 40 SLAs dbi FlexService contracted dbi services is hiring in Basel & Zürich (career@dbi-services.com) Page

4 Agenda 1. Docker overview 2. Database provisioning architecture 3. Networking & interfaces 4. Generating a database container Page

5 Docker overview What are containers? > Introduction > Docker principle > Docker architecture Page

6 Docker overview Introduction Page

7 Docker overview Docker principle Open platform to > Build > Ship > Run...any application anywhere (soon) Container based virtualization > Uses host kernel features > Namespace > Cgroups Page

8 Docker overview Docker principle Virtualization > Resource pooling > Easy to scale > Requires dedicated > CPU / RAM / Storage > Guest OS waste of resource Containers > Lightweight > No need of Guest OS > Portability > Limited to one type of OS VM VM VM Container Container App App App App App Guest OS Guest OS Hypervisor Guest OS OS Kernel Host OS Page 8

9 Docker overview Docker architecture Container Container App App Docker Engine Image Image Images Docker Hub OS Kernel Host OS Page 9

10 Docker overview Docker architecture Docker Engine (Daemon) > Based on Linux Kernel features > Namespace (PID, NET,MNT...) isolation > Control groups (cgroups) resources management > Manage images > Allows containers to be build, run & shipped Docker client > CLI interface > Additional clients available > Docker Machine > Docker Compose > Docker Swarm clusters >... ~]# docker version Client version: el7 Client API version: 1.18 Go version (client): go1.4.2 Git commit (client): c3ca5bb/1.6.2 OS/Arch (client): linux/amd64 Server version: el7 Server API version: 1.18 Go version (server): go1.4.2 Git commit (server): c3ca5bb/1.6.2 OS/Arch (server): linux/amd64 Page 10

11 Docker overview Docker architecture Images > Read Only templates > Build by users > From an image > Based on a Docker File > Can be pulled from a repository R/W Container add HTTP (R/0) R/W Container add DB (R/0) Containers > Isolated application platform > Principle of Single Concern > Read Write layer from one or more images > Copy on Write > Allows to generate new images Base Image (R/O) Page 11

12 Docker overview Docker architecture Registry & Repositories > Global store for images > 2 defaults > Local registry > Docker hub Registry Tag Tag Tag Page 12

13 Database provisioning architecture DBaaS platform? > Target architecture > Components Page

14 Database provisioning architecture Target architecture Oracle RDBMS image Container Container Container Instance 1 Instance 2 Instance N Oracle data image Oracle Linux image Data-Only container Docker Engine OS Kernel Host OS Page 14

15 Database provisioning architecture Components Images > Oracle Linux image > Can be pulled from docker registry > Can be created manually through tar file of a minimal installation tar --numeric-owner --exclude=/proc /tmp/oracle-linuxr7u1.tar /tmp --exclude=/sys -cvf cat oracle-linuxr7u1.tar docker import - oracle-linux/base:7.1 > Oracle RDBMS image > Oracle installed > Listener configured > Port 1521 exposed > Script to deploy or start a database Page 15

16 Database provisioning architecture Components Images > Oracle data image > Oracle preinstall rdbms 12c package > ORADATA folder structure > Used to run data-only container oracle-data]# cat Dockerfile FROM oracle-linux/preinstall:7.1 MAINTAINER RUN mkdir -p /u01/oradata /u02/oradata /u03/oradata /u90/flash_recovery_area;\ chown oracle:oinstall /u01/oradata;\ chown oracle:oinstall /u02/oradata;\ chown oracle:oinstall /u03/oradata;\ chown oracle:oinstall /u90/flash_recovery_area VOLUME /u01/oradata VOLUME /u02/oradata VOLUME /u03/oradata VOLUME /u90/flash_recovery_area Page 16

17 Database provisioning architecture Components Containers > Data-only container > Presents storage to the application containers > Integrates 1 Volume per Mount Point > Doesn t need to be running [root@srvdocker01 ~]# docker run --name=ol7-oradata oracle-linux/data:7.1 true [root@srvdocker01 ~]# docker ps a CONTAINER ID IMAGE COMMAND STATUS NAMES a0e953 oracle-linux/data:7.1 "true" 6 seconds ago ol7-oradata [root@srvdocker01 ~]# docker volume ls DRIVER VOLUME NAME local 0eb940ae49ecf64ec60d96f9a3cc6865c77f359012d9e6183cfbb43e8b local 029cf9eb6a8d4762febaac5e b6920c44a bb3f46ce20afb0772 local d99ba295f0e38f2375c05d1e198af64c76d8473d2fabab1eda0af06e283eb665 local ada706cbbc0c4748a71a0fb62c24477cd78c ae ef5715ae21 Page 17

18 Database provisioning architecture Components Containers > Data-only container > Volumes content can be browsed from the host machine volumes]# pwd /var/lib/docker/volumes volumes]# ls /*/_data/./06b67f1c48ce3029ce43c2e9786ac66fadfa09ce99f55b608be88bd18dd4b96a/_data/: DBTEST0 DBTEST1 DBTEST2 DBTEST3 DBTEST5 DBTEST6 DBTEST7 DBTEST9./180f70c8fd751a4bfb93e e92fae43665a0e12202d71cf19f f/_data/: DBTEST0 DBTEST1 DBTEST2 DBTEST3 DBTEST5 DBTEST6 DBTEST7 DBTEST9./7578ee63cbabf846b422d7af6c84bf3f8460a4d52ba4de2ed5b7b14d44c50451/_data/: DBTEST3 DBTEST6 DBTEST7./f3d5d ec0533cbbb4bf340ac27636c34a5a9f2bf6d503ae79cedfffb3a/_data/: DBTEST0 DBTEST1 DBTEST2 DBTEST3 DBTEST5 DBTEST6 DBTEST7 DBTEST9 Page 18

19 Database provisioning architecture Components Containers > Instance container > Runs database instance > Stores password file & spfile > Access permanent storage from data-only container volumes]# pwd /var/lib/docker/volumes Page 19

20 Networking and interfaces Accessing the databases... > Networking > Container interfaces Page

21 Networking and interfaces Networking 3 networks available by default [root@srvdocker01 docker]# docker network ls NETWORK ID NAME DRIVER 154cc89e0178 bridge bridge B d364 none null 944c26d97cf7 host host None network > Connects the container only with lo interface J Host > Duplicates the host network layer > Includes hostname Page 21

22 Networking and interfaces Networking Bridge network > Linked to local virtual interface docker0 > Default network interface for containers > Principle of NAT interface > Ports are exposed by the container > Access is done on host IP address > Custom bridge can be configured > Use of brctl command docker]# ip addr 4: docker0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP link/ether 02:42:60:e5:34:db brd ff:ff:ff:ff:ff:ff inet /16 scope global docker0 inet6 fe80::42:60ff:fee5:34db/64 scope link valid_lft forever preferred_lft forever Page 22

23 Networking and interfaces Networking Bridge network Container Container Host eth0: eth0: veth51abaf0 veth5ca4828 docker0: enp0s3: Physical network Page 23

24 Networking and interfaces Container interfaces All Linux traditional interfaces available > Service needs to be started at container run Docker commands > stop / start > pause / unpause > Attach (Detach using Ctrl + Alt + P +Q) Additional process can be started on running container > docker exec [root@srvdocker01 docker]# docker exec it ol7-dbitest1 /bin/bash Page 24

25 Generating a database container Accessing the databases... > Deployment templates > Deployment script > Deploy a database Page

26 Generating a database container Deployment templates Templates to generate a new database > Directories creation script > Password File & Pfile > Tar file of base database backup > Control File > Incremental level 0 > Archivelogs > RMAN duplicate script [root@srvdocker01 template]# pwd /staging/databases/template [root@srvdocker01 template]#ls backup_inc0_dbtemp.tar.gz duplicate.rcv orapwdbtemp create_dir.sh initdbtemp.ora Page 26

27 Generating a database container Deployment script Add entry in ORATAB Set environment Get directory creation script Add & run directory script Get pfile Adapt pfile Get template backup Get & rename password file Create spfile & startup nomount Run backup based duplicate Start Listener Page 27

28 Generating a database container Deployment script Started at container creation > Defined in the image [root@srvdocker01 docker]# cat DockerFiles/ol7-dbaas/Dockerfile FROM oracle-linux/rdbms:tmp MAINTAINER david.hueber@dbi-services.com EXPOSE 1521 CMD /bin/bash -c "/tmp/run_dbaas.sh -o ${OPERATION} -s ${TARGET}" Page 28

29 Generating a database container Deployment a database Based on command docker run > -d run in detach mode background > -P automatically map all exposed ports > -e provide variables values for CMD statement > --volumes-from defines Data-only container to used > --name defines container name > Defines image used to create the container > No tag specifies > Looks for latest by default > Script to run at startup depends on CMD statement in the image docker run d P e OPERATION=deploy e TARGET=DBIDB01 --volumes-from=ol7- data --name=ol7-dbodb01 oracle-linux/rdbms Page 29

30 Generating a database container Deployment a database Deployment progress can be followed > Docker logs f <container> > tail f like command Docker logs f ol7-dbodb01 Once deployed > Find corresponding port using docker ps [root@srvdocker01 docker]# docker ps CONTAINER ID... STATUS PORTS 5dda1f7e2dd9... Up 17 minutes :32770->1521/tcp > Access database > SQLPlus & SQL Developer > Any application Page 30

31 Infrastructure at your Service. Any questions? Please do ask. David Hueber COO Principal Consultant Mobile We look forward to working with you! Page