User Manual. CG Elastic. Version 1.17-SNAPSHOT

Size: px

Start display at page:

Download "User Manual. CG Elastic. Version 1.17-SNAPSHOT"

Clinton Gilbert Fowler
5 years ago
Views:

1 User Manual CG Elastic Version 1.17-SNAPSHOT

2 Table of Contents 1. Introduction Modules HeartBeat MetricBeat CgWmBeat ISHome ISService UmQueue UmDoc Tablespace Perflog Sysmem, Syscpu, Sysdisk (deprecated) Jenkins

Table 1. History Date Author Detail 2017-10-09 bcouetil Minor changes 2017-10-06 bcouetil CgElastic beat migration + CgUtils DB update 2017-09-15 bcouetil Anomaly code refactoring 1.

3 Table 1. History Date Author Detail bcouetil Minor changes bcouetil CgElastic beat migration + CgUtils DB update bcouetil Anomaly code refactoring 1. Introduction webmethods offer some nice KPI and dashboard handling by the hand of Optimize For Process, Optimize For Infra, and MashZone. The setup, from which CgElastic is a part of, involves the (free and versatile) Elastic Stack instead (Elasticsearch, Logstash, Beats, Kibana). Figure 1. webmethods Architecture involving Elastic Stack 1

4 Figure 2. Kibana dashboard on a webmethods project Figure 3. Graphana dashboards on a webmethods project 2

5 2. Modules In the following paragraphs, different modules are presented. All have the purpose to populate an Elastisearch. Some are official modules applied to webmethods ecosystem HeartBeat The official Elastic module HeartBeat is able to ping a host regularly through various channels. It can be used to check that the IS, UM, MWS, CentraSite modules are up and running, as wells as continuous deployment tools such as Gerrit, Jenkins, SonarQube, Nexus. Figure 4. Number of healthchecks KO checked every 30s Example JSON Data { "_index": "heartbeat ", "_type": "doc", "_id": "AV7IZ1_jh9aXLVWW6fIY", "_version": 1, "_score": null, "_source": { "@timestamp": " T12:12:50.727Z", "beat": { "hostname": "2008c14c7d19", "name": "2008c14c7d19", "version": "5.5.2" "duration": { "us": "host": "frpardge", "response": { "status": 200 "type": "Kibana", "up": true, "url": " 3

2.2. MetricBeat The official Elastic module

server and containers as well. Figure 5.

6 2.2. MetricBeat The official Elastic module MetricBeat gives insights on Memory, CPU, disk, network of the current host. It is able to give these insight on Docker server and containers as well. Figure 5. CPU usage overtime Figure 6. Memory usage overtime Figure 7. Docker CPU usage overtime 4

$Figure 8. Docker memory usage overtime Example JSON Data { "_index": "metricbeat-2017.09.$

7 Figure 8. Docker memory usage overtime Example JSON Data { "_index": "metricbeat ", "_type": "doc", "_id": "AV7IZkNlh9aXLVWW6e3m", "_version": 1, "_score": null, "_source": { "@timestamp": " T12:11:37.813Z", "beat": { "hostname": "frpardge", "name": "frpardge", "version": "5.5.2" "docker": { "info": { "containers": { "paused": 0, "running": 6, "stopped": 3, "total": 9 "id": "KRQF:O4Q2:C3XT:HVLP:LKJW:RO5A:XB55:BKTR:K5RB:LK5R:63EJ:6BPB", "images": 82 "metricset": { "host": "/var/run/docker.sock", "module": "docker", "name": "info", "rtt": "type": "metricsets" 5

8 2.3. CgWmBeat Capgemini webmethods beat module cgwmbeat gathers all custom statistics from webmethods servers. There are several area of data detailed in next paragraphs ISHome The ISHome module gives insights on Integration Server overall statistics Figure 9. IS Memory usage Figure 10. IS uptime 6

9 Example JSON Data { "_index": "isstat", "_type": "isstat", "_id": "AV7IaOwuh9aXLVWW6fiJ", "_version": 1, "_score": null, "_source": { "starttime": " :36:40 CEST", "uptime": "1h:37m:52s", "maxmem": , "totalmem": , "freemem": , "usedmem": , "freememper": 57, "usedmemper": 43, "memarraymax": , "svrt": 2, "svrtmax": 14, "srvthreadcount": 1, "srvthreadcountpeak": 11, "syst": 374, "systmax": 375, "conn": 55, "connmax": 55, "connavg": 322, "reqtotal": 31, "reqlifetime": 3714, "reqavg": 165, "reqtotavg": 209, "newreqpm": 36, "endreqpm": 36, "errsvc": 104, "errsys": 43, "svcrate": 100, "ssnused": 3, "ssnpeak": 4, "ssnmax": , "connstatefulsessionscurrent": 0, "connstatefulsessionspeak": 0, "connstatefulsessionslimit": , "insertdate": " T12:14:33.005" "fields": { "insertdate": [ , "usedmempretty": [ , "totalmempretty": [ , "maxmempretty": [ "sort": [

$IS Services total access Example JSON Data { "_index": "servicestat", "_type": "startup", "_id": "AV7TWV-fh9aXLVWWGoGl", "_version": 1, "_score": null, "_source": { "fullname": "wm.xslt.$

10 ISService The ISService module gathers webmethods services running statistics. Figure 11. IS Services total access Example JSON Data { "_index": "servicestat", "_type": "startup", "_id": "AV7TWV-fh9aXLVWWGoGl", "_version": 1, "_score": null, "_source": { "fullname": "wm.xslt.admin:startup", "package": "wm.xslt.admin", "shortname": "startup", "accesslastdate": " :31:46 CEST", "accesstotal": 1, "accessnew": 0, "accessrunning": 0, "insertdate": " T15:13:23.359" "fields": { "insertdate": [ "sort": [

11 UmQueue The UmQueue module gathers Universal Messaging channels and topics statistics. This helps know, on publish/subscribe processes, if queues are growing, or if the platform handles everything at the highest possible speed. Figure 12. UM queues length Example JSON Data { "_index": "umqueue", "_type": "StartRouteMsg", "_id": "AV7TXczxh9aXLVWWGpYr", "_version": 1, "_score": null, "_source": { "name": "StartRouteMsg", "type": "channel", "currentnoofconnections": 1, "currentnumberofevents": 0, "totalconsumed": 12, "totalpublished": 4, "usedspace": 781, "memoryusage": 0, "consumedrate": 0, "fanouttime": 0, "insertdate": " T15:18:13.489" "fields": { "insertdate": [ "sort": [

12 UmDoc The UmDoc module is the main module for business dashboards. It tracks every single (business) document published in the system. Figure 13. CG Anomalies by type Figure 14. Document published by type 10

13 Example JSON Data { "_index": "pubdoc", "_type": "DfArle", "_id": "AV7TTTGmh9aXLVWWGkmc", "_version": 1, "_score": null, "_source": { "DGE.Entete.Nature.Type": "DiffusionFichier", "DGE.Entete.Nature.Version": "02.01", "DGE.Entete.Nature.Phase": "DF_ARLE", "DGE.Entete.Service.Reference": "M0002E001", "DGE.Entete.Service.Version": "02.01", "DGE.Entete.Echange.Identifiant": "CNAM.DGEARLE.Q ", "DGE.Entete.Echange.Horodatage": " T17:00:04.911", "DGE.Entete.Echange.RefConversation": "DGEA011701", "DGE.Entete.Echange.Fonction": "9", "DGE.Entete.Emetteur.Identifiant": " ", "DGE.Entete.Emetteur.Type": "RFO", "DGE.Entete.Emetteur.Libelle": "DGE", "DGE.Entete.Recepteur.Identifiant": " ", "DGE.Entete.Recepteur.Type": "RFO", "DGE.Entete.Recepteur.Libelle": "CNAM", "DGE.Document.EchangeOrigine.Identifiant": "RGF011701", "DGE.Document.EchangeOrigine.Horodatage": " T17:00:00.203", "DGE.Document.Resultat.Statut": "R", "DGE.Document.Resultat.Complement[0.Code": "9302", "DGE.Document.Resultat.Complement[0.Libelle": "Adhesion producteur inconnue", "insertdate": " T15:00:05.157" "fields": { "DGE.Document.EchangeOrigine.Horodatage": [ , "ModuleCode": [ "null/null", "DGE.Entete.Echange.Horodatage": [ , "insertdate": [ "sort": [

$Tablespaces occupation gauges Example JSON Data { "_index": "dbstat", "_type": "WEBMDATA", "_id": "AV7TUF8eh9aXLVWWGlge", "_version": 1,$ $"_score": null, "_source": { "schema": "WEBMDATA", "allocatedmo": 200, "freemo": 179.81, "usedmo": 20.19, "freepercent": 89.$

14 Tablespace The Tablespace module gives insights on Oracle TBS Occupation Figure 15. Tablespaces occupation overtime Figure 16. Tablespaces occupation gauges Example JSON Data { "_index": "dbstat", "_type": "WEBMDATA", "_id": "AV7TUF8eh9aXLVWWGlge", "_version": 1, "_score": null, "_source": { "schema": "WEBMDATA", "allocatedmo": 200, "freemo": , "usedmo": 20.19, "freepercent": 89.91, "usedpercent": 10.09, "insertdate": " T15:03:33.406" "fields": { "insertdate": [ , "usedpercentpretty": [ "sort": [

15 Perflog The perflog module listen to the cg-utils file that stores top level java services duration. With this data, you can see what services are taking too long to execute, and if the current duration is consistent with the average. Figure 17. Java service duration overtime Figure 18. Java services duration heatmap 13

16 Example JSON Data { "_index": "logstash ", "_type": "perflog", "_id": "AV7TTUT9h9aXLVWWGknX", "_version": 1, "_score": null, "_source": { "offset": 76128, "method": "senddfarle", "input_type": "log", "source": "/islogs/log4j2/perfs.log", "message": " :00: INFO PERFORMANCES - #senddfarle(...): in ms", "type": "log", "tags": [ "beats_input_codec_plain_applied", "duration": , "@timestamp": " T15:00:07.451Z", "@version": "1", "beat": { "hostname": "c843aa83715b", "name": "c843aa83715b", "version": "5.5.2" "host": "c843aa83715b", "timestamp": " :00:07.451" "fields": { "@timestamp": [ "sort": [

17 Sysmem, Syscpu, Sysdisk (deprecated) sysmem, syscpu and sysdisk provides insight of memory, CPU and disk usage from the server hosting the current IS server. They are deprecated since the unveil of the Elastic module metricbeat which is more feature-rich. 15

18 2.4. Jenkins The Jenkins plugin Logstash gives insight on build launches and durations. Figure 19. Jenkins builds duration Example JSON Data { "_index": "jenkins", "_type": "build", "_id": "AV7PQahNh9aXLVWWB8FS", "_version": 1, "_score": null, "_source": { "data": { "id": "753", "result": "FAILURE", "projectname": "CNAV-DGE_P1_Review", "displayname": "#753", "message": [ "[...truncated KB...", "[withmaven Jenkins Task Scanner Plugin not found, don't display results of source code scanning for 'TODO' and 'FIXME' in pipeline screen.", "[Pipeline // withmaven", "[Pipeline ", "[Pipeline // stage", "[Pipeline extrecipients", "[Pipeline step", "[Pipeline ", "[Pipeline // timeout", "source": "jenkins", "source_host": " "@buildtimestamp": " T22:07: ", "@timestamp": " T22:09: ", "@version": 1 16

Amazon Elasticsearch Service

Amazon Elasticsearch Service Fully managed, reliable, and scalable Elasticsearch service. Have Your Frontend & Monitor It Too Scalable Log Analytics Inside a VPC Lab Instructions Contents Lab Overview...