198 Lotus blogs updated hourly. Who will post next? Home | Blogs | Search | About 
 
Latest 7 Posts
More on Elasticsearch, Logstash and Kibana (ELK)
Fri, Oct 20th 2017 27
Zipping and Tarring on macOS - with added funkiness
Thu, Oct 19th 2017 28
IBM BPM and Elasticsearch - with added TLS
Thu, Oct 19th 2017 27
Apple Watch - go, no go, go
Mon, Oct 16th 2017 125
IBM Cloud Private - My first foray
Mon, Oct 16th 2017 101
Ubuntu - Software Updater and the Insufficient Disk Space
Mon, Oct 16th 2017 62
Git and Jenkins - Learning Resources
Fri, Oct 13th 2017 57
Top 10
Apple Watch - go, no go, go
Mon, Oct 16th 2017 125
IBM Cloud Private - My first foray
Mon, Oct 16th 2017 101
Ubuntu - Software Updater and the Insufficient Disk Space
Mon, Oct 16th 2017 62
Git and Jenkins - Learning Resources
Fri, Oct 13th 2017 57
Jenkins to Git - SSH says "No"
Fri, Oct 13th 2017 52
Transport Layer Security (TLS) 1.2 and SoapUI
Fri, Jun 12th 2015 48
Learning Times - Or Git being a bit of a Git
Fri, Oct 13th 2017 46
Executing external Python/Jython scripts from within WebSphere Application Server's wsadmin tool
Thu, Feb 27th 2014 42
IBM HTTP Server - Checking Personal Certificates
Wed, Oct 11th 2017 42
IBM HTTP Server - Tinkering with CMS Keystore Passwords
Wed, Oct 11th 2017 38


Tinkering with Elasticsearch and Kibana - on Docker, of course
Twitter Google+ Facebook LinkedIn Addthis Email Gmail Flipboard Reddit Tumblr WhatsApp StumbleUpon Yammer Evernote Delicious
   

In order to get to grips with the new world of event emission from IBM BPM, I needed to have a combined Elasticsearch / Kibana runtime to which to … emit events.

Using this as source: -

Elasticsearch and Kibana in one container

Simple and lightweight docker image for previewing Elasticsearch and Kibana.

I downloaded the repository file from here, expanded the resulting ZIP file: -

unzip ~/Downloads/nshou-elasticsearch-kibana-e07aa6ed04af.zip 

switched to the appropriate directory: -

cd ~/nshou-elasticsearch-kibana-e07aa6ed04af

took a quick look at the Dockerfile: -

cat Dockerfile

FROM openjdk:jre-alpine

LABEL maintainer "nshou <nshou@coronocoya.net>"

ENV ES_VERSION=5.6.2
    KIBANA_VERSION=5.6.2

RUN apk add --quiet --no-progress --no-cache nodejs wget
 && adduser -D elasticsearch

USER elasticsearch

WORKDIR /home/elasticsearch

RUN wget -q -O - https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-${ES_VERSION}.tar.gz
 |  tar -zx
 && mv elasticsearch-${ES_VERSION} elasticsearch
 && wget -q -O - https://artifacts.elastic.co/downloads/kibana/kibana-${KIBANA_VERSION}-linux-x86_64.tar.gz
 |  tar -zx
 && mv kibana-${KIBANA_VERSION}-linux-x86_64 kibana
 && rm -f kibana/node/bin/node kibana/node/bin/npm
 && ln -s $(which node) kibana/node/bin/node
 && ln -s $(which npm) kibana/node/bin/npm

CMD sh elasticsearch/bin/elasticsearch -E http.host=0.0.0.0 --quiet & kibana/bin/kibana --host 0.0.0.0 -Q

EXPOSE 9200 5601


and then created the image: -

docker build -t elastic-search-kibana:elastickib .

Sending build context to Docker daemon   7.68kB
Step 1/9 : FROM openjdk:jre-alpine
jre-alpine: Pulling from library/openjdk
88286f41530e: Pull complete 
720349d0916a: Pull complete 
9431a0557160: Pull complete 
Digest: sha256:6bb5c6b7b685b63cb2d937bded1afbcc5738a5ea4b7c4e219199e55e7dda70f8
Status: Downloaded newer image for openjdk:jre-alpine
 ---> e2f6fe2dacef
Step 2/9 : LABEL maintainer "nshou <nshou@coronocoya.net>"
 ---> Running in 1e003af9f082
 ---> df191a529d94
Removing intermediate container 1e003af9f082
Step 3/9 : ENV ES_VERSION 5.6.2 KIBANA_VERSION 5.6.2
 ---> Running in c8664902a7f7
 ---> 90c47efaf56a
Removing intermediate container c8664902a7f7
Step 4/9 : RUN apk add --quiet --no-progress --no-cache nodejs wget  && adduser -D elasticsearch
 ---> Running in 9fa9ade91bc4
 ---> 5445495027dc
Removing intermediate container 9fa9ade91bc4
Step 5/9 : USER elasticsearch
 ---> Running in f15c2522650a
 ---> fd83a9e51b4b
Removing intermediate container f15c2522650a
Step 6/9 : WORKDIR /home/elasticsearch
 ---> c4b5b83af736
Removing intermediate container c834e8cbb240
Step 7/9 : RUN wget -q -O - https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-${ES_VERSION}.tar.gz  |  tar -zx  && mv elasticsearch-${ES_VERSION} elasticsearch  && wget -q -O - https://artifacts.elastic.co/downloads/kibana/kibana-${KIBANA_VERSION}-linux-x86_64.tar.gz  |  tar -zx  && mv kibana-${KIBANA_VERSION}-linux-x86_64 kibana  && rm -f kibana/node/bin/node kibana/node/bin/npm  && ln -s $(which node) kibana/node/bin/node  && ln -s $(which npm) kibana/node/bin/npm
 ---> Running in fdc3ce9e0fc3
 ---> 772dbe7ad146
Removing intermediate container fdc3ce9e0fc3
Step 8/9 : CMD sh elasticsearch/bin/elasticsearch -E http.host=0.0.0.0 --quiet & kibana/bin/kibana --host 0.0.0.0 -Q
 ---> Running in 19b3ae4f083c
 ---> 077e18084009
Removing intermediate container 19b3ae4f083c
Step 9/9 : EXPOSE 9200 5601
 ---> Running in 160b93b21db3
 ---> 9a2583574e8a
Removing intermediate container 160b93b21db3
Successfully built 9a2583574e8a
Successfully tagged elastic-search-kibana:elastickib

checked my Docker image repository: -

docker images

REPOSITORY              TAG                 IMAGE ID            CREATED             SIZE
elastic-search-kibana   elastickib          9a2583574e8a        2 hours ago         310MB
websphere-liberty       webProfile7         905fc63e8e9b        3 weeks ago         411MB
openjdk                 jre-alpine          e2f6fe2dacef        3 weeks ago         81.4MB
ibmcom/datapower        latest              5d04824ab687        2 months ago        758MB

started a container: -

docker run -d -p 9200:9200 -p 5601:5601 elastic-search-kibana:elastickib

checked the running container: -

docker ps -a

CONTAINER ID        IMAGE                              COMMAND                  CREATED             STATUS              PORTS                                            NAMES
82a69369a551        elastic-search-kibana:elastickib   "/bin/sh -c 'sh el..."   7 seconds ago       Up 2 seconds        0.0.0.0:5601->5601/tcp, 0.0.0.0:9200->9200/tcp   cranky_visvesvaraya

and then connected to Kibana: -



and to Elasticsearch: -


which is nice

I'm now following this: -


and will go ahead and setup my BPM 8.6 VM … 

Let's see how I get on …



---------------------
http://portal2portal.blogspot.com/2017/10/tinkering-with-elasticsearch-and-kibana.html
Oct 10, 2017
34 hits



Recent Blog Posts
27
More on Elasticsearch, Logstash and Kibana (ELK)
Fri, Oct 20th 2017 10:28a   Dave Hay
Following earlier posts: -Tinkering with Elasticsearch and Kibana - on Docker, of courseFurther stories of a tinkerer - this time it's IBM BPM, Apache Kibana and ElasticsearchIBM BPM and Elasticsearch - with added TLSI've had a brief play with a new ( to me ) Docker image, ELK: -sebp/elkCollect, search and visualise log data with Elasticsearch, Logstash, and Kibana.using this documentation: -Elasticsearch, Logstash, Kibana (ELK) Docker image documentationThis time around, I built it using Dock
28
Zipping and Tarring on macOS - with added funkiness
Thu, Oct 19th 2017 5:41p   Dave Hay
So I had a specific requirement yesterday - I wanted to extract three specific files from a ZIP file.This is what I had: -unzip -l certificate-bundle.zipArchive: certificate-bundle.zip Length Date Time Name--------- ---------- ----- ---- 0 10-19-2017 16:58 ca/ 1310 10-19-2017 16:58 ca/ca.crt 1679 10-19-2017 16:58 ca/ca.key 0 10-19-2017 16:58 node1/ 1379 10-19-2017 16:58 node1/node1.crt 1679 10-19-2017 16:58 node1/node1.key---------
27
IBM BPM and Elasticsearch - with added TLS
Thu, Oct 19th 2017 5:29p   Dave Hay
Following this: -Tinkering with Elasticsearch and Kibana - on Docker, of courseFurther stories of a tinkerer - this time it's IBM BPM, Apache Kibana and ElasticsearchI've been tinkering further with Elasticsearch on Docker, establishing a TLS connection between it and IBM BPM.Here's my notes: -Pull Imagedocker pull docker.elastic.co/elasticsearch/elasticsearch:5.6.3Start containeres=`docker run -d -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" docker.elastic.co/elasticsearch/elas
125
Apple Watch - go, no go, go
Mon, Oct 16th 2017 3:29p   Dave Hay
So I had a weird experience last evening, and not in a good way.For no apparent reason, this was my Apple Watch: -and this: -I have no earthly idea what happened.So, being a true nerd, and a big fan of The IT Crowd, I decided to ( all together now ) TURN IT OFF AND ON AGAIN ….Obviously I couldn't read the display, what with it being all garbled n' all, so I just hit the big button on the right-hand side, below the digital crown and chose the appropriate gibberish - it was the one in red, so
101
IBM Cloud Private - My first foray
Mon, Oct 16th 2017 10:37a   Dave Hay
So this week, along with many other things, I'm starting to get to grips with the newly announced IBM Cloud Private: - IBM brings the power of cloud behind the enterprise firewall I'm running on Ubuntu Linux: - lsb_release -a No LSB modules are available. Distributor ID:    Ubuntu Description:    Ubuntu 16.04.3 LTS Release:    16.04 Codename:    xenial so started by installing the pre-requisites of VirtualBox and Vagrant: - sudo apt-get install virtualbox su
62
Ubuntu - Software Updater and the Insufficient Disk Space
Mon, Oct 16th 2017 8:13a   Dave Hay
So I'm trying to update Ubuntu 16.0.4.3 LTS using Software Updater, but couldn't get past this: -      Now I have LOADS of disk space: - df -kmh Filesystem                   Size  Used Avail Use% Mounted on udev                          16G     0   16G   0% /dev tmpfs                        3.2G  9.4M  3.2G   1% /run /dev/mapper/ubuntu--vg-root  2.7T  346G  2.2T  14% / tmpfs               
57
Git and Jenkins - Learning Resources
Fri, Oct 13th 2017 10:35a   Dave Hay
This is what I've been reading and using over the past few days: -git-server-dockerHow to Setup Git Repository and Credentials for Jenkins Jobs.ssh/id_rsa failed: permission deniedMy simply Git Cheatsheet4.2 Git on the Server - Getting Git on a Server2.5 Git Basics - Working with Remotes'Your branch is ahead of 'origin/master' by 1 commit' on explicit push [duplicate]Unable to push to repositorycannot push into git repositoryJenkins TutorialIBM WebSphere Liberty ConfigurationDeploying with
52
Jenkins to Git - SSH says "No"
Fri, Oct 13th 2017 10:28a   Dave Hay
As per my earlier post: -Learning Times - Or Git being a bit of a GitI'm on a voyage of discovery with Jenkins and Git.Whilst trying to plumb onto into t'other, I was hitting a blocker.To recap, I have Jenkins installed on my MacBook, running locally, and I have Git running on a Docker container on a remote Mac.Therefore, I'm connecting to the remote Git repository using SSH rather than, say, HTTPS or a local file-system.This works OK for me using Git commands such as: -git clone ssh://git@19
46
Learning Times - Or Git being a bit of a Git
Fri, Oct 13th 2017 9:56a   Dave Hay
I'm on a bit of a voyage of discovery this week, having previously been tinkering with Elasticsearch and Kibana a few days back: -Further stories of a tinkerer - this time it's IBM BPM, Apache Kibana and ElasticsearchNow I'm playing with Jenkins and Git, the latter of which is running on Docker, with the intention of automating the push of Java code to WebSphere Liberty Profile, also running in Docker.I also intend to get to grips with Maven at the same time, what's not to like ?Anyway, back
42
IBM HTTP Server - Checking Personal Certificates
Wed, Oct 11th 2017 3:54p   Dave Hay
Whilst on the subject of IBM HTTP Server (IHS), as per an earlier post: -IBM HTTP Server - Tinkering with CMS Keystore PasswordsI was "auditing" the SSL certificate that I'm using for IHS, specifically the signature algorithm.So I have a single certificate in the key store: -/opt/IBM/HTTPServer/bin/gskcapicmd -cert -list -db /opt/IBM/HTTPServer/APIC/ssl/keystore.kdb -pw passw0rdCertificates found* default, - personal, ! trusted, # secret key*- wlpn.uk.ibm.comwhich I validated as follows: -/op




Created and Maintained by Yancy Lent - About - Planet Lotus Blog - Advertising - Mobile Edition