=== Log concentration project
- Install, configure, create Ansible roles and dockerize log shippers :
Flume-ng
Filebeat
- Install, configure and dockerize a publish subscribe tool :
Kafka cluster of 3 nodes
monitored by kafka-manager
orchestrated with zookeeper
- Install, configure and dockerize a search engine :
Elasticsearch cluster of 4 nodes
- install, dockerize, index templates injection in container startup, cluster creation, node jobs re-partition and cluster scaling with a button push
- TuneUP ES :
number of shards and replicas per index
data groupment in indexes per type
old data rotation using curator for ES a jenkins slave containing curator will be created when the job is triggered daily to remove last 10 days logs
Elasticsearch head standalone server cerebro web interface for
monitoring
- Install, configure and dockerize log parsers :
Logstash regex, conf, threads repartition .
Flume-ng
- Install, configure and dockerize log display and filtering tool :
Kibana dashbord
Dashboards creation
- Install, configure and dockerize security and monitoring tool :
X-Pack
==== E-boutique project HYBRIS
- create and maintain jenkins shell/groovy/pipeline jobs
- create and maintain jenkins declarative or multibranch pipeline
- refactoring of the existing shell scripted jobs into declarative pipeline
- deploy eboutique versions in various platforms
- nightly automatic deployment
- centralized merge job for all brunches of the project
- personalized docker jenkins slaves for specific jobs
- automated Unit tests with various reports for application stability under jenkins
- Docker images creation, maintenance
- Integration of docker images into DCOS mesosphere using marathon
tools used : DCOS PAAS, Mesos container scheduler, Ansible, docker, jenkins, gitlab, marathon, kafka, filebeat, logstash, zookeeper, Kibana, artifactory, elasticsearch .