Appdynamics / Appdynamics/HA-toolkit

appdstatus.sh: Events-service liveness-detection fragile and broken in 4.4(?)+ (4.5.1 confirmed)

Open
#94 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Shell
Stars
13
Forks
11
PR merge metrics
No merged PRs in 30d

Description

Issue 1): EC allows installation of events service to any location-
Issue 2): "Events Service" process signature changed from "events_service" to "events-service"
(underscore to hyphen)

Liveness script checks for it in the "usual" <=V4.3 spot (fails)

bash -x output:

`+ events_running
+ grep /data/appdynamics/platform/product/controller/events_service
+ grep java
+ ps -f -u appd
+ return 1
+ case $? in
+ echo 'events service not running'
events service not running`

Events service doesn't live there, events service lives here:

/data/appdynamics/platform/product/events-service/processor/bin/

Process signature:

`appd@ubuntu:/data/appdynamics/platform/product/controller/HA$ ps -ef|grep events_service
appd 9925 8428 0 11:33 pts/0 00:00:00 grep --color=auto events_service
appd@ubuntu:/data/appdynamics/platform/product/controller/HA$ ps -ef|grep events-service
appd 4977 1 1 11:02 tty1 00:00:26 /data/appdynamics/platform/product/jre/1.8.0_162/bin/java -Xmx746m -Xms746m -Djava.net.preferIPv4Stack=true -Dfile.encoding=UTF-8 -Djute.maxbuffer=30000000 -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+DisableExplicitGC -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+PrintClassHistogram -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure -verbose:gc -XX:GCLogFileSize=64m -XX:NumberOfGCLogFiles=4 -XX:+UseGCLogFileRotation -XX:CompileCommand=exclude,org/apache/lucene/lucene54/Lucene54DocValuesConsumer.addSortedNumericField -XX:CompileCommand=exclude,org/apache/lucene/lucene54/Lucene54DocValuesConsumer.addBinaryField -XX:CompileCommand=exclude,org/elasticsearch/search/aggregations/metrics/percentiles/tdigest/AbstractTDigestPercentilesAggregatorstart.collect -XX:CompileCommand=exclude,org/apache/lucene/index/SortedNumericDocValuesWriter.flush -XX:CompileCommand=exclude,org/apache/lucene/codecs/PushPostingsWriterBase.writeTerm -Xloggc:/data/appdynamics/platform/product/events-service/processor/bin/../logs/%p-gc.log -DAPPLICATION_HOME=/data/appdynamics/platform/product/events-service/processor/bin/.. -classpath /data/appdynamics/platform/product/events-service/processor/bin/../lib/* com.appdynamics.analytics.processor.AnalyticsService -p /data/appdynamics/platform/product/events-service/processor/conf/events-service-api-store.properties -y /data/appdynamics/platform/product/events-service/processor/bin/../conf/events-service-api-store.yml
appd 5011 4977 1 11:02 tty1 00:00:20 /data/appdynamics/platform/product/jre/1.8.0_162/bin/java -Xms2238m -Xmx2238m -Djava.awt.headless=true -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+HeapDumpOnOutOfMemoryError -XX:+DisableExplicitGC -Dfile.encoding=UTF-8 -Djna.nosys=true -Djava.net.preferIPv4Stack=true -Dfile.encoding=UTF-8 -Djute.maxbuffer=30000000 -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+DisableExplicitGC -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+PrintClassHistogram -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure -verbose:gc -XX:GCLogFileSize=64m -XX:NumberOfGCLogFiles=4 -XX:+UseGCLogFileRotation -XX:CompileCommand=exclude,org/apache/lucene/lucene54/Lucene54DocValuesConsumer.addSortedNumericField -XX:CompileCommand=exclude,org/apache/lucene/lucene54/Lucene54DocValuesConsumer.addBinaryField -XX:CompileCommand=exclude,org/elasticsearch/search/aggregations/metrics/percentiles/tdigest/AbstractTDigestPercentilesAggregator$1.collect -XX:CompileCommand=exclude,org/apache/lucene/index/SortedNumericDocValuesWriter.flush -XX:CompileCommand=exclude,org/apache/lucene/codecs/PushPostingsWriterBase.writeTerm -Dmapper.allow_dots_in_name=true -Des.insecure.allow.root=true -Des.path.home=/data/appdynamics/platform/product/events-service/processor/elasticsearch -cp /data/appdynamics/platform/product/events-service/processor/elasticsearch/lib/elasticsearch-2.4.1.jar:/data/appdynamics/platform/product/events-service/processor/elasticsearch/lib/* org.elasticsearch.bootstrap.Elasticsearch start -p /data/appdynamics/platform/product/events-service/processor/bin/../elasticsearch.id
appd 9927 8428 0 11:33 pts/0 00:00:00 grep --color=auto events-service`

Kinda lame fix/hack:

HA/lib/status.sh:

`function events_running {
# scosol fix
# if ps -f -u $RUNUSER | grep "java" | grep "$APPD_ROOT/events_service" >/dev/null ; then
if ps -f -u $RUNUSER | grep "java" | grep "events-service" >/dev/null ; then`

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.