After configuring AppDynamics in the jvm arguments, the controller process crashed.

Document ID : KB000072280
Last Modified Date : 28/02/2018
Show Technical Document Details
Issue:

After configuring AppDynamics in the jvm arguments, the controller process crashed.
Summary: sspc.log 2018-02-22T13:37:01.015+0100 WARNING 1 com.l7tech.server.processcontroller.ProcessController: default crashed with exit code 0! Will restart. 2018-02-22T13:37:01.018+0100 WARNING 1 com.l7tech.server.processcontroller.ProcessController: default is supposedly running but has not responded to a ping in 5,005ms. Will keep retrying up to 15,000 ms. 2018-02-22T13:37:06.019+0100 INFO 1 com.l7tech.server.processcontroller.ProcessController: default crashed; restarting... 2018-02-22T13:37:06.019+0100 INFO 1 com.l7tech.server.processcontroller.ProcessController: Getting API port from /opt/SecureSpan/Gateway/node/default/var/processControllerPort 2018-02-22T13:37:06.041+0100 INFO 1 com.l7tech.server.processcontroller.p: default starting 2018-02-22T13:37:11.042+0100 INFO 1 com.l7tech.server.processcontroller.ProcessController: Getting API port from /opt/SecureSpan/Gateway/node/default/var/processControllerPort 2018-02-22T13:37:16.071+0100 INFO 1 com.l7tech.server.processcontroller.ProcessController: Getting API port from /opt/SecureSpan/Gateway/node/default/var/processControllerPort 2018-02-22T13:37:21.094+0100 INFO 1 com.l7tech.server.processcontroller.ProcessController: Getting API port from /opt/SecureSpan/Gateway/node/default/var/processControllerPort 2018-02-22T13:37:26.126+0100 INFO 1 com.l7tech.server.processcontroller.ProcessController: Getting API port from /opt/SecureSpan/Gateway/node/default/var/processControllerPort 2018-02-22T13:37:31.144+0100 INFO 1 com.l7tech.server.processcontroller.ProcessController: Getting API port from /opt/SecureSpan/Gateway/node/default/var/processControllerPort 2018-02-22T13:37:36.163+0100 INFO 1 com.l7tech.server.processcontroller.ProcessController: Getting API port from /opt/SecureSpan/Gateway/node/default/var/processControllerPort 2018-02-22T13:37:41.178+0100 INFO 1 com.l7tech.server.processcontroller.ProcessController: /opt/SecureSpan/Gateway/node/default/var/processControllerPort does not exist yet, will try default port 2018-02-22T13:37:46.194+0100 INFO 1 com.l7tech.server.processcontroller.ProcessController: /opt/SecureSpan/Gateway/node/default/var/processControllerPort does not exist yet, will try default port 2018-02-22T13:37:51.209+0100 INFO 1 com.l7tech.server.processcontroller.ProcessController: /opt/SecureSpan/Gateway/node/default/var/processControllerPort does not exist yet, will try default port 2018-02-22T13:37:56.227+0100 INFO 1 com.l7tech.server.processcontroller.ProcessController: Getting API port from /opt/SecureSpan/Gateway/node/default/var/processControllerPort 2018-02-22T13:37:56.886+0100 INFO 1 com.l7tech.server.processcontroller.p: default started successfully 2018-02-22T13:37:56.886+0100 INFO 1 com.l7tech.server.processcontroller.ProcessController: default started Messages (I think we have to increase the limit) Feb 22 13:37:23 svamden java: SSL cipher list set to AES256-SHA Feb 22 13:37:28 svamden rsyslogd-2177: imuxsock begins to drop messages from pid 20968 due to rate-limiting Feb 22 13:37:33 svamden rsyslogd-2177: imuxsock lost 398 messages from pid 20968 due to rate-limiting Feb 22 13:37:37 svamden rsyslogd-2177: imuxsock begins to drop messages from pid 20968 due to rate-limiting Feb 22 13:37:48 svamden rsyslogd-2177: imuxsock lost 106 messages from pid 20968 due to rate-limiting Changes: Added AppDynamics startup properties in appliancedefs.sh file # Reserve ports 7001 and 7100 on the appliance NODE_OPTS="$NODE_OPTS -Dcom.l7tech.server.transport.reservedPorts=7001,7100 -javaagent:/usr/local/appdynamics/appagent/javaagent.jar"

Environment:

Product: API GATEWAY, Release: 8.4, Operating System: RHEL 6

Cause:
After configuring AppDynamics in the jvm arguments, the controller process crashed.
Resolution:

1. Install Dynatrace agent on opt/dynatracexxx/ (*** is your dynatrace agent version) 
2.change the owner of your folder to gateway user 
3.chown -R gateway:gateway opt/dynatracexxx/ 
4.Go to /opt/SecureSpan/Gateway/runtime/etc/profile.d/ 
5. and edit ssgruntimedefs.sh 
Add the line of Dynatrace as the sample bellow 
# LAYER 7 TECHNOLOGIES 
# Defines JAVA_HOME, etc 
default_java_opts="-server " 
if [ ! -f "/etc/sysconfig/network" -o "$(grep "^NETWORKING_IPV6=yes" /etc/sysconfig/network 2>/dev/null)" ] 
then 
default_java_opts="$default_java_opts -Djava.net.preferIPv4Stack=false " 
else 
default_java_opts="$default_java_opts -Djava.net.preferIPv4Stack=true " 
fi 
default_java_opts="$default_java_opts -agentpath:/opt/dynatrace/agent/lib64/libdtagent.so=name=CAP_DES,server=yourDynatraceColectorServer :YourDynatraceColectorPort" 
default_java_opts="$default_java_opts -Djava.security.policy=${SSG_HOME}/runtime/etc/ssg.policy" 
default_java_opts="$default_java_opts -Djava.security.egd=file:/dev/./urandom" 
default_java_opts="$default_java_opts -Dfile.encoding=UTF-8 -Dsun.net.inetaddr.ttl=30 " 
default_java_opts="$default_java_opts -Djava.awt.headless=true -XX:CompileThreshold=1500 " 
default_java_opts="$default_java_opts -Dcom.l7tech.server.defaultClusterHostname=$(hostname)" 
default_java_opts="$default_java_opts -Djava.util.Arrays.useLegacyMergeSort=true" 
SSG_JAVA_OPTS="$SSG_JAVA_OPTS $default_java_opts"; 
unset default_java_opts 
export SSG_JAVA_OPTS 
if ! echo $LD_LIBRARY_PATH | /bin/egrep -s "(^|:)$SSG_HOME/runtime/lib($|:)" >/dev/null ; then 
LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$SSG_HOME/runtime/lib 
fi 
export LD_LIBRARY_PATH 

6.Save the file 
7. Back to Gateway menu and select option 2 and 7 press Enter after show the status like this sample bellow 



CA API Gateway Status 
---------------------------------------------------------------------- 
Configuration: 
Node Status = RUNNING 
Node Status Timestamp = 2018-01-11 10:46:09 
Node Status Since = 2018-01-10 20:33:13 
Press [Enter] to continue. 
and then select option 2 to restart the Gateway Service 
CA API Gateway status options: 
1) Stop the CA API Gateway 
2) Restart the CA API Gateway 
X) Exit menu 
Please make a selection: