OTK Toolkit Installation Failing on 8.4 software install Gateway.

On a 8.4 software Install the Oauth 3.1.1 install may start to slow down and hang. It is also possible at other times the gateway process on a software install will hang and stop working.

the /opt/SecureSpan/Gateway/node/default/var/logs/ssg_0_0.log you will see messages as below.

tail -f of /opt/SecureSpan/Gateway/node/default/var/logs/ssg_0_0.log will show the OTK install ultimately fails with,

016-06-23T02:32:45.052-0400 WARNING 354 com.l7tech.server.policy.bundle.PolicyBundleInstallerAdminAbstractImpl: Exception type: com.l7tech.server.policy.bundle.GatewayManagementDocumentUtilities$UnexpectedManagementResponse 

2016-06-23T02:32:45.052-0400 WARNING 354 com.l7tech.server.policy.bundle.PolicyBundleInstallerAdminAbstractImpl: Unexpected error during installation: Could not get the id for service from bundle with id: #{abb7e4c00c5d9904177a4bfba9ec2ab3} 

2016-06-23T02:32:45.053-0400 WARNING 354 com.l7tech.server.policy.bundle.g: 9920: OTK Installation Problem: Could not get the id for service from bundle with id: #{abb7e4c00c5d9904177a4bfba9ec2ab3} 

But the policy manager UI initiating the install will stay up until you receive a broken pipe failure and this will require a gateway restart to login again. 

The main cause of this is,

The Gateway process generating output on stdout and stderr. If the process generates too much output Linux will suspend the entire process until something reads that output. 

The OVA Virtual Appliance at this version has a different log handler so its not prone to have this fault.

Action required to correct this issue,

First remove the Oauth Toolkit,

Then Goto Policy Manager;

Tasks -> Manage Encapsulated Assertions 

click on the first Encapsulated Assertion, hit shift scroll to the last one and click (Highlight all) Or highlight at least all OTK 

And then choose to remove, 

Choose the OTK Folders in policy manager bottom left pane, right click and remove. 

Second change the piped messages by modifying the gateway.sh as below,

chmod 755 /opt/SecureSpan/Gateway/runtime/bin/gateway.sh 

cp  /opt/SecureSpan/Gateway/runtime/bin/gateway.sh /opt/SecureSpan/Gateway/runtime/bin/backupcopygateway.sh 

vi /opt/SecureSpan/Gateway/runtime/bin/gateway.sh 

Change following line from; 

exec "${SSG_JAVA_HOME}/bin/java" ${JAVA_OPTS} -jar "${SSG_HOME}/runtime/Gateway.jar" "${SSGARGS[@]}" 

to; 

exec "${SSG_JAVA_HOME}/bin/java" ${JAVA_OPTS} -jar "${SSG_HOME}/runtime/Gateway.jar" "${SSGARGS[@]}" > /dev/null 2>&1 

Then restart the gateway process as below.

/opt/SecureSpan/Gateway/runtime/bin/gateway.sh stop

/opt/SecureSpan/Gateway/runtime/bin/gateway.sh start

You should then receive a successful install and without failures.