Some jobs are getting aborted daily within a specific time.

Document ID : KB000084798
Last Modified Date : 14/04/2018
Show Technical Document Details
Issue:
Affects Release version(s): 5

Error Message :
The following error messages are present in universe.log: 

====================================================================================== 
<< 2014-01-20 05:03:10 0002038/uxshw /CALL_UXIOSRV /000000000 - u_io_callsrv(on uni-fin,PROD50,X) returns error -1 
<< 2014-01-20 05:03:10 0002038/uxshw /GAAPIUSR /134459202 - %UNI_-E-U_EGAT05B3207, Update to an unknown User 
<< 2014-01-20 05:03:10 0002043/uxshw /u_io_callsrv /000000000 - u_connect error : Errno syserror 99: Cannot assign requested address (host [finuniv-prod-01]) 
======================================================================================  

Patch level detected:Dollar Universe 5.3.3
Product Version: Dollar.Universe 5.3.3 FX25002

In this example, the issue occurs between 5:00 and 5:30 AM everyday.

The connection to the IO server can increase dramatically. In our example, from 1K to 27K in less a few seconds (less than 10 seconds) using the netstat command while greping for the IO server's port number (ex: 10600).

The high volume of connections to the IO server causes the system to run out of available TCP connection.
Environment:
OS: All
Cause:
Root Cause: N/A
Resolution:
Check if there's a Dollar Universe job or cron job that uses Dollar Universe commands that is launched multiple times(thousands times).

If there is, then check to see if it is necessary.

If it is not, you may need to stop the job.

If it is necessary, check with your system administrator on how to make ensure that the machine can handle/provide more TCP connections.

Fix Status: No Fix
 
Additional Information:
Workaround :
N/A