WP keep crashing due to a disk failed issue in Database server

Document ID : KB000094877
Last Modified Date : 12/06/2018
Show Technical Document Details
Issue:
Symptoms:

WP keep crashing. If we restart WP, it will reach 100% usage of the last 1 quickly and crash again.

Many Time critical DB call found in the WP log:
01 - 20180419/053125.580 - U00003524 UCUDB: ===> Time critical DB call! OPC: 'EXEC' time: '4:828.318.999'
01 - 20180419/053125.580 - U00003525 UCUDB: ===> 'DELETE FROM XREQ'
01 - 20180419/053941.837 - U00003524 UCUDB: ===> Time critical DB call! OPC: 'EXEC' time: '496:250.497.999'
01 - 20180419/053941.837 - U00029131 UCUDB - List of bind parameters:
01 - 20180419/053941.837 - U00029132 UCUDB: 'AH_TimeStamp4 = 2018-4-19 3:31:25.0'
01 - 20180419/053941.837 - U00029132 UCUDB: 'AH_Status = 1815'
01 - 20180419/053941.837 - U00003525 UCUDB: ===> 'Update AH set AH_TimeStamp4 = ?, AH_Status = ? where AH_TimeStamp4 is null and AH_Idnr not in (Select EH_AH_Idnr from EH)'
01 - 20180419/054237.548 - U00003524 UCUDB: ===> Time critical DB call! OPC: 'EXEC' time: '175:700.795.999'

Investigate:
There is no DB deadlock, but MQ tables increase very quick after start / cold start.
The issue was found as a disk failed (holding some of the oracle data area) in the database server.

Customer's server administrator found one disks which are changing status from healthy to degraded/faulty.
After they fix the disk failed issue, Database performance is better and Automation Engine works normally.
 
Cause:
Database server disk failed
Resolution:
fix the disk failed issue at the database server