ILM: Partition Change fails in version 12.1 where Java Server Process is active

Document ID : KB000084400
Last Modified Date : 14/04/2018
Show Technical Document Details
Issue:
Error Message :
This is just a short excerpt from the PWP logfile, please be aware that the following ILM related messages are just an example and may vary
...
U00005305 ILM: 'ALTER TABLE UC4.AFC SPLIT PARTITION "132" AT (1188645000) INTO (PARTITION "132", PARTITION "133" TABLESPACE UC4_ILM13)'
U00005305 ILM: 'ALTER TABLE UC4.XRO SPLIT PARTITION "132" AT (1188645000) INTO (PARTITION "132", PARTITION "133" TABLESPACE UC4_ILM13)'
U00005305 ILM: 'ALTER TABLE UC4.APDC SPLIT PARTITION "132" AT (1188645000) INTO (PARTITION "132", PARTITION "133" TABLESPACE UC4_ILM13)'
U00005305 ILM: 'ALTER TABLE UC4.AJPOP SPLIT PARTITION "132" AT (1188645000) INTO (PARTITION "132", PARTITION "133" TABLESPACE UC4_ILM13 LOB ("AJPOP_VALUE") STORE
...
U00029108 UCUDB: SQL_ERROR Database handles DB-HENV: 11005bf50 DB-HDBC: 11008e1d0
U00003591 UCUDB - DB error info: OPC: 'OCIStmtExecute' Return code: 'ERROR'
U00003592 UCUDB - Status: '' Native error: '54' Msg: 'ORA-00054: resource busy and acquire with NOWAIT specified or timeout expired'
U00000005 LOCK
U00005334 ILM: Server processing will be continued.
U00005323 WARNING: ==ILM-REDO-MODE== Due to a possible Server crash some ILM statements could not be processed. They will be executed now.
U00005333 ILM: Server processing will be halted. Option: ' '
...

The Information Lifecycle Management (ILM) Partition Change (Partition Switch) fails in version 12.1 when a Java Server Process (JWP or JCP) is active.
 
The Java Server Processes doesn’t stop performing database actions on the tables covered by ILM during the Partition Change. Therefore, Change (aka Switch or Split) might fail and ILM is deactivated.

Since there is no impact on the automation, this fact that the ILM stops might be overlooked easily.
 
Note:  This issue can appear in all previous released versions of AE 12.1.0 HF4.

 
Environment:
OS Version: N/A
Cause:
Cause type:
Defect
Root Cause: Bug, Java Server Processes are not paused during the Partition Change.
Resolution:
Update to a fix version listed below or a newer version if available.
 

Fix Status: Released

Fix Version(s):
Component(s): AE Server and Initialdata

Automation Engine 12.1.0 HF4 - Available
Additional Information:
Workaround :
The ILM Partition Change works, in cases where no Java Server Process is active. So there is an easy workaround:
  1. Stop all JWP, and JCP Processes (on all nodes) during the ILM action for a few minutes.
For instance, stop those processes 3 minutes before the ILM switch is performed and start them afterwards.

This can be done manually via the Administration Perspective or via the Service Manager Dialog.
 
It’s also possible to use the MODIFY_SYSTEM Script Function to perform the necessary steps (start and stop the JWP, and JCP processes) automatically.

Resource

Further details can be found in the online documentation, where the Script Function MODIFY_SYSTEM is described in detail.

Automation Engine 12.1 Documentation:
Automic Scripting Guide > Ordered by Function > System Conditions and Settings > MODIFY_SYSTEM