Data in CABI not current and bucket files not processing

Document ID : KB000120700
Last Modified Date : 30/11/2018
Show Technical Document Details
Issue:
SRM had been running ok in 10.2.3 for some time, then bucket files start piling up in <SPECROOT>/mysql/data/reporting. When running reports, the data is not current. Checking OneClick web page > Administration > Report Manager > Spectrum STATUS, the 'Last Event Time" is not current. 

Checking the OneClick Tomcat log we are seeing some errors like shown here: 

Oct 29, 2018 08:02:50.371 (SRM/NCMConfigHandler/bucketReader) (com.aprisma.spectrum.app.repmgr.dc.event.handler.NCMConfigHandler) - (WARN) - Current configuration model handle is null.
  User Name: Unknown
  Change Time: 2018-10-29 07:19:56.0
Oct 29, 2018 08:02:50.375 (SRM/NCMConfigHandler/bucketReader) (com.aprisma.spectrum.app.repmgr.dc.event.handler.NCMConfigHandler) - (ERROR) - Error occurred while processing NCM event bucket
Caused by: org.springframework.dao.DataIntegrityViolationException: PreparedStatementCallback; SQL []; Column 'config_text_id' cannot be null; nested exception is com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: Column 'config_text_id' cannot be null
    at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:85)
    at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:73)
    at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81)
    at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:660)
    at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:943)
    at org.springframework.jdbc.core.simple.AbstractJdbcInsert.executeInsertAndReturnKeyHolderInternal(AbstractJdbcInsert.java:438)
    at org.springframework.jdbc.core.simple.AbstractJdbcInsert.executeInsertAndReturnKeyInternal(AbstractJdbcInsert.java:419)
    at org.springframework.jdbc.core.simple.AbstractJdbcInsert.doExecuteAndReturnKey(AbstractJdbcInsert.java:386)
    at org.springframework.jdbc.core.simple.SimpleJdbcInsert.executeAndReturnKey(SimpleJdbcInsert.java:137)
    at com.aprisma.spectrum.app.repmgr.dc.db.dao.jdbc.JdbcNCMConfigDAO.insert(Unknown Source)
    at com.aprisma.spectrum.app.repmgr.dc.services.DefaultNCMConfigService.insertConfig(Unknown Source)
    at sun.reflect.GeneratedMethodAccessor242.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
    at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190)
    at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
    at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:99)
    at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:267)
    at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:96)
    at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
    at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:207)
    at com.sun.proxy.$Proxy162.insertConfig(Unknown Source)
    at com.aprisma.spectrum.app.repmgr.dc.event.handler.NCMConfigBucketReader.processBucketRecords(Unknown Source)
    at com.aprisma.spectrum.app.repmgr.dc.event.handler.AbstractBucketReader.readBucket(Unknown Source)
    at com.aprisma.spectrum.app.repmgr.dc.event.handler.BucketReaderScheduler$ScheduledReader.run(Unknown Source)
    at com.aprisma.util.thread.JobQueue.runJobThread(JobQueue.java:221)
    at com.aprisma.util.thread.JobQueue.access$000(JobQueue.java:15)
    at com.aprisma.util.thread.JobQueue$JobRunnable.run(JobQueue.java:24)
    at java.lang.Thread.run(Thread.java:745)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: Column 'config_text_id' cannot be null
    at sun.reflect.GeneratedConstructorAccessor174.newInstance(Unknown Source)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at com.mysql.jdbc.Util.handleNewInstance(Util.java:409)
    at com.mysql.jdbc.Util.getInstance(Util.java:384)
    at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1041)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3562)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3494)
    at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1960)
    at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2114)
    at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2696)
    at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2105)
    at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2398)
    at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2316)
    at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2301)
    at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:101)
    at org.springframework.jdbc.core.JdbcTemplate$3.doInPreparedStatement(JdbcTemplate.java:946)
    at org.springframework.jdbc.core.JdbcTemplate$3.doInPreparedStatement(JdbcTemplate.java:943)
    at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:644)
    ... 26 more

Oct 29, 2018 08:02:50.553 (SRM/NCMConfigHandler/bucketReader) (com.aprisma.spectrum.app.repmgr.dc.event.handler.NCMConfigHandler) - (ERROR) - Critical failure with events; processing halted for all servers.
  Handler Name: NCMConfigHandler
Oct 29, 2018 08:07:44.153 (SRM/EventPoller/lwqpcadss01) (com.aprisma.spectrum.app.repmgr.dc.event.handler.NCMConfigHandler) - (ERROR) - Unable to properly process handler update.
Cause:
There is a known issue in 10.2.3 for this. The fix is provided in a patch for 10.2.3 and is also included in 10.3 BMP :Spectrum_10.03.00.BMP_10.3.001
Resolution:
Contact CA Support for 10.2.3 patch Spectrum_10.02.03.D429
Additional Information:
10.3 BMP patch is available here: https://support.ca.com/us/product-content/recommended-reading/technical-document-index/ca-spectrum-r10-2-solutions-patches.html