CA Spectrum Archive Manager continually going down with errors

Document ID : KB000049797
Last Modified Date : 14/02/2018
Show Technical Document Details

Description:

Archive Manager will go down or seemingly crash with errors in the $SPECROOT/SS/DDM/ARCHMGR.OUT file regarding "MySQL Server Gone Away" or "Failure Executing Query" - both are also possible.

Solution:

This issue is resolved with Spectrum debug patch D202 for Spectrum version 9.2.1 and PTF (Program Temporary Fix) patch PTF_H0601 for Spectrum version 9.2.1 with hotfix patch H06, please contact CA Support to get either of these patches.

After installing one of the above mentioned patches, two configuration files will need to edited following these steps on Windows operating systems only:

  1. Save a copy of the $SPECROOT/mysql/my-spectrum.cnf file to a backup location, or add .orig to a copy of it.
  2. In the $SPECROOT/mysql/my-spectrum.cnf file add the following line to the [mysqld] section. This setting will force MySQL to use a shared-memory connection:

    shared-memory
    This line is not commented out.

    Example my-spectrum.cnf file contents:

    # Spectrum mysql config file.
    # This will be passed to all mysql clients
    [client]
    port=3306
    #socket=MySQL
    # The MySQL server
    [mysqld]
    shared-memory
    port=3306
    #socket=MySQL
    basedir = c:/win32app/spectrum/mysql
    tmpdir = c:/win32app/spectrum/mysql/tmp
    #log-slow-queries
    #long_query_time = 10
    #skip-innodb
    innodb_file_per_table
    innodb_buffer_pool_size = 256M
    innodb_log_file_size = 256M
    innodb_log_buffer_size = 4M

  1. Save a copy of the $SPECROOT/SS/DDM/.configrc file to a backup location or add .orig to a copy of it.
  2. Add the following lines to the $SPECROOT/SS/DDM/.configrc file:

    DDM_DATABASE_HOSTNAME=localhost
    DDM_DATABASE_PORT=0

    Example .configrc file conents:

    DDM_SOCKET_NUMBER=0xddec
    ARCH_MGR_SOCKET_NUMBER=0xbafe
    MAX_STAT_DAYS=45
    MAX_EVENT_DAYS=45
    LANDSCAPE_PRECEDENCE=10
    TIME_TOLERANCE_IN_SECONDS=300
    DDM_DATABASE_NAME=ddmdb
    DDM_DATABASE_USERNAME=spectrum
    DDM_DATABASE_HOSTNAME=localhost
    DDM_DATABASE_PASSWORD=spectrum
    orb_args=-Dvbroker.se.iiop_tp.scm.iiop_tp.listener.port=14003 -ORBpropStorage ../../.corbarc
    DDM_DATABASE_PORT=0

Save the files and restart both MySQL and the Archive Manager.

After MySQL and the Archive Manager are running, the changes can be validated by doing the following:

Run 'netstat -ano | grep 3306'. Notice that the Archive Manager process id (PID) is now listed as ArchMgr and is now using a shared-memory connection instead of sockets.

Example:

Archive Manager PID is 5284

Figure 1

> netstat -ano | grep 3306

 TCP    0.0.0.0:3306           0.0.0.0:0              LISTENING       5900
 TCP    127.0.0.1:3306         127.0.0.1:58763        ESTABLISHED     5900
 TCP    127.0.0.1:3306         127.0.0.1:58838        ESTABLISHED     5900
 TCP    127.0.0.1:58763        127.0.0.1:3306         ESTABLISHED     8024
 TCP    127.0.0.1:58838        127.0.0.1:3306         ESTABLISHED     8024

Note there is no 5284, which validates shared-memory is being used.