Data Mining Services ("Dataminer") has been available as a set of routines for the last several releases of CA Datacom/DB.
The CA Datacom group now has a new version of the Dataminer programs available updated for CA Datacom beginning with Version 11.0. This updated version includes significant new functionality and processing options.
Dataminer provides basic Change Capture and Audit Reporting Services based on the content of the CA Datacom/DB Recovery File (RXX).
The Dataminer service provides three key functions:
- RXX-based Change Capture and RAAT apply process for CA Datacom Source and Target environments
- RXX-based Change Capture and SQL apply process for CA Datacom Source and SQL-able Target environment
- Change audit reporting
The Dataminer RAAT apply process allows you to keep target CA Datacom tables in sync with the source CA Datacom tables, without taking either the source or target tables offline (for recovery processing). This process can be very effective if you have read-only data (such as warehouse environments) that you need to keep in sync with the production but must also be up 24x7.
The Dataminer SQL apply process allows you to capture changes as they occur on the CA Datacom source tables and convert them into standard SQL statements that can be applied on a target DBMS system. The SQL statements are produced regardless of the method used to create the data change in the source CA Datacom environment (RAAT, SAAT, SQL, and Transparency).
The Dataminer audit report process allows you to capture changes and report them as they occur on the CA Datacom source tables. The changes are converted into easily read data files that can be used for customized reporting and querying. A sample audit report is provided with the Dataminer system.
Included in the SQL apply and audit report processes is the Identifier Field process. For each data column that is updated, you can select up to eight other column values from the same row that will be included in the column change record. These additional data values are used to "identify" the row that was changed.
Knowing that WAGES changed from 5.65 to 7.65 is of little value unless you also include the identifying column values such as:
EMPID = 12345 and LASTNAME = "DOE".
The Dataminer SQL change capture and audit report processes can be tailored to limit or adjust the content that will be generated as output. Tailoring that can be done includes:
- Selecting only certain tables to be processed
- Selecting specific columns (on the selected tables)
- Selecting "sub-strings" of existing columns.
Limited data translation capabilities are available to reformat data content from the CA Datacom source to the SQL target or audit report.
Dataminer provides a simple, no-cost, "no-frills" way to capture and report changes for minimal CPU cycles.
For more information on Dataminer, please contact Dale.Russell@ca.com (CA Datacom Sustaining Engineering Manager).
Other Relevant Information:
Dataminer is provided as a set of COBOL programs (and URTs) in source code form. Sample compile and execution JCL is provided for the z/OS environment.
The Dataminer programs are provided by CA Technologies under an agreement with each licensed CA Datacom site. The programs are standard LE COBOL and use supported (published) APIs to access the CA Datacom Datadictionary and the CA Datacom/DB RXX dataset. The Dataminer programs are not supported or warranted by CA Technologies. The user accepts all responsibility for the use of these programs.