The purpose of this Test Bed was to develop a test environment where the Indexing Initiative team could test out "real-time" processing and handling of the Office of Computer and Communications Systems (OCCS) XML (eXtensible Markup Language) formatted data files. The idea was to use the existing Medical Article Record System (MARS) automated data flow to OCCS as a platform to simulate the interaction with OCCS and allow the Indexing Initiative team to finalize development of a system that will eventually interface directly with OCCS.
Goals of the Test Bed:
The system must be able to handle the test bed flow without hesitation, be able to run without human monitoring, provide near 100% uptime, and provide 100% accuracy integrating our recommendations into the existing data file without injecting inconsistencies in the data file.
The Test Bed:
The test bed involved the following:
Transmittal of final validated XML based file from MARS to MTI at approximately the same time as they are transmitted to OCCS.
Automatic detection and validation of the MARS transmitted file by the MTI.
Processing and final recommendations made by the MTI and reintegrated into the MARS file.
MTI Validation prior to transmittal back to MARS.
MTI transmittal of the file back to MARS.
MARS validation of the file from MTI - offline from production system. Batch processed with email every couple of days -- more frequently at beginning, tapering off towards the end of the experiment.
Verification of receipt
Validation of file format to ensure that no inconsistencies were added to the file.
Transmittal of MARS validation report back to MTI denoting any deficiencies found.
Results of the Test:
Overall, the MTI worked as planned. We were able to identify batch files sent from MARS, validate the input files, process all of the citations from the batch files, identify and integrate our recommendations, validate our reintegrated file, and transfer the batch files (now with MTI recommendations) back to MARS on average in less than five (5) minutes time.
The Indexing Initiative team has also developed the following as a result of the test bed creation:
A working XML (eXtensible Markup Language) DTD (Document Type Definition) that is 100% compatible with the current NLM DTD.
An integrated XML/DTD validator.
Valuable information was also garnered as to "normal" operating procedures to expect in a production environment. We were able to identify typical batch sizes, beginning and ending of processing day, and that jobs are sporadic throughout the day versus all showing up at the end of day.