Conversion of new data with SAACR_raw2data can slow down considerably over time as historic data accumulates. The processing time for new data can be significantly improved while retaining all historic data values by creating an archive.

NOTE: You should be familiar with processing data with SAACR_raw2data before trying to follow the instructions in this guide. Please refer to the SAACR_raw2data How-To Guide for more information.



Step 1 - Create an 'archive' Folder


Raw data processed with SAACR_raw2data will produce a multi_saa_allcart.mat file in the project folder containing the logger project files. The first step to creating an archive to improve processing speed of large data sets is to create a folder named 'archive' in the project folder.

NOTE: The 'archive' folder's name should use all lowercase letters.


Figure 1: Create an 'archive' folder in the project folder



Step 2 - Move the multi_saa_allcart.mat File to the Archive Folder and Rename It


Once the archive folder has been created, you need to move the multi_saa_allcart.mat file from the project folder to the newly created archive folder. Once moved to the archive folder, the file must be renamed to multi_saa_allcart_archive.mat.


Figure 2: Rename the multi_saa_allcart.mat file to multi_saa_allcart_archive.mat



Step 3 - Backup and Then Delete the Raw Data Files From the Project Folder


From the project folder, backup all of the SAA#_DATA.dat files to another location. You should then delete the SAA#_DATA.dat files in the project folder. A new copy of these files containing only the data that is currently on the logger will be generated when your next data collection occurs. Because the newly generated SAA#_DATA.dat files will contain much less data than the previous ones, processing with SAACR_raw2data will be much faster.

NOTE: If you copied the multi_saa_allcart.mat file to the archive folder instead of moving it in the previous step, you should delete it from the project folder at this time.


Figure 3: After creating the multi_saa_allcart_archive.mat file, delete the SAA#_DATA.dat and multi_saa_allcart.mat files from the project folder


After the three steps described above have been completed, the next conversion of the project data will retrieve the historical data from the archive folder and append newly collected data to it to create a new multi_saa_allcart.mat file containing all of the data. This process should be considerably faster if there was a large amount of historical data.