summaryrefslogtreecommitdiff
path: root/archiver
AgeCommit message (Collapse)Author
2022-12-17Optimized 'archiver' script with clever use of awkmainAdam M. Stück
Seems to run about 4 times faster now. Which is a decent time save when running the script on the cluster. Uses a magic awk command to concatenate all raw .csv files (excluding their headers). This replaces the old way which consisted of reading each file, trimming the header, and appending the lines to a HUGE variable.
2022-12-16fix: archiver find command options orderAdam M. Stück
-maxdepth option must come first archiver will also now overwrite an exiting data.csv
2022-12-16Archiver now only looks at job data (*.csv)Adam M. Stück
This fixes an issue where the generated data.csv contains text from non-job data files such as *.hardwareinfo
2022-12-16Improved file structureAdam M. Stück