Age | Commit message (Collapse) | Author | |
---|---|---|---|
2022-12-17 | Optimized 'archiver' script with clever use of awkmain | Adam M. Stück | |
Seems to run about 4 times faster now. Which is a decent time save when running the script on the cluster. Uses a magic awk command to concatenate all raw .csv files (excluding their headers). This replaces the old way which consisted of reading each file, trimming the header, and appending the lines to a HUGE variable. | |||
2022-12-16 | fix: archiver find command options order | Adam M. Stück | |
-maxdepth option must come first archiver will also now overwrite an exiting data.csv | |||
2022-12-16 | Archiver now only looks at job data (*.csv) | Adam M. Stück | |
This fixes an issue where the generated data.csv contains text from non-job data files such as *.hardwareinfo | |||
2022-12-16 | Improved file structure | Adam M. Stück | |