The pipeline takes a long time to run. If I misconfigured the save path, it will take a long time to run, and then crash without saving.
I suggest verifying all I/O endpoints before running, and exiting immediately if any of them fail, with a helpful error message.
Things to check:
- redmetrics url
- save path
- nas connection
- any intermediate paths used for saving temp files
- Anything else I don't know about
Bonus points: instead of doing this, wrap writing with logic to safe-save to a known available location (preferably OS-independent - home directory?). If fails to save to the specified path, save to the backup location and print helpful warning message.
The pipeline takes a long time to run. If I misconfigured the save path, it will take a long time to run, and then crash without saving.
I suggest verifying all I/O endpoints before running, and exiting immediately if any of them fail, with a helpful error message.
Things to check:
Bonus points: instead of doing this, wrap writing with logic to safe-save to a known available location (preferably OS-independent - home directory?). If fails to save to the specified path, save to the backup location and print helpful warning message.