On Sun, 13 Nov 2022 at 18:43, Jelle van der Waa <jelle@archlinux.org> wrote:
* Do we have enough disk space for archiving?
You have to take gemini's daily backups into consideration as well. They already take up a lot of backup space [1] and several hours to finish every day. I can see gemini falling over if we start processing and storing a lot more sources on it. # journalctl -o cat --since -5d --grep Duration -u borg-backup Duration: 4 hours 55 minutes 12.55 seconds Duration: 4 hours 21 minutes 40.80 seconds Duration: 4 hours 34 minutes 10.01 seconds Duration: 4 hours 41 minutes 27.67 seconds Duration: 5 hours 24 minutes 44.55 seconds # journalctl -o cat --since -5d --grep Duration -u borg-backup-offsite Duration: 4 hours 9 minutes 2.50 seconds Duration: 4 hours 24 minutes 19.42 seconds Duration: 4 hours 40 minutes 17.96 seconds Duration: 5 hours 33 minutes 47.30 seconds Duration: 8 hours 2 minutes 20.43 seconds td;dr: Best to wait until the daily backup duration drops by a lot, perhaps after more efficient package archiving is implemented (as part of repod?). The current hardlink-based archive is very disk I/O heavy (consists of over 61 million inodes). [1] borg repo size grew from 4.69 TiB on May 13th to 5.86 TiB currently; trimming the archive once a year helps a bit but the upward trend persists