[arch-mirrors] "symlink has no referent" errors
This problem was fixed before, but it reappeared: Some of the following errors appear on every rsync run:
symlink has no referent: "/linux/archlinux/community/os/x86_64/dwarffortress-0.34.11-5-x86_64.pkg.tar.xz.sig" (in pub) symlink has no referent: "/linux/archlinux/extra/os/x86_64/calligra-libs-2.9.1-1-x86_64.pkg.tar.xz.sig" (in pub) symlink has no referent: "/linux/archlinux/extra/os/x86_64/calligra-plugins-2.9.1-1-x86_64.pkg.tar.xz.sig" (in pub) symlink has no referent: "/linux/archlinux/extra/os/x86_64/calligra-words-2.9.1-1-x86_64.pkg.tar.xz" (in pub) symlink has no referent: "/linux/archlinux/community/os/i686/qcad-3.8.1.0-2-i686.pkg.tar.xz" (in pub) symlink has no referent: "/linux/archlinux/community/os/i686/qcad-3.8.1.0-2-i686.pkg.tar.xz.sig" (in pub) symlink has no referent: "/linux/archlinux/community/os/x86_64/qcad-3.8.1.0-2-x86_64.pkg.tar.xz" (in pub) symlink has no referent: "/linux/archlinux/community/os/x86_64/qcad-3.8.1.0-2-x86_64.pkg.tar.xz.sig" (in pub) It seems it's not always the same, there is some variation, only the dwarffortress-error is there every time and has been for some time. Could these please be fixed? It makes it impossible to quickly tell whether the mirror really has a problem or it's just those errors again, because rsync ALWAYS exits with an error code. -- Michael Meier, FTP-Admin Friedrich-Alexander-Universitaet Erlangen-Nuernberg Regionales Rechenzentrum Erlangen Martensstrasse 1, 91058 Erlangen, Germany Tel.: +49 9131 85-28973, Fax: +49 9131 302941 rrze-ftp-admins@fau.de blogs.fau.de/ftp/
Hi, On 16.03.2015 11:02, Michael Meier (FTP Admin) wrote:
It seems it's not always the same, there is some variation, only the dwarffortress-error is there every time and has been for some time.
As for the dwarffortress error that was a somehow left over symlink. The others were likely just being created when you synced. I'll see if that's the case and if the race condition can be fixed. I now also have a cronjob checking for dead symlinks. Are you still using rsync --copy-links? We are using symlinks to keep bandwidth and sync times low when packages move between repos, but if you use that option you loose that benefit. Also that option causes those errors. If you take it out you'd simply sync broken links without errors. Sorry I didn't notice that the first time. As described in the wiki[1] we suggest "-rtlvH --delete-after --delay-updates --safe-links --max-delete=1000". If possible please try to adapt your options. [1] https://wiki.archlinux.org/index.php/DeveloperWiki:NewMirrors Hope that helps, Florian
On 03/16/2015 11:45 AM, Florian Pritz wrote:
As for the dwarffortress error that was a somehow left over symlink. The others were likely just being created when you synced. I'll see if that's the case and if the race condition can be fixed. I now also have a cronjob checking for dead symlinks.
The window for those should be pretty small though thanks to --delay-updates, shouldn't it? However some seem to be hitting on every sync. Maybe my upstream (gwdg.de) isn't using --delay-updates. I just noticed there is another Tier 1 in .de by leaseweb, I'll try that one instead.
Are you still using rsync --copy-links? As described in the wiki[1] we suggest "-rtlvH --delete-after --delay-updates --safe-links --max-delete=1000". If possible please try to adapt your options.
I noticed the recommended options have changed and just adapted them. Besides --copy-links, the previous exclude for dot-files seems to be no longer recommended as well. It now synced without errors - well, except
Deletions stopped due to --max-delete limit (191203 skipped) which of course isn't surprising, since deletions are skipped when there is an error like the symlink problem... And that has been there for a while, so outdated files probably haven't been deleted in the last few months.
Thanks, -- Michael Meier, FTP-Admin Friedrich-Alexander-Universitaet Erlangen-Nuernberg Regionales Rechenzentrum Erlangen Martensstrasse 1, 91058 Erlangen, Germany Tel.: +49 9131 85-28973, Fax: +49 9131 302941 rrze-ftp-admins@fau.de blogs.fau.de/ftp/
participants (2)
-
Florian Pritz
-
Michael Meier (FTP Admin)