On Sat, Jun 19, 2010 at 23:41, Mihael Pranjić <mpranj@limun.org> wrote:
Am 2010-06-19 14:11, schrieb Roman Kyrylych:
Do you suggest to increase sync time to less than 1 hour? Perhaps we could try that.
Yip, I think syncing more often could improve the situation, since it does not really make much more traffic. It's rather a problem if you sync only once a day so the main mirror has to deal with more traffic in less time. Syncing every 15 minutes (on a random minute) could even improve performance since we would sync 100mb now, 100 later, instead of having a dozen servers syncing 200mb at the same time. I could also be wrong.
I see your point. Well, if there are no difficulties for mirrors with using more frequent updates, I see no reason why it should not be possible, especially after we completely turn off rsync access to archlinux.org for all non-tier1 mirrors soon.
However, another result of this (if applied to all mirrors) is that some probably don't sync from the tier-2 mirrors. Say server D syncs from C, C syncs from B, B syncs from A and they do it only once in an hour, could result in a huge time gap between commit on server A (archlinux.org) and sync on server D. In fact, I think this is also important because of our mirroring scheme, concerning that we don't sync from archlinux.org any more - so syncing could take 30 minutes until a new file gets from archlinux.org to an actual mirror from where users update.
Yes, there are some mirrors currently, that use a longer sync chain, but as more mirrors move to 2-tier scheme, I ask admins to sync only from tier1 mirrors (which all sync once per hour). -- Roman Kyrylych (Роман Кирилич)