[arch-mirrors] Tier1 speed
Hi, I'm user of Arch since 2007, and the new admin of Unicamp's tier1 mirror, but I'm having issues with poor synchronization speed, causing hours of outdating in medium and big updates. Our link is 1Gbps, and getting only 50-60kb/s syncing with following command: /usr/bin/rsync -rtlvH --delete-after --delay-updates --safe-links --max-delete=1000 --timeout=30 rsync://rsync.archlinux.org/ftp_tier1/ /l/pub/archlinux I can assure it isn't our link load, since others repositories are syncing with 1-6Mb/s (depending on server). Any hint? Thanks, and I hope to help community as much as possible. -- /-=| Δ ŋ đ г Σ |=-\ «» ♫♫♫ https://profiles.google.com/andre.vmatos
Que tal sincronizar de nós (archlinux.c3sl.ufpr.br)? Vai ser beeeem rápido...
Carlos Carvalho (carlos@fisica.ufpr.br) wrote on 8 April 2013 18:07:
Que tal sincronizar de nós (archlinux.c3sl.ufpr.br)? Vai ser beeeem rápido...
Sorry for the post in Portuguese, it was intended to André only and I didn't pay attention...
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 08/04/13 21:36, André Vitor de Lima Matos wrote:
Hi, I'm user of Arch since 2007, and the new admin of Unicamp's tier1 mirror, but I'm having issues with poor synchronization speed, causing hours of outdating in medium and big updates. Our link is 1Gbps, and getting only 50-60kb/s syncing with following command:
That server is rate limited to 50Kbps: https://www.archlinux.org/news/throttling-ftparchlinuxorg-rsyncarchlinuxorg/ I don't know if they have an ACL policy that allows by-passing that (says it's limited to official mirrors) - something one of the Arch folk's would need to answer. That in mind, might have more luck running a sync from another local mirror. Alex -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEcBAEBAgAGBQJRYzVJAAoJEGFhyqw98Adhd8EH/RHEjzqxVddsl436CgWDvTdr 4+OnK6aOudwnIqa1QuxP1Yl1B0kzYhUqufG5mWBWqMZ4XYzBhQt5wRG3hGjYbkQk RQP1jwJ8wjXQWVHvlpc+CdEMS95R/OAMxSgllgEf87vaNXGcUdFisubYZPxAQKK7 QYtSokemP75J1NlkhUKTFJ+6EvWvRUAND2p3XVaQgh8hHRIiQquperOaMKCL4Oq0 8h692gp5GV5G6nj9unpJVM3SS4h4XUcOvaxHO2mEBorMycfR1FjYdeljADYXtoHo 0Yqq3Dep56EKcaGnFnjOEsdksB2UVarlAJMwZV9tMM7tsSToOCRtlym9Q/HYU7k= =NPXI -----END PGP SIGNATURE-----
Em 08-04-2013 18:23, Alex Smith escreveu:
That server is rate limited to 50Kbps: I don't know if they have an ACL policy that allows by-passing that (says it's limited to official mirrors) - something one of the Arch folk's would need to answer. I understand, but, since we're Tier1, I think should be a better solution. As I'm landing now, I don't have e-mails exchanged in mirror setup, that should have original links and configurations for a Tier1 mirror. That's why I'm writing.
-- /-=| Δ ŋ đ г Σ |=-\ «» ♫♫♫ https://profiles.google.com/andre.vmatos
On Mon, Apr 8, 2013 at 4:23 PM, Alex Smith
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
On 08/04/13 21:36, André Vitor de Lima Matos wrote:
Hi, I'm user of Arch since 2007, and the new admin of Unicamp's tier1 mirror, but I'm having issues with poor synchronization speed, causing hours of outdating in medium and big updates. Our link is 1Gbps, and getting only 50-60kb/s syncing with following command:
That server is rate limited to 50Kbps:
https://www.archlinux.org/news/throttling-ftparchlinuxorg-rsyncarchlinuxorg/
I don't know if they have an ACL policy that allows by-passing that (says it's limited to official mirrors) - something one of the Arch folk's would need to answer.
That in mind, might have more luck running a sync from another local mirror.
This is not the same problem. ftp.archlinux.org != rsync.archlinux.org, and hasn't been for at least 5+ years.
Also, Unicamp.br is a *tier 1 mirror*. By definition, that means they wish to (and need to!) sync from our primary server, not another one. This is in the subject of this email. $ host ftp.archlinux.org ftp.archlinux.org has address 209.85.41.143 ftp.archlinux.org has address 209.85.41.144 $ host rsync.archlinux.org rsync.archlinux.org is an alias for nymeria.archlinux.org. nymeria.archlinux.org has address 89.238.67.251 nymeria.archlinux.org has IPv6 address 2a00:1828:2000:547::2 We did move rsync.archlinux.org to being hosted on a different server a few months back, so this is the more likely reason why things got slower. We have noted that traffic is handled at acceptable rates with HTTP, but raw TCP sockets using socat and rsync have notably reduced performance from certain locations. -Dan
Em 08-04-2013 18:32, Dan McGee escreveu:
We did move rsync.archlinux.org http://rsync.archlinux.org to being hosted on a different server a few months back, so this is the more likely reason why things got slower. We have noted that traffic is handled at acceptable rates with HTTP, but raw TCP sockets using socat and rsync have notably reduced performance from certain locations. Thanks for your reply, Dan, but what I should do to avoid a tier1 outdated?
-- /-=| ? ? ? ? ? |=-\ «» ??? https://profiles.google.com/andre.vmatos
On Mon, Apr 8, 2013 at 4:35 PM, André Vitor de Lima Matos
Em 08-04-2013 18:32, Dan McGee escreveu:
We did move rsync.archlinux.org to being hosted on a different server a few months back, so this is the more likely reason why things got slower. We have noted that traffic is handled at acceptable rates with HTTP, but raw TCP sockets using socat and rsync have notably reduced performance from certain locations.
Thanks for your reply, Dan, but what I should do to avoid a tier1 outdated?
How are things looking today? We found an issue with some Path MTU responses or something getting lost, causing TCP connections to constantly scale back. We've temporarily dropped the MTU on our host machine from 1500 to 1470 which has yielded much faster performance in our testing over the last 12 hours. Let me know if you're seeing the same. -Dan
Em 09-04-2013 10:40, Dan McGee escreveu:
How are things looking today? Let me know if you're seeing the same. Problem solved. Getting up to 1.25Mb/s in stable connections (40Mb updates). Thanks very much. I'll keep monitoring, and will let you know if something happens. Regards,
-- /-=| Δ ŋ đ г Σ |=-\ «» ♫♫♫ https://profiles.google.com/andre.vmatos
On Tue, Apr 9, 2013 at 10:53 AM, André Vitor de Lima Matos
Em 09-04-2013 10:40, Dan McGee escreveu:
How are things looking today? Let me know if you're seeing the same. Problem solved. Getting up to 1.25Mb/s in stable connections (40Mb updates). Thanks very much. I'll keep monitoring, and will let you know if something happens.
Great to hear, thanks! To any other mirror admins: please let us know if you are seeing issues and we'll try to investigate any potential path/network/MTU issues. -Dan
participants (4)
-
Alex Smith
-
André Vitor de Lima Matos
-
Carlos Carvalho
-
Dan McGee