[aur-general] Why is aur.archlinux.org so slow? :(
Whenever I try uploading a reasonably large package to aur.archlinux.org, my average speed is around 500KB/s. This appears to be an artificial limitation since a server would have at least 10/10MBits uplink. I therefore request the speed limit to be disabled in order to be able to upload large packages with all available bandwidth to increase productivity. Or is there a reason for the limit? -- Sven-Hendrik
On Fri, Sep 10, 2010 at 01:27:39AM +0200, Sven-Hendrik Haase wrote:
Whenever I try uploading a reasonably large package to aur.archlinux.org, my average speed is around 500KB/s. This appears to be an artificial limitation since a server would have at least 10/10MBits uplink. I therefore request the speed limit to be disabled in order to be able to upload large packages with all available bandwidth to increase productivity.
Or is there a reason for the limit?
-- Sven-Hendrik
I assume it is to lower the load the server has. If you have 10 people uploading a package at one time, it is going to put a harder load on the server if you give them the freedom to upload at any speed they choose. Of course, I don't know how much of load the AUR servers carry, so maybe it was put in place just for security measures, in case somebody tries to spam the server with huge files or something similar. -- Brad
Excerpts from Sven-Hendrik Haase's message of 2010-09-10 01:27:39 +0200:
Whenever I try uploading a reasonably large package to aur.archlinux.org, my average speed is around 500KB/s. This appears to be an artificial limitation since a server would have at least 10/10MBits uplink. I therefore request the speed limit to be disabled in order to be able to upload large packages with all available bandwidth to increase productivity.
Or is there a reason for the limit?
-- Sven-Hendrik
Maybe I misunderstand something here, but my average upload to AUR is 600 Bytes, so the speed really doesn't matter. What do you upload there? -- Philipp -- "Wir stehen selbst enttäuscht und sehn betroffen / Den Vorhang zu und alle Fragen offen." Bertolt Brecht, Der gute Mensch von Sezuan
On Fri, Sep 10, 2010 at 12:50 PM, Philipp Überbacher <hollunder@lavabit.com> wrote:
Excerpts from Sven-Hendrik Haase's message of 2010-09-10 01:27:39 +0200:
Whenever I try uploading a reasonably large package to aur.archlinux.org, my average speed is around 500KB/s. This appears to be an artificial limitation since a server would have at least 10/10MBits uplink. I therefore request the speed limit to be disabled in order to be able to upload large packages with all available bandwidth to increase productivity.
Or is there a reason for the limit?
-- Sven-Hendrik
Maybe I misunderstand something here, but my average upload to AUR is 600 Bytes, so the speed really doesn't matter. What do you upload there? -- Philipp
-- "Wir stehen selbst enttäuscht und sehn betroffen / Den Vorhang zu und alle Fragen offen." Bertolt Brecht, Der gute Mensch von Sezuan
Binary packages like sage-mathematics (over a GiB for both architectures).
On 10/09/10 11:59, Evangelos Foutras wrote:
On Fri, Sep 10, 2010 at 12:50 PM, Philipp Überbacher <hollunder@lavabit.com> wrote:
Excerpts from Sven-Hendrik Haase's message of 2010-09-10 01:27:39 +0200:
Whenever I try uploading a reasonably large package to aur.archlinux.org, my average speed is around 500KB/s. This appears to be an artificial limitation since a server would have at least 10/10MBits uplink. I therefore request the speed limit to be disabled in order to be able to upload large packages with all available bandwidth to increase productivity.
Or is there a reason for the limit?
-- Sven-Hendrik
Maybe I misunderstand something here, but my average upload to AUR is 600 Bytes, so the speed really doesn't matter. What do you upload there? -- Philipp
-- "Wir stehen selbst enttäuscht und sehn betroffen / Den Vorhang zu und alle Fragen offen." Bertolt Brecht, Der gute Mensch von Sezuan
Binary packages like sage-mathematics (over a GiB for both architectures).
AUR isn't a binary repository, all it's intended to store are PKGBUILDs scripts that aid the PKGBUILD .install files, .desktop files, and other small files not including sourcecode.
On Fri, Sep 10, 2010 at 1:10 PM, Nathan Wayde <kumyco@konnichi.com> wrote:
On 10/09/10 11:59, Evangelos Foutras wrote:
On Fri, Sep 10, 2010 at 12:50 PM, Philipp Überbacher <hollunder@lavabit.com> wrote:
Excerpts from Sven-Hendrik Haase's message of 2010-09-10 01:27:39 +0200:
Whenever I try uploading a reasonably large package to aur.archlinux.org, my average speed is around 500KB/s. This appears to be an artificial limitation since a server would have at least 10/10MBits uplink. I therefore request the speed limit to be disabled in order to be able to upload large packages with all available bandwidth to increase productivity.
Or is there a reason for the limit?
-- Sven-Hendrik
Maybe I misunderstand something here, but my average upload to AUR is 600 Bytes, so the speed really doesn't matter. What do you upload there? -- Philipp
-- "Wir stehen selbst enttäuscht und sehn betroffen / Den Vorhang zu und alle Fragen offen." Bertolt Brecht, Der gute Mensch von Sezuan
Binary packages like sage-mathematics (over a GiB for both architectures).
AUR isn't a binary repository, all it's intended to store are PKGBUILDs scripts that aid the PKGBUILD .install files, .desktop files, and other small files not including sourcecode.
sure it it, that is where the community repo is stored... Ronald
On 10/09/10 12:17, Ronald van Haren wrote: [...]
sure it it, that is where the community repo is stored...
Ronald
I'm not sure I follow you. The community repo AFAIK is just like the other official except that it and community-testing is managed by TUs while the others are managed by the Arch devs. That fact is still irrelevant however, as users can't upload anything to any of the repos. Users don't even use from ftp.archliux.org as a mirror - or at least the idea is that they shouldn't.
On Fri, Sep 10, 2010 at 1:22 PM, Nathan Wayde <kumyco@konnichi.com> wrote:
On 10/09/10 12:17, Ronald van Haren wrote: [...]
sure it it, that is where the community repo is stored...
Ronald
I'm not sure I follow you. The community repo AFAIK is just like the other official except that it and community-testing is managed by TUs while the others are managed by the Arch devs.
You do notice that half of the people, including the one started this thread is either TU, DEV, or both? Packages to the community repo are uploaded to the aur.archlinux.org server, whereas packages for the official repos are uploaded to gerolde.archlinux.org.
That fact is still irrelevant however, as users can't upload anything to any of the repos. Users don't even use from ftp.archliux.org as a mirror - or at least the idea is that they shouldn't.
Well, as said,Sven-Hendrik is a TU. Ronald
On 10.09.2010 13:22, Nathan Wayde wrote:
Users don't even use from ftp.archliux.org as a mirror - or at least the idea is that they shouldn't.
ftp.archlinux.org is NOT a special mirror. It's just a normal one and someone decided to create a dns entry. Could we please removed that entry? It causes quite some confusion. -- Florian Pritz -- {flo,bluewind}@server-speed.net
Excerpts from Evangelos Foutras's message of 2010-09-10 12:59:50 +0200:
On Fri, Sep 10, 2010 at 12:50 PM, Philipp Überbacher <hollunder@lavabit.com> wrote:
Excerpts from Sven-Hendrik Haase's message of 2010-09-10 01:27:39 +0200:
Whenever I try uploading a reasonably large package to aur.archlinux.org, my average speed is around 500KB/s. This appears to be an artificial limitation since a server would have at least 10/10MBits uplink. I therefore request the speed limit to be disabled in order to be able to upload large packages with all available bandwidth to increase productivity.
Or is there a reason for the limit?
-- Sven-Hendrik
Maybe I misunderstand something here, but my average upload to AUR is 600 Bytes, so the speed really doesn't matter. What do you upload there? -- Philipp
-- "Wir stehen selbst enttäuscht und sehn betroffen / Den Vorhang zu und alle Fragen offen." Bertolt Brecht, Der gute Mensch von Sezuan
Binary packages like sage-mathematics (over a GiB for both architectures).
Sage is in community in the meanwhile, and afair the sage-mathematics-bin package did download a debian or ubuntu package from somewhere. -- Philipp -- "Wir stehen selbst enttäuscht und sehn betroffen / Den Vorhang zu und alle Fragen offen." Bertolt Brecht, Der gute Mensch von Sezuan
On Fri, Sep 10, 2010 at 1:59 PM, Evangelos Foutras <foutrelis@gmail.com> wrote:
On Fri, Sep 10, 2010 at 12:50 PM, Philipp Überbacher <hollunder@lavabit.com> wrote:
Excerpts from Sven-Hendrik Haase's message of 2010-09-10 01:27:39 +0200:
Whenever I try uploading a reasonably large package to aur.archlinux.org, my average speed is around 500KB/s. This appears to be an artificial limitation since a server would have at least 10/10MBits uplink. I therefore request the speed limit to be disabled in order to be able to upload large packages with all available bandwidth to increase productivity.
Or is there a reason for the limit?
-- Sven-Hendrik
Maybe I misunderstand something here, but my average upload to AUR is 600 Bytes, so the speed really doesn't matter. What do you upload there? -- Philipp
-- "Wir stehen selbst enttäuscht und sehn betroffen / Den Vorhang zu und alle Fragen offen." Bertolt Brecht, Der gute Mensch von Sezuan
Binary packages like sage-mathematics (over a GiB for both architectures).
Looks like my message was misunderstood. I was referring to binary packages that get uploaded to [community]. These uploads are handled by the aur.archlinux.org server, which also happens to host the AUR. However, the AUR is not involved in this process, as uploads to [community] are done via SSH. The issue discussed in this thread is the fact that the server seems to have a bandwidth cap and thus uploads to it are restricted to ~500kB/s.
On 10/09/10 12:28, Evangelos Foutras wrote: [...]
Looks like my message was misunderstood. I was referring to binary packages that get uploaded to [community]. These uploads are handled by the aur.archlinux.org server, which also happens to host the AUR. However, the AUR is not involved in this process, as uploads to [community] are done via SSH.
The issue discussed in this thread is the fact that the server seems to have a bandwidth cap and thus uploads to it are restricted to ~500kB/s.
oh, that makes sense. for a minute there i thought you were talking about the AUR.
On 10 September 2010 19:30, Nathan Wayde <kumyco@konnichi.com> wrote:
oh, that makes sense. for a minute there i thought you were talking about the AUR.
The mention of "aur.archlinux.org" was rather misleading. At first glance I thought it was about the AUR too. When I noticed the use of "package to" rather than "package in", I realised it's actually refering to the alias for sigurd.archlinux.org, the [community] machine. It's normal for anyone other than a TU to have misunderstood.
On Fri, Sep 10, 2010 at 1:28 PM, Evangelos Foutras <foutrelis@gmail.com> wrote:
On Fri, Sep 10, 2010 at 1:59 PM, Evangelos Foutras <foutrelis@gmail.com> wrote:
On Fri, Sep 10, 2010 at 12:50 PM, Philipp Überbacher <hollunder@lavabit.com> wrote:
Excerpts from Sven-Hendrik Haase's message of 2010-09-10 01:27:39 +0200:
Whenever I try uploading a reasonably large package to aur.archlinux.org, my average speed is around 500KB/s. This appears to be an artificial limitation since a server would have at least 10/10MBits uplink. I therefore request the speed limit to be disabled in order to be able to upload large packages with all available bandwidth to increase productivity.
Or is there a reason for the limit?
-- Sven-Hendrik
Maybe I misunderstand something here, but my average upload to AUR is 600 Bytes, so the speed really doesn't matter. What do you upload there? -- Philipp
-- "Wir stehen selbst enttäuscht und sehn betroffen / Den Vorhang zu und alle Fragen offen." Bertolt Brecht, Der gute Mensch von Sezuan
Binary packages like sage-mathematics (over a GiB for both architectures).
Looks like my message was misunderstood. I was referring to binary packages that get uploaded to [community]. These uploads are handled by the aur.archlinux.org server, which also happens to host the AUR. However, the AUR is not involved in this process, as uploads to [community] are done via SSH.
The issue discussed in this thread is the fact that the server seems to have a bandwidth cap and thus uploads to it are restricted to ~500kB/s.
are you sure about this? Isn't it related to your connection, how many hubs it uses and the way it travels to the other side of the ocean? I remember that before I moved houses last December I got a reasonable upspeed (I think it was faster than 500 kB/s but I'm not sure), nowadays I most of the time don't even come close to 500 kB/s. I usually blame my connection for it. Well, you would have to ask one of the server guys, they probably know better, I'm not sure they read this list. Ronald
On Fri, Sep 10, 2010 at 2:33 PM, Ronald van Haren <pressh@gmail.com> wrote:
The issue discussed in this thread is the fact that the server seems to have a bandwidth cap and thus uploads to it are restricted to ~500kB/s.
are you sure about this? Isn't it related to your connection, how many hubs it uses and the way it travels to the other side of the ocean? I remember that before I moved houses last December I got a reasonable upspeed (I think it was faster than 500 kB/s but I'm not sure), nowadays I most of the time don't even come close to 500 kB/s. I usually blame my connection for it. Well, you would have to ask one of the server guys, they probably know better, I'm not sure they read this list.
Ronald
I'm not sure, no. Unfortunately, my home connection tops out at 50kB/s, but the ~500kB/s figure comes from older uploads I had done from pkgbuild.com, back when it was hosted on a Linode VPS. I remember that the speed remained constant throughout the upload process, so a 5Mb/s cap isn't unreasonable to assume. Maybe Loui or Dan [1] would know more. I'll try asking them if I catch them on IRC or Jabber (respectively ;p). [1] http://wiki.archlinux.org/index.php/DeveloperWiki:Sigurd_%28TU%29
On 10.09.2010 13:44, Evangelos Foutras wrote:
I'm not sure, no. Unfortunately, my home connection tops out at 50kB/s, but the ~500kB/s figure comes from older uploads I had done from pkgbuild.com, back when it was hosted on a Linode VPS. I remember that the speed remained constant throughout the upload process, so a 5Mb/s cap isn't unreasonable to assume.
Sevenl also offers 5Mbit unmetered for their normal dedicated server so this seems highly likely. -- Florian Pritz -- {flo,bluewind}@server-speed.net
On 10 September 2010 13:33, Ronald van Haren <pressh@gmail.com> wrote:
On Fri, Sep 10, 2010 at 1:28 PM, Evangelos Foutras <foutrelis@gmail.com> wrote:
On Fri, Sep 10, 2010 at 1:59 PM, Evangelos Foutras <foutrelis@gmail.com> wrote:
On Fri, Sep 10, 2010 at 12:50 PM, Philipp Überbacher <hollunder@lavabit.com> wrote:
Excerpts from Sven-Hendrik Haase's message of 2010-09-10 01:27:39 +0200:
Whenever I try uploading a reasonably large package to aur.archlinux.org, my average speed is around 500KB/s. This appears to be an artificial limitation since a server would have at least 10/10MBits uplink. I therefore request the speed limit to be disabled in order to be able to upload large packages with all available bandwidth to increase productivity.
Or is there a reason for the limit?
-- Sven-Hendrik
Maybe I misunderstand something here, but my average upload to AUR is 600 Bytes, so the speed really doesn't matter. What do you upload there? -- Philipp
-- "Wir stehen selbst enttäuscht und sehn betroffen / Den Vorhang zu und alle Fragen offen." Bertolt Brecht, Der gute Mensch von Sezuan
Binary packages like sage-mathematics (over a GiB for both architectures).
Looks like my message was misunderstood. I was referring to binary packages that get uploaded to [community]. These uploads are handled by the aur.archlinux.org server, which also happens to host the AUR. However, the AUR is not involved in this process, as uploads to [community] are done via SSH.
The issue discussed in this thread is the fact that the server seems to have a bandwidth cap and thus uploads to it are restricted to ~500kB/s.
are you sure about this? Isn't it related to your connection, how many hubs it uses and the way it travels to the other side of the ocean? I remember that before I moved houses last December I got a reasonable upspeed (I think it was faster than 500 kB/s but I'm not sure), nowadays I most of the time don't even come close to 500 kB/s. I usually blame my connection for it. Well, you would have to ask one of the server guys, they probably know better, I'm not sure they read this list.
Ronald
I'm pretty sure it was faster when I was uploading a file but it wasn't anywhere near to my top upload speed so there is certainly some limit. I'll test the speed when I get access to the archlinux.org page because I don't want to fill community with orphans. Lukas
On 10.09.2010 14:26, Lukáš Jirkovský wrote:
limit. I'll test the speed when I get access to the archlinux.org page because I don't want to fill community with orphans.
You can use netcat/socat. They are installed. -- Florian Pritz -- {flo,bluewind}@server-speed.net
On 10 September 2010 14:29, Florian Pritz <bluewind@server-speed.net> wrote:
On 10.09.2010 14:26, Lukáš Jirkovský wrote:
limit. I'll test the speed when I get access to the archlinux.org page because I don't want to fill community with orphans.
You can use netcat/socat. They are installed.
-- Florian Pritz -- {flo,bluewind}@server-speed.net
Heh, I never used socat.
participants (9)
-
Brad Fanella
-
Evangelos Foutras
-
Florian Pritz
-
Lukáš Jirkovský
-
Nathan Wayde
-
Philipp Überbacher
-
Ray Rashif
-
Ronald van Haren
-
Sven-Hendrik Haase