[arch-dev-public] Arch mirrors

[Roman Kyrylych]

2007/9/18, Roman Kyrylych <roman.kyrylych at gmail.com>:
> 2007/9/18, eliott <eliott at cactuswax.net>:
> > On 9/18/07, Roman Kyrylych <roman.kyrylych at gmail.com> wrote:
> > > 2007/9/17, Dan McGee <dpmcgee at gmail.com>:
> > > > On 9/17/07, Simo Leone <simo at archlinux.org> wrote:
> > > > > On Mon, Sep 17, 2007 at 10:58:37AM -0700, eliott wrote:
> > > > > > There is a FS ticket for part of this thread:
> > > > > > http://bugs.archlinux.org/task/7006
> > > > > >
> > > > > > I support changing the link on the downloads page to reference the wiki.
> > > > > > This would, however, allow end users to modify the mirror page thus
> > > > > > changing the mirror list in a way that may be seen as more 'official'.
> > > > > >
> > > > > > We could perhaps lock the mirrors page, but that semi-defeats the
> > > > > > purpose of the change control suggestion.
> > > > > >
> > > > > > Any thoughts or feedback of a high caliber?
> > > > > >
> > > > > I'd rather have the static mirror page for the reasons you mentioned. It
> > > > > seems kind of... open... to have a wikified mirror page.
> > > > >
> > > > > If someone wants to add a mirror, it's not that hard to mail one of us
> > > > > and ask to have it added/removed/whatever, which amounts to the same
> > > > > thing as a locked wiki page, except the non-wiki page is prettier 8)
> > > > >
> > > > > -S
> > > >
> > > > Can we get http/ftp/rsync availability at least on the offical page? A
> > > > nice table would do the trick:
> > > >
> > > > /***************|***********|**************|*************\
> > > > mirror      | http   | ftp | rsync \
> > > > foo.bar.com | <a href="http://...">HTTP</a> | <a href="ftp://.."> ........
> > > >
> > > > You get the point. It shouldn't be very hard to write a little script
> > > > that tests the current list of mirrors we have for availability of
> > > > these three services.
> > >
> > > Well, this info is already provided on our wiki, so if someone will
> > > modify /download/ page manually then this can be entered as well.
> > > We cannot use pacman mirrorlist directly, because not all mirrors have
> > > isos on them (or if there will be a script for checking ftp/http/rsync
> > > - it should check for latest isos too).
> >
> > I will certainly update the /download/ page, but we first need to
> > decide which mirrors to include on the download page (are they all
> > valid and dev authorized?).
>
> They are 99% the same as in pacman.d/* (just a little more up-to-date).
> But not all of them have iso/ directory (or some have very outdated
> isos) - this is noted on wiki page right after mirror's URL.
>
> >
> > Then I need somebody to put the mirrors into a reasonable format for
> > me. I don't have the time to get all the data in a usable format AND
> > update the page. If somebody can do the legwork for me, I will
> > certainly do the backend change.
> >
> > A nice format would be..
> >
> > ftp_url  |  http_url  |  Country
> >
>
> I'll try to find time for this. Probably even tomorrow.
>

OK, done now. That was not easy task for such lazy guy as me. :-P
I'm attaching mirrors.txt file for you, Eliott.
The format is: FtpUrl | HttpUrl | RsyncUrl | Country
Note that FTP and HTTP URLs are not same in all cases (Brazillian mirror).

I also checked the entire pacman's mirrorlist and here's what I've found:

1) http://archlinux.c3sl.ufpr.br/ is also available via FTP as
ftp://archlinux.c3sl.ufpr.br/archlinux/ (note the archlinux
subdirectory)

http://mirrors.easynews.com/linux/archlinux/ is also available via FTP.

ftp://ftp-linux.cc.gatech.edu/pub/linux/distributions/archlinux/ is
not available but
http://ftp-linux.cc.gatech.edu/pub/linux/distributions/archlinux/
works.

2) some mirrors don't work:
  ftp://ftp.rez-gif.supelec.fr/pub/Linux/distrib/archlinux/ - cannot connect
  ftp://saule.mintis.lt/pub/linux/ - pub/ is empty
  ftp://mirror.djzradio.net/archlinux/ - domain does not exist anymore
  ftp://gul.est.ips.pt/repos/archlinux/ - cannot connect
  ftp://darkstar.ist.utl.pt/pub/archlinux/ - cannot connect

I think we should also forbid rsyncing from their (ex-)IPs.

3) there are some mirrors of ibiblio.org - I think we could get all
those that have distributions/archlinux directory to the pacman's
mirrorlist but place a notice that they are syncing from ibiblio.org,
not from archlinux.org (so there may be longer sync intervals than
from other mirrors).

4) questionable mirrors:
  http://archlinux.freeside.ru/ - has current (sic), extra and
community only, outdated
  ftp://ftp.linux.kiev.ua/pub/Linux/ArchLinux/ - up to date but i686
only, no new isos.

5) There are 2 new good mirrors:
  ftp://archlinux.org.ru/pub/archlinux/ (Russia)
  http://server.elsistech.com/archlinux/ (Turkey)
I've added them to mirrors.txt but not to mirrorlist.in yet.
I've talked with Russian admin and he will contact you after testing
period ends, Eliott.
The Turkish mirror was added to the wiki just yesterday.

It seems that http://mir.archlinux.fr/ is a round-robin HTTP-only
redirect to other two French mirrors, so I didn't add it to any list.

I've attached a modified mirrorlist.in file with all fixes mentioned
above for you, Dan (sorry, I cannot provide patch now).
Be sure to check those "cannot connect" mirrors and add them back if they work.

-- 
Roman Kyrylych (Роман Кирилич)
-------------- next part --------------
A non-text attachment was scrubbed...
Name: mirrorlist.in
Type: application/octet-stream
Size: 3184 bytes
Desc: not available
URL: <http://archlinux.org/pipermail/arch-dev-public/attachments/20070926/c36b0eda/attachment.obj>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: mirrors.txt
URL: <http://archlinux.org/pipermail/arch-dev-public/attachments/20070926/c36b0eda/attachment.txt>