- Arch-mirrors - lists.archlinux.org

mirrors.xtom.de issue
by Amin Vakil 17 Sep '23

17 Sep '23

Hi, I'm just a normal user using mirrors.xtom.de, in the past few days there have been some problems with this mirror. It just timed out or returned 503 for a few days, and now it's been almost 12 hours which it has been out of sync. As it's a tier 1 mirror, I'm sending this email to see if administrator of the mirror replies if there's a issue and do they have a guess when it will be fixed, or if someone from archlinux staff knows about this. I can understand you may find this too much to report for a single mirror and why I haven't just switched to another one, but Internet is very bad in my country and this mirror is the only one which is accessible all the time, has good speed and it has been reliable on all ISPs in the past few years. Best Regards, Amin Vakil

3 2

tier 1 23m.com seems out of date
by ave 17 Sep '23

17 Sep '23

Hello, The tier 1 mirror that we pull from, 23m.com, seems to be having issues (connection issues, low completion): https://archlinux.org/mirrors/23m.com/ Can the operator please fix it? Thanks. Best, ave

2 1

pacman cannot handle HTTP 304 returned by nginx?
by Jing Luo 06 Sep '23

06 Sep '23

Hi all, I don't know if this is an intended behavior for pacman. Today I ran `pacman -Syyu` against the mirror hosted by me, and pacman output 404 for all the packages: ``` Total Download Size: 395.48 MiB Total Installed Size: 2273.64 MiB Net Upgrade Size: 133.43 MiB :: Proceed with installation? [Y/n] :: Retrieving packages... noto-fonts-cjk-20230817-1-any is up to date linux-6.4.12.arch1-1-x86_64 is up to date ktuberling-23.08.0-1-x86_64 is up to date marble-common-23.08.0-1-x86_64 is up to date klettres-23.08.0-1-x86_64 is up to date linux-headers-6.4.12.arch1-1-x86_64 is up to date minuet-23.08.0-1-x86_64 is up to date kalzium-23.08.0-1-x86_64 is up to date linux-docs-6.4.12.arch1-1-x86_64 is up to date archlinux-appstream-data-20230827-2-any is up to date Total ( 10/217) 395.5 MiB 22.7 GiB/s 00:00 [#######################################################################################] 100% error: failed retrieving file 'noto-fonts-cjk-20230817-1-any.pkg.tar.zst.sig' from repo.jing.rocks : The requested URL returned error: 404 error: failed retrieving file 'linux-6.4.12.arch1-1-x86_64.pkg.tar.zst.sig' from repo.jing.rocks : The requested URL returned error: 404 error: failed retrieving file 'archlinux-appstream-data-20230827-2-any.pkg.tar.zst.sig' from repo.jing.rocks : The requested URL returned error: 404 warning: too many errors from repo.jing.rocks, skipping for the remainder of this transaction error: failed retrieving file 'ktuberling-23.08.0-1-x86_64.pkg.tar.zst.sig' from repo.jing.rocks : The requested URL returned error: 404 error: failed retrieving file 'linux-headers-6.4.12.arch1-1-x86_64.pkg.tar.zst.sig' from repo.jing.rocks : The requested URL returned error: 404 error: failed retrieving file 'marble-common-23.08.0-1-x86_64.pkg.tar.zst.sig' from repo.jing.rocks : The requested URL returned error: 404 error: failed retrieving file 'kalzium-23.08.0-1-x86_64.pkg.tar.zst.sig' from repo.jing.rocks : The requested URL returned error: 404 error: failed retrieving file 'klettres-23.08.0-1-x86_64.pkg.tar.zst.sig' from repo.jing.rocks : The requested URL returned error: 404 error: failed retrieving file 'minuet-23.08.0-1-x86_64.pkg.tar.zst.sig' from repo.jing.rocks : The requested URL returned error: 404 error: failed retrieving file 'linux-docs-6.4.12.arch1-1-x86_64.pkg.tar.zst.sig' from repo.jing.rocks : The requested URL returned error: 404 warning: failed to retrieve some files error: failed to commit transaction (failed to retrieve some files) Errors occurred, no packages were upgraded. ``` I thought my mirror was out of date at first, so I ran the syncrepo script manually, but it looks like only the file lists were transferred. I searched on the arch forum, but in their cases, they have out-of-date package index or they change the mirrorlist to solve this problem. Not exactly my case. So I looked at the nginx access.log: ``` - - - [29/Aug/2023:08:06:42 +0900] "GET /archlinux/core/os/x86_64/core.db HTTP/2.0" 304 0 "-" "pacman/6.0.2 (Linux x86_64) libalpm/13.0.2" - - - [29/Aug/2023:08:06:42 +0900] "GET /archlinux/multilib/os/x86_64/multilib.db HTTP/2.0" 304 0 "-" "pacman/6.0.2 (Linux x86_64) libalpm/13.0.2" - - - [29/Aug/2023:08:06:42 +0900] "GET /archlinux/extra/os/x86_64/extra.db HTTP/2.0" 304 0 "-" "pacman/6.0.2 (Linux x86_64) libalpm/13.0.2" - - - [29/Aug/2023:08:06:43 +0900] "GET /archlinux/extra/os/x86_64/noto-fonts-cjk-20230817-1-any.pkg.tar.zst HTTP/2.0" 304 0 "-" "pacman/6.0.2 (Linux x86_64) libalpm/13.0.2" - - - [29/Aug/2023:08:06:43 +0900] "GET /archlinux/core/os/x86_64/linux-6.4.12.arch1-1-x86_64.pkg.tar.zst HTTP/2.0" 304 0 "-" "pacman/6.0.2 (Linux x86_64) libalpm/13.0.2" - - - [29/Aug/2023:08:06:43 +0900] "GET /archlinux/extra/os/x86_64/ktuberling-23.08.0-1-x86_64.pkg.tar.zst HTTP/2.0" 304 0 "-" "pacman/6.0.2 (Linux x86_64) libalpm/13.0.2" - - - [29/Aug/2023:08:06:43 +0900] "GET /archlinux/extra/os/x86_64/marble-common-23.08.0-1-x86_64.pkg.tar.zst HTTP/2.0" 304 0 "-" "pacman/6.0.2 (Linux x86_64) libalpm/13.0.2" - - - [29/Aug/2023:08:06:43 +0900] "GET /archlinux/extra/os/x86_64/klettres-23.08.0-1-x86_64.pkg.tar.zst HTTP/2.0" 304 0 "-" "pacman/6.0.2 (Linux x86_64) libalpm/13.0.2" - - - [29/Aug/2023:08:06:43 +0900] "GET /archlinux/core/os/x86_64/linux-headers-6.4.12.arch1-1-x86_64.pkg.tar.zst HTTP/2.0" 304 0 "-" "pacman/6.0.2 (Linux x86_64) libalpm/13.0.2" - - - [29/Aug/2023:08:06:43 +0900] "GET /archlinux/extra/os/x86_64/minuet-23.08.0-1-x86_64.pkg.tar.zst HTTP/2.0" 304 0 "-" "pacman/6.0.2 (Linux x86_64) libalpm/13.0.2" - - - [29/Aug/2023:08:06:43 +0900] "GET /archlinux/extra/os/x86_64/kalzium-23.08.0-1-x86_64.pkg.tar.zst HTTP/2.0" 304 0 "-" "pacman/6.0.2 (Linux x86_64) libalpm/13.0.2" - - - [29/Aug/2023:08:06:43 +0900] "GET /archlinux/core/os/x86_64/linux-docs-6.4.12.arch1-1-x86_64.pkg.tar.zst HTTP/2.0" 304 0 "-" "pacman/6.0.2 (Linux x86_64) libalpm/13.0.2" - - - [29/Aug/2023:08:06:43 +0900] "GET /archlinux/extra/os/x86_64/archlinux-appstream-data-20230827-2-any.pkg.tar.zst HTTP/2.0" 304 0 "-" "pacman/6.0.2 (Linux x86_64) libalpm/13.0.2" ``` After a little bit of research, I found that nginx seems to conform to the standard according to my setup: gzip off, telling the browser (in this case, pacman) to use the client side local cache, returning a 304. Note that my mirror site is set up like this: a load-balancer/reverse proxy (repo.jing.rocks) in front of two web servers (repo1 and repo2) connected to the same NFS storage backend. Caching to disk is not enabled in nginx. After that I decided to put these three lines into my location block so that nginx always returns 200: ``` add_header Cache-Control "no-cache"; etag off; if_modified_since off; ``` It looks all good now, except I can't reproduce this pacman bug (?) anymore. Now that arch's gitlab closed new account registration, I thought I should probably look for experienced mirror operators' input before submitting a bug report. What do y'all think? Is this a bug? (Also my mirror hasn't been accepted after 2 months https://bugs.archlinux.org/task/78991 looks like the mirror admin team is taking their sweet sweet time?) BR, -- Jing Luo About me: https://jing.rocks/about/ PGP Fingerprint: 4E09 8D19 00AA 3F72 1899 2614 09B3 316E 13A1 1EFC

4 3

Docker Image for Mirrors
by port19 28 Aug '23

28 Aug '23

Hi all, in my limited research into hosting a public mirror, I have not found a way to do so via a preexisting docker image. Wiki page in question: https://wiki.archlinux.org/title/DeveloperWiki:NewMirrors A publicly available and officially endorsed docker image has several advantages in easing administration, especially in regard to first setup. To be more percise: - Specified rsync options can be preconfigured - Random sync delay can be preconfigured - A default sync interval (I propose 6 hours) can be preconfigured, with optional override - Included synced repositories can be configured via a config file - Persistent storage should be done via a docker volume. The scope of the container would include a small entrypoint script to provide the mentioned configurability. If I get positive feedback on the matter I can start development immediately. Kind Regards, port19

2 1

Hacking & Coffee mirror outage
by Tails Hon1nbo 03 Jul '23

03 Jul '23

Due to a facility migration the https://mirror.hackingand.coffee will be offline for 1-2 weeks I had originally expected this to be a love migration, but due to a shortage of extra capacity on the fail over pool we have to turn it off until the migration is complete It is going offline at approximately 11am central time -Hon1nbo -- This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited.

1 1

(no subject)
by Mirror Admin 03 Jun '23

03 Jun '23

Due to some unforeseen changes that have come up, we are needing to pull our mirror off the list. We love supporting the open source community and hope to continue to. We are in negotiations with our DIA provider to possibly move the mirror to their datacenter and have them take responsibility/control for it. This would allow the mirror to be connected directly to the BGP routers that interface with the internet exchanges and provide a better experience for the end-users. I do not have a timeline for when this will happen but we are hoping before the end of Q2. I would say to go ahead and remove us for the time being and will reach out when that transfer happens. Respectfully, Grant Brooks Mirror Admin

2 1

Rsync re-enabled again
by Jelle van der Waa 21 May '23

21 May '23

Hi all, We have re-enabled rsync access, the first sync will take a while as you will sync all the merged packages from community into extra so the sync can take a while. The community pool is not yet removed, this will happen later. So this means there will be a slight increase of diskspace for a while. Greetings, Jelle

1 0

Mirror reverse proxy
by DevPGSV 20 May '23

20 May '23

Hi, I've just noticed something.... strange? I manage this mirror: https://archlinux.org/mirrors/librelabucm.org/ And I've just noticed that this other mirror: https://archlinux.org/mirrors/mirrors.marquitos.space/ Is actually just a reverse proxy to ours. We are sure about this: * If I temporarily create a file in our mirror folder, it is also shown on their end, instantly * Every time I go to "https://mirrors.marquitos.space/archlinux/", I see in our server logs a request coming from the same IP as the one " mirrors.marquitos.space" resolves to. We've seen that aprox 1/10 of the requests we are receiving in our mirror come from this IP. I've added a temporary rule to enable their IP in our firewall, so they are not blocked, so if someone is using their mirror, it's still working. I found his email address online, so I'm going to send him an email to ask him about it. So..... * Was there any official request to add that mirror to the list? https://archlinux.org/mirrorlist/all/ * Is there any reason/benefit to offering a mirror as a reverse proxy to other mirror? (I've checked, they are not caching files) Thank you, Pablo

4 3

rsync.archlinux.org disabled
by Jelle van der Waa 19 May '23

19 May '23

Hi all, We are starting the migration to Git for packaging repositories and merging [community] to [extra] to prevent a weird state being synced to the mirrors we will leave our rsync endpoint disabled until the migration is complete. Greetings, Jelle van der Waa

4 9

Git migration announcement
by Jelle van der Waa 15 May '23

15 May '23

This Friday morning (2023-05-19) the Git packaging migration will start until Sunday (2023-05-21). The Arch Linux packaging team will not be able to update packages in any of the repositories during this period. Notification when the migration starts, and when it is completed, will be published on the [arch-dev-public] mailing list. # How does this impact Arch Linux users? The [testing] repository will be split into [core-testing] and [extra-testing], the [staging] repository will be split into [core-staging] and [extra-staging]. The [community] repository will be merged into [extra] and will therefore be empty after the migration. All affected repositories will be provided as empty repositories for a transition period after the migration. For regular users, this means that everything works as before. Note: After the migration is done, users that have the testing repositories enabled need to include the new repositories ([core-testing] and [extra-testing] instead of [testing]) in their pacman.conf before updating their system. Other changes: - SVN access is discontinued and will disappear. [1] - The svn2git mirror will no longer be updated. - asp, which relies on the svn2git mirror, will stop working. It is replaced by pkgctl repo clone. [2] # How does this impact Arch Linux tier 1 mirrors? During the migration rsync and HTTP access will be shut down. We will send an email notification to arch-mirrors once everything has been finished. # How does this impact Arch Linux packagers? Packagers will not be able to patch and update their packages. The internal Tier 0 mirror is also going to be disabled for the duration of this migration. [1] https://archlinux.org/svn/ [2] https://lists.archlinux.org/archives/list/arch-mirrors@lists.archlinux.org/

1 0