- Arch-devops - lists.archlinux.org

[arch-devops] Cleaning up archive.archlinux.org
by Florian 11 Jul '17

11 Jul '17

Hi, While I like the idea of the archive, it currently does not implement any kind of cleanup and forever grows in size. Right now is is somewhere around 50 million files with a total size of 1.7TB. Those are very rough numbers since calculating them for real takes considerable time. This creates multiple problems: - The disks only have ~700gb more space before they are full. We will reach that eventually - The backup creation takes somewhere between 4 to 5 hours depending on machine load. I am thinking about increasing the backup frequency where possible, but if one backup takes 4 hours that won't happen. I am also worried that if we ever need to restore, this could easily take well over 24 hours. The initial backup (which read all data rather than ignoring unchanged data) took something around 24 hours, but that was with less files. Essentially this means we need to put some kind of automatic deletion of old data in place and reduce the size of the archive. What would be a good time frame here? Have we defined a clear goal for the archive that we can use as a guideline? My gut says 6 months should be enough, but feel free to disagree. Once we have decided how long data should be kept, we also need something to actually delete it. Deleting files from the ./repos directory should be simple, but the ./packages directory is more complicated because it is not nicely separated into directories per day. Sebastien, do you have an idea about how we could delete old data or do you have a script for that? Florian

6 8

[arch-devops] Maintenance window for luna
by Bartłomiej Piotrowski 17 Jun '17

17 Jun '17

Hi all, tomorrow around 22:00 CET, the server that hosts forums, wiki and AUR will be offline for planned maintenance. The downtime will take up to 2 hours; the plan is to reboot it into linux-hardened, then see if it is possible to switch from Percona to MariaDB (and if the mysterious crash from the past still happens, gather debug data for reporting it upstream). Sorry for the inconvenience, Bartłomiej

1 1

[arch-devops] Webserver maintenance downtime
by Florian Pritz 12 Apr '17

12 Apr '17

Hi, Our web server (apollo.archlinux.org) appears to experience some hardware issues and will be checked by the ISP shortly. Please expect a downtime of up to 14 hours. The following services will be affected: bugs, planet, security, www (main website) Other services (wiki, bbs, mailinglists) are not affected by this. I'm sorry for the inconvenience. Florian

1 0

[arch-devops] archive.archlinux.org
by Sébastien Luttringer 01 Apr '17

01 Apr '17

Hello, Archive is now on Orion. DNS has been updated and the ansible config pushed. Cheers, -- Sébastien "Seblu" Luttringer GPG: 0x2072D77A

1 0

[arch-devops] Monitoring
by Florian Pritz 20 Mar '17

20 Mar '17

Hi, I've finally started setting up a monitoring solution (zabbix). Thanks to Bartłomiej for getting zabbix packages into our repos! If anyone from the devops team wants accounts on zabbix, please send me a mail. Right now it doesn't monitor too much (items and hosts), but I plan to increase coverage over time. I'll likely also set up grafana later for pretty graphs. Florian

1 0

[arch-devops] Kanboard for devops and other arch projects
by Florian Pritz 07 Mar '17

07 Mar '17

Hi, I've set up kanboard[1] for us[2]. Currently there is only one board for the infrastructure and it has public viewing enabled[3]. Anyone with an account is can create their own personal boards and I can create group boards as well. If you (dev/TU/support staff) want an account, please send me a mail or ping me on IRC. In case you wonder: If multiple users edit a board at the same time it is automatically updated every 10 seconds for the others. [1] https://kanboard.net/features [2] https://kanboard.archlinux.org/ [3] https://kanboard.archlinux.org/public/board/7dd7510424e4229247e8e0b90bf43e1… Florian

2 2

[arch-devops] Archweb migration
by Giancarlo Razzolini 01 Jan '17

01 Jan '17

Hi All, We are in the process of moving archweb from gudrun to apollo. The site already is running from there but, unfortunately, there was a small window of time where changes done could have been lost. This does apply to logins, passwords, signoff's and such. From a quick look at gudrun's log I could not find anyone that should have lost anything. The services are being changed as I write this, so packages and mirrors can be outdated for a little bit. If you notice anything strange, please report. Make sure you cleaned your browser's local cache first though. Also, for the devops, running playbooks against orion and apollo should not be done. Some small issues with postgres prevent that. Talk with me or Florian if you need to make changes on these machines. I expect us to fix this issue soon. Cheers, Giancarlo Razzolini

3 3

[arch-devops] New devops member (root access) + access list
by Florian Pritz 27 Nov '16

27 Nov '16

Hi, I'm giving Giancarlo Razzolini root access so he can migrate archweb. He also agreed to continue helping with other devops things in the future. Also here's a list of people that currently have root access: Bartlomiej Piotrowski Jan Alexander Steffens Sven-Hendrik Haase Florian Pritz Sébastien Luttringer Ángel Velásquez Giancarlo Razzolini I've also noticed that Sebastien and Angel don't have vault access right now so they can't deploy using ansible. I'll fix that as well since root access means they can read the deployed files anyways. Florian

1 0

[arch-devops] Shutting down celestia (old pkgbuild)
by Florian Pritz 03 Oct '16

03 Oct '16

Hi, According to Jan, everything has been transferred to the new server (soyuz). I'll be shutting down celestia next weekend. I see some of you have connected to celestia in the last few days. I believe Jan only synced once on Friday so any changes you made since have probably not been migrated to soyuz. Please migrate those things yourself. I'll obviously create a backup when I shut the machine down, but access will be more complicated. If you don't use pkgbuild.com as the host for ssh, please update your scripts/aliases to use soyuz instead of celestia. Florian

2 3

[arch-devops] Code complexity survey
by Vard Antinyan 27 Sep '16

27 Sep '16

Dear developers, We have undertaken a task to assess code complexity triggers and generate recommendations for developing understandable code. Our intension is to share the results with you, developers, so everyone can learn the triggers behind complex software. We need your help for rigorous results. My request to you is - if you get 5-10 min. time, would you please consider to answer the questions of this survey on code complexity? https://goo.gl/forms/h9WXZ8VSEw7BUyHg1 You are welcome to learn preliminary results through this link: https://www.facebook.com/SoftwareCodeQuality/photos/?tab=album&album_id=163… The results will be shared in a public webpage and everyone possible will be invited to learn and discuss them. Your knowledge and experience is vital for achieving substantial and generalizable results, and your effort is much appreciated! Sincerely Vard Antinyan PhD candidate in University of Gothenburg, Sweden Tel: 0046317725707

1 0