[arch-dev-public] Source package creation repaired
Hi devs, I repaired the sourceball creation script the last days. I didn't active the cron job yet as a couple of packages should be fixed first (will send a new mail about that) * Similar to the package pool there are now two subdirs for our core/extra packages and the ones from community in ftp/sources. * The sourceballs user has srcdest set to ~/sourceballs so we don't need to redownload sources on every minor update * A cron job removes files older than 120 days from that srcdest folder * I have added a new rsync module to sigurd in order to provide these sources for gerolde * Instead of logging to files the plan is to send the output of the scripts to the arch-notifications mailing list Greetings, Pierre -- Pierre Schmitz, https://users.archlinux.de/~pierre
Thanks Pierre! On Sunday, November 21, 2010, Pierre Schmitz <pierre@archlinux.de> wrote:
Hi devs,
I repaired the sourceball creation script the last days. I didn't active the cron job yet as a couple of packages should be fixed first (will send a new mail about that)
* Similar to the package pool there are now two subdirs for our core/extra packages and the ones from community in ftp/sources. * The sourceballs user has srcdest set to ~/sourceballs so we don't need to redownload sources on every minor update * A cron job removes files older than 120 days from that srcdest folder * I have added a new rsync module to sigurd in order to provide these sources for gerolde * Instead of logging to files the plan is to send the output of the scripts to the arch-notifications mailing list
Greetings,
Pierre
-- Pierre Schmitz, https://users.archlinux.de/~pierre
On Sun, Nov 21, 2010 at 6:41 PM, Pierre Schmitz <pierre@archlinux.de> wrote:
Hi devs,
I repaired the sourceball creation script the last days. I didn't active the cron job yet as a couple of packages should be fixed first (will send a new mail about that)
* Similar to the package pool there are now two subdirs for our core/extra packages and the ones from community in ftp/sources. * The sourceballs user has srcdest set to ~/sourceballs so we don't need to redownload sources on every minor update * A cron job removes files older than 120 days from that srcdest folder * I have added a new rsync module to sigurd in order to provide these sources for gerolde * Instead of logging to files the plan is to send the output of the scripts to the arch-notifications mailing list
A few suggestions about the notification email: 1) It would be helpfull to list the failed packages (content of failed.txt wich you apparently removed) before the makepkg output. At a glance, we'll be able to see if one of our package has failed without going through pages of output. Maybe it won't be as useful after we fix the current packages. 2) Seperate the makepkg output of each failed package with an empty line or a long line of dashes or equal signs. It'll make them easier to distinguish. 3) The script is checking for multilib repos for i686. As it dosn't find the db it just aborts but we should just skip the check. This will enable us to not send the email if there are no failures.
On Sun, Nov 21, 2010 at 5:41 PM, Pierre Schmitz <pierre@archlinux.de> wrote:
Hi devs,
I repaired the sourceball creation script the last days. I didn't active the cron job yet as a couple of packages should be fixed first (will send a new mail about that)
* Similar to the package pool there are now two subdirs for our core/extra packages and the ones from community in ftp/sources. * The sourceballs user has srcdest set to ~/sourceballs so we don't need to redownload sources on every minor update SRCDEST=/home/sourceballs/sources
This is quickly filling up /home on gerolde. Somewhere on /srv (173 GB vs 25 GB) and not under ftp/ would be a much better idea. $ sudo du -shxP * | sort -h ... 568M aaron 704M paul 838M remy 1.3G pierre 1.7G mailman 4.1G sourceballs 5.7G tpowa Your homedir is also quite big. :P Tpowa- do we really need to keep around ISOs from 2007 in your archive/ directory?
* A cron job removes files older than 120 days from that srcdest folder * I have added a new rsync module to sigurd in order to provide these sources for gerolde * Instead of logging to files the plan is to send the output of the scripts to the arch-notifications mailing list
On Fri, 3 Dec 2010 21:24:42 -0600, Dan McGee <dpmcgee@gmail.com> wrote:
SRCDEST=/home/sourceballs/sources
This is quickly filling up /home on gerolde. Somewhere on /srv (173 GB vs 25 GB) and not under ftp/ would be a much better idea.
Right, I need to tune this a little bit; maybe also reduce the time we keep those sources. I'll also alter the db-scripts in a way to "touch" packages when moved so we can clean them up by a cron job. What is a good amount of time to keep "removed" packages? Like 7 to 14 days?
$ sudo du -shxP * | sort -h ... 568M aaron 704M paul 838M remy 1.3G pierre 1.7G mailman 4.1G sourceballs 5.7G tpowa
Your homedir is also quite big. :P
Will look at it...there are still some backups in there. A problem with hasn't been solved yet. :-) -- Pierre Schmitz, https://users.archlinux.de/~pierre
participants (3)
-
Dan McGee
-
Eric Bélanger
-
Pierre Schmitz