On Mon, Sep 21, 2009 at 3:23 PM, Aaron Griffin wrote:

On Fri, Sep 18, 2009 at 11:52 PM, Eric Bélanger wrote:

...

On Fri, Sep 18, 2009 at 4:22 PM, Aaron Griffin wrote:

...

See /arch-test/

This should have a better cleanup script, no more dependence on makepkg.conf, improved integrity check, scripts for community-testing and a bunch more things.

Eric, I'm adjusting the sourceball cron job now, because you like that :)

I used the new db-extra and db-testing a couple of time. Didn't noticed any problems.

The sourceball script didn't work. It was ran as root:

$ zcat /var/log/sourceballs/facile.gz ==> ERROR: Running makepkg as root is a BAD idea and can cause    permanent, catastrophic damage to your system. If you    wish to run as root, please use the --asroot option.

We'll need to run it as a user or use the --asroot option.

Aha, this is what the "cronjob" user used to be for. I added a user specifically for this purpose. Looks like it's running right now, so I will test this and jiggle with the permissions later on today.

...

Looks like the svn command is failing for community packages:

Yeah. I disabled community in the sourceballs cron job for now. I guess I'll need a selector to get the svn repo URL based on hostname and repo... ewww

Just a ping on this. Does everything seem ok? I'd like to tag and release this for both us and the TUs shortly. Note the sourceball script needs additional work to work with community, but I will get to it eventually. I added it here: http://wiki.archlinux.org/index.php/DeveloperWiki:Internal_Projects#Develope...

On Tue, Sep 22, 2009 at 4:00 PM, Eric Bélanger wrote:

On Tue, Sep 22, 2009 at 4:29 PM, Aaron Griffin wrote:

...

On Mon, Sep 21, 2009 at 3:23 PM, Aaron Griffin wrote:

...

On Fri, Sep 18, 2009 at 11:52 PM, Eric Bélanger wrote:

...

On Fri, Sep 18, 2009 at 4:22 PM, Aaron Griffin wrote:

...

See /arch-test/

This should have a better cleanup script, no more dependence on makepkg.conf, improved integrity check, scripts for community-testing and a bunch more things.

Eric, I'm adjusting the sourceball cron job now, because you like that :)

I used the new db-extra and db-testing a couple of time. Didn't noticed any problems.

The sourceball script didn't work. It was ran as root:

$ zcat /var/log/sourceballs/facile.gz ==> ERROR: Running makepkg as root is a BAD idea and can cause    permanent, catastrophic damage to your system. If you    wish to run as root, please use the --asroot option.

We'll need to run it as a user or use the --asroot option.

Aha, this is what the "cronjob" user used to be for. I added a user specifically for this purpose. Looks like it's running right now, so I will test this and jiggle with the permissions later on today.

...

Looks like the svn command is failing for community packages:

Yeah. I disabled community in the sourceballs cron job for now. I guess I'll need a selector to get the svn repo URL based on hostname and repo... ewww

Just a ping on this. Does everything seem ok? I'd like to tag and release this for both us and the TUs shortly.

Note the sourceball script needs additional work to work with community, but I will get to it eventually. I added it here: http://wiki.archlinux.org/index.php/DeveloperWiki:Internal_Projects#Develope...

you haven't fix the perms for sourceball yet:

errors occured during run: svn: warning: Can't open file '/root/.subversion/servers': Permission denied svn: warning: Can't open file '/root/.subversion/servers': Permission denied /arch-test/cron-jobs/../misc-scripts/make-sourceball: line 81: /var/log/sourceballs//cloog-ppl: Permission denied gzip: /var/log/sourceballs//cloog-ppl: No such file or directory        Failed to download source for cloog-ppl-0.15.7-1 (core-i686)

You need to give sourceballs users rw perm  in /var/log/sourceballs.

Fixed. Forgot about the log dir

Also the current sources in  /srv/ftp/sources/ have these perms: -rw-rw-r-- 1         546 ftp-arch

Are we looking at the same machine? -rw-rw-r-- 1 sourceballs root 165 2009-09-21 16:12 transcode.gz -rw-rw-r-- 1 sourceballs root 164 2009-09-21 16:14 ttf-thai.gz -rw-rw-r-- 1 sourceballs root 162 2009-09-21 16:15 tzdata.gz -rw-rw-r-- 1 sourceballs root 160 2009-09-21 16:00 udev.gz -rw-rw-r-- 1 sourceballs root 162 2009-09-21 16:12 unison.gz I just changed it all to group:ftp-extra Also: drwxrwsr-x 2 sourceballs ftp-extra 236K 2009-09-22 16:12 sources/

You'll need to fix their perms if the sourceballs user isn't in the ftp-arch group.   You might also want to fix the svn warning if it's easy. It might be inoffensive but will clutter the logs.

Hmm, I'll switch to su from sudo, it should clear the HOME dir being set to root and clean that up

On Tue, Sep 22, 2009 at 5:08 PM, Aaron Griffin wrote:

On Tue, Sep 22, 2009 at 4:00 PM, Eric Bélanger wrote:

...

On Tue, Sep 22, 2009 at 4:29 PM, Aaron Griffin wrote:

...

On Mon, Sep 21, 2009 at 3:23 PM, Aaron Griffin wrote:

...

On Fri, Sep 18, 2009 at 11:52 PM, Eric Bélanger wrote:

...

On Fri, Sep 18, 2009 at 4:22 PM, Aaron Griffin wrote:

...

See /arch-test/

This should have a better cleanup script, no more dependence on makepkg.conf, improved integrity check, scripts for community-testing and a bunch more things.

Eric, I'm adjusting the sourceball cron job now, because you like that :)

I used the new db-extra and db-testing a couple of time. Didn't noticed any problems.

The sourceball script didn't work. It was ran as root:

$ zcat /var/log/sourceballs/facile.gz ==> ERROR: Running makepkg as root is a BAD idea and can cause    permanent, catastrophic damage to your system. If you    wish to run as root, please use the --asroot option.

We'll need to run it as a user or use the --asroot option.

Aha, this is what the "cronjob" user used to be for. I added a user specifically for this purpose. Looks like it's running right now, so I will test this and jiggle with the permissions later on today.

...

Looks like the svn command is failing for community packages:

Yeah. I disabled community in the sourceballs cron job for now. I guess I'll need a selector to get the svn repo URL based on hostname and repo... ewww

Just a ping on this. Does everything seem ok? I'd like to tag and release this for both us and the TUs shortly.

Note the sourceball script needs additional work to work with community, but I will get to it eventually. I added it here: http://wiki.archlinux.org/index.php/DeveloperWiki:Internal_Projects#Develope...

you haven't fix the perms for sourceball yet:

errors occured during run: svn: warning: Can't open file '/root/.subversion/servers': Permission denied svn: warning: Can't open file '/root/.subversion/servers': Permission denied /arch-test/cron-jobs/../misc-scripts/make-sourceball: line 81: /var/log/sourceballs//cloog-ppl: Permission denied gzip: /var/log/sourceballs//cloog-ppl: No such file or directory        Failed to download source for cloog-ppl-0.15.7-1 (core-i686)

You need to give sourceballs users rw perm  in /var/log/sourceballs.

Fixed. Forgot about the log dir

...

Also the current sources in  /srv/ftp/sources/ have these perms: -rw-rw-r-- 1         546 ftp-arch

Are we looking at the same machine?

-rw-rw-r-- 1 sourceballs root 165 2009-09-21 16:12 transcode.gz -rw-rw-r-- 1 sourceballs root 164 2009-09-21 16:14 ttf-thai.gz -rw-rw-r-- 1 sourceballs root 162 2009-09-21 16:15 tzdata.gz -rw-rw-r-- 1 sourceballs root 160 2009-09-21 16:00 udev.gz -rw-rw-r-- 1 sourceballs root 162 2009-09-21 16:12 unison.gz

Same machine but different directory. You are probably looking at the logs in /var/log/sourceballs they have .gz extension. I was talking about the sources in /srv/ftp/sources/ : 6 eric@gerolde.archlinux.org $ ls -lt /srv/ftp/sources/|head -10 total 18G -rw-rw-r-- 1 sourceballs ftp-extra 624K 2009-09-22 16:12 errors.txt -rw-rw-r-- 1 sourceballs ftp-extra 58K 2009-09-22 16:12 failed.txt -rw-rw-r-- 1 sourceballs ftp-extra 58K 2009-09-22 08:13 failed.txt.old -rw-rw-r-- 1 sourceballs ftp-extra 642K 2009-09-22 08:13 errors.txt.old -rw-rw-r-- 1 546 ftp-arch 1.9M 2009-08-03 08:06 soprano-2.3.0-1.src.tar.gz -rw-rw-r-- 1 546 ftp-arch 159K 2009-08-03 08:06 qtcurve-kde4-0.66.1-2.src.tar.gz -rw-rw-r-- 1 546 ftp-arch 111M 2009-08-03 08:06 qt-4.5.2-5.src.tar.gz -rw-rw-r-- 1 546 ftp-arch 6.7M 2009-08-03 08:04 pyqt-4.5.4-1.src.tar.gz -rw-rw-r-- 1 546 ftp-arch 71K 2009-08-03 08:04 kopete-cryptography-1.3.0-3.src.tar.gz There seems to be problems with split package I believe. I'll wait until it finish running to look into it further. The "Failed to download source for" error are, at first look, because of missing source/md5sums.: Errors occured during run: Failed to download source for tzdata-2009l-1 (core-i686) Failed to download source for xfsprogs-3.0.1-2 (core-i686) Failed to download source for tzdata-2009l-1 (core-x86_64) Failed to download source for xfsprogs-3.0.1-2 (core-x86_64) Failed to download source for aria2-1.5.2-1 (extra-i686) Failed to download source for enca-1.10-1 (extra-i686) Failed to download source for gmpc-0.19.0-1 (extra-i686) cp: cannot stat `kdeaccessibility-colorschemes-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeaccessibility-colorschemes-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeaccessibility-colorschemes-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeaccessibility-colorschemes-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeaccessibility-colorschemes-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeaccessibility-colorschemes-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeadmin-kcron-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeadmin-kcron-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeadmin-kcron-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeadmin-kcron-4.3.1-1.src.tar.gz': No such file or directory

I just changed it all to group:ftp-extra

Also: drwxrwsr-x   2 sourceballs ftp-extra 236K 2009-09-22 16:12 sources/

...

You'll need to fix their perms if the sourceballs user isn't in the ftp-arch group.   You might also want to fix the svn warning if it's easy. It might be inoffensive but will clutter the logs.

Hmm, I'll switch to su from sudo, it should clear the HOME dir being set to root and clean that up

On Tue, Sep 22, 2009 at 9:28 PM, Eric Bélanger wrote:

On Tue, Sep 22, 2009 at 7:01 PM, Eric Bélanger wrote:

...

On Tue, Sep 22, 2009 at 5:08 PM, Aaron Griffin wrote:

...

On Tue, Sep 22, 2009 at 4:00 PM, Eric Bélanger wrote:

...

On Tue, Sep 22, 2009 at 4:29 PM, Aaron Griffin wrote:

...

On Mon, Sep 21, 2009 at 3:23 PM, Aaron Griffin wrote:

...

On Fri, Sep 18, 2009 at 11:52 PM, Eric Bélanger wrote: > On Fri, Sep 18, 2009 at 4:22 PM, Aaron Griffin wrote: >> See /arch-test/ >>

There seems to be problems with split package I believe. I'll wait until it finish running to look into it further. The "Failed to download source for" error are, at first look, because of missing source/md5sums.:

Errors occured during run:        Failed to download source for tzdata-2009l-1 (core-i686)        Failed to download source for xfsprogs-3.0.1-2 (core-i686)        Failed to download source for tzdata-2009l-1 (core-x86_64)        Failed to download source for xfsprogs-3.0.1-2 (core-x86_64)        Failed to download source for aria2-1.5.2-1 (extra-i686)        Failed to download source for enca-1.10-1 (extra-i686)        Failed to download source for gmpc-0.19.0-1 (extra-i686) cp: cannot stat `kdeaccessibility-colorschemes-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeaccessibility-colorschemes-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeaccessibility-colorschemes-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeaccessibility-colorschemes-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeaccessibility-colorschemes-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeaccessibility-colorschemes-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeadmin-kcron-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeadmin-kcron-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeadmin-kcron-4.3.1-1.src.tar.gz': No such file or directory cp: cannot stat `kdeadmin-kcron-4.3.1-1.src.tar.gz': No such file or directory

Attached is an untested patch to fix split package support in sourceballs script. It uses the package name as indicated in the script arguments instead of the incorrect one sourced from the PKGBUILD.

Applied and pushed. I also fixed the permissions on the stray sources with the wrong permissions