February 2010 - Arch-dev-public - lists.archlinux.org

[arch-dev-public] [devtools] [PATCH] read {SRC, PKG}DEST from user makepkg.conf
by Andrea Scarpino 28 Jun '10

28 Jun '10

makechrootpkg does not read SRCDEST and PKGDEST if they are set in ~/.makepkg.conf -- Andrea `bash` Scarpino Arch Linux Developer

5 11

[arch-dev-public] [PATCH 1/3] sourceballs: Make cleanup more efficient
by Eric Bélanger 28 Jun '10

28 Jun '10

Moved all cleanup related code in sourceballs-cleanup script and moved, now common, functions in db-functions. The cleanup script is now ran after all the new sourceballs have been fetched. Signed-off-by: Eric Bélanger <snowmaniscool(a)gmail.com> --- cron-jobs/sourceballs | 2 + db-functions | 21 ++++++++ misc-scripts/make-sourceball | 54 --------------------- misc-scripts/sourceballs-cleanup | 95 ++++++++++++++++++++++++++++++++++++++ 4 files changed, 118 insertions(+), 54 deletions(-) create mode 100755 misc-scripts/sourceballs-cleanup diff --git a/cron-jobs/sourceballs b/cron-jobs/sourceballs index b7a4885..ccb00ad 100755 --- a/cron-jobs/sourceballs +++ b/cron-jobs/sourceballs @@ -89,4 +89,6 @@ if [ -n "$FAILED_PKGS" ]; then echo -e $FAILED_PKGS | sed "s| |\n|g" | sort -u >> "$srcbase/failed.txt" fi +$dirname/../misc-scripts/sourceballs-cleanup + cleanup diff --git a/db-functions b/db-functions index a4cffd7..ecf53d9 100644 --- a/db-functions +++ b/db-functions @@ -126,4 +126,25 @@ chk_license() { return 1 } +pkgname_from_src() { + local tmp + tmp=${1##*/} + tmp=${tmp%$SRCEXT} + for a in ${ARCHES[@]}; do + tmp=${tmp%-$a} + done + tmp=${tmp%-any} + echo ${tmp%-*-*} +} + +pkgver_from_src() { + tmp=${1##*/} + tmp=${tmp%$SRCEXT} + for a in ${ARCHES[@]}; do + tmp=${tmp%-$a} + done + tmp=${tmp%-any} + echo $tmp | sed 's|.*-$.*-.*$$|\1|g' +} + # vim: set ts=4 sw=4 noet ft=sh: diff --git a/misc-scripts/make-sourceball b/misc-scripts/make-sourceball index 8899fca..610d7f1 100755 --- a/misc-scripts/make-sourceball +++ b/misc-scripts/make-sourceball @@ -40,27 +40,6 @@ die() { cleanup 1 } -pkgname_from_src() { - local tmp - tmp=${1##*/} - tmp=${tmp%$SRCEXT} - for a in ${ARCHES[@]}; do - tmp=${tmp%-$a} - done - tmp=${tmp%-any} - echo ${tmp%-*-*} -} - -pkgver_from_src() { - tmp=${1##*/} - tmp=${tmp%$SRCEXT} - for a in ${ARCHES[@]}; do - tmp=${tmp%-$a} - done - tmp=${tmp%-any} - echo $tmp | sed 's|.*-$.*-.*$$|\1|g' -} - create_srcpackage() { if [ -d "$1" ]; then pushd "$1" >/dev/null @@ -94,38 +73,6 @@ create_srcpackage() { fi } -remove_old() { - if [ -d "$1" ]; then - pushd "$1" >/dev/null - PKGVERS="" - for repo in *; do - cd "$repo" - . "$BUILDSCRIPT" - PKGVERS="$PKGVERS $pkgver-$pkgrel" - cd .. - done - - for srcpkg in "$srcpath/$packagename-"*; do - [ -f "$srcpkg" ] || continue - if [ "$(pkgname_from_src $srcpkg)" == "$packagename" ]; then - skip=0 - pver="$(pkgver_from_src $srcpkg)" - for v in $PKGVERS; do - if [ "$v" = "$pver" ]; then - skip=1 - break - fi - done - if [ $skip -ne 1 ]; then - mv "$srcpkg" $SOURCE_CLEANUP_DESTDIR - fi - fi - done - - popd >/dev/null - fi -} - trap ctrl_c 2 trap cleanup 0 1 @@ -135,7 +82,6 @@ set_umask cd "$WORKDIR" if /usr/bin/svn export -q "$SVNREPO/$packagename" $packagename; then - remove_old "$packagename/repos/" create_srcpackage "$packagename/repos/$reponame-$_arch" else die "\tPackage '$packagename' does not exist in repo '$reponame-$_arch'" diff --git a/misc-scripts/sourceballs-cleanup b/misc-scripts/sourceballs-cleanup new file mode 100755 index 0000000..0a1ac4d --- /dev/null +++ b/misc-scripts/sourceballs-cleanup @@ -0,0 +1,95 @@ +#!/bin/bash + +. "$(dirname $0)/../db-functions" +. "$(dirname $0)/../config" + +srcpath="$FTP_BASE/sources/" +logfile="$srcpath/cleanup.txt" + +LOCKFILE="/tmp/.sourceball-cleanup.lock" +WORKDIR="/tmp/sourceball-cleanup.$packagename.$UID" + +cleanup () { + restore_umask + rm -rf "$WORKDIR" + rm -f "$LOCKFILE" + exit 0 +} + +ctrl_c() { + echo "Interrupted" >&2 + cleanup 0 +} + +remove_old() { + if [ -d "$1" ]; then + pushd "$1" >/dev/null + PKGVERS="" + for repo in *; do + cd "$repo" + . "$BUILDSCRIPT" + PKGVERS="$PKGVERS $pkgver-$pkgrel" + cd .. + done + + for srcpkg in "$srcpath/$packagename-"*; do + [ -f "$srcpkg" ] || continue + if [ "$(pkgname_from_src $srcpkg)" == "$packagename" ]; then + skip=0 + pver="$(pkgver_from_src $srcpkg)" + for v in $PKGVERS; do + if [ "$v" = "$pver" ]; then + skip=1 + break + fi + done + if [ $skip -ne 1 ]; then + mv "$srcpkg" $SOURCE_CLEANUP_DESTDIR + fi + fi + done + + popd >/dev/null + fi +} + +if [ -f "$LOCKFILE" ]; then + owner="$(/usr/bin/stat -c %U $LOCKFILE)" + echo "error: source tarball generation is already in progress (started by $owner)" + exit 1 +fi + +trap cleanup 0 +trap ctrl_c 2 + +/bin/touch "$LOCKFILE" + +#adjust the nice level to run at a lower priority +/usr/bin/renice +10 -p $$ > /dev/null + +set_umask +/bin/mkdir -p "$WORKDIR" +cd "$WORKDIR" + +[ -e "$logfile" ] && /bin/mv "$logfile" "$logfile.old" +echo "Orphaned sourceballs:" > "$logfile" + +for sourceball in "$srcpath"/*$SRCEXT; do + packagename=$(basename $sourceball) + packagename=${packagename%-*-*$SRCEXT} + + if ! /usr/bin/svn export -q --force "$SVNREPO/$packagename" "$packagename" >/dev/null 2>&1 ; then + echo "$packagename : no longer in svn. Removing sourceball." >> "$logfile" + mv $sourceball $SOURCE_CLEANUP_DESTDIR + elif [ -z "$(ls -A "$packagename/repos")" ]; then + echo "$packagename : no longer in repos but trunk is still in svn. Removing sourceball." >> "$logfile" + mv $sourceball $SOURCE_CLEANUP_DESTDIR + elif ! source "$packagename/trunk/$BUILDSCRIPT" && chk_license ${license[@]}; then + echo "$packagename : source hosting no longer required by license. Removing sourceball." >> "$logfile" + mv $sourceball $SOURCE_CLEANUP_DESTDIR + else + remove_old "$packagename/repos/" + fi +done + +cleanup 0 -- 1.6.6.1

4 10

[arch-dev-public] [signoff] b43-fwcutter-012-1
by Tobias Powalowski 02 May '10

02 May '10

Hi bumped to latest version, please signoff both arches. greetings tpowa -- Tobias Powalowski Archlinux Developer & Package Maintainer (tpowa) http://www.archlinux.org tpowa(a)archlinux.org

2 4

[arch-dev-public] [signoff] lvm2/device-mapper 2.02.61-1
by Eric Bélanger 31 Mar '10

31 Mar '10

Hi, lvm2/device-mapper 2.02.61-1 are now in testing: - minor upstream update - Add optional lvmwait= command line parameter, fixes FS#18428 Please test and signoff. Signoffs from users are welcome. Eric lvm2: Version 2.02.61 - 15th February 2010 ==================================== Fix some consts and floating point gcc warnings. Fix dm_report_field_uint64 function to accept 64-bit ints. Change readhead display to use 32-bit -1 const instead of 64-bit. Add LVM_SUPPRESS_LOCKING_FAILURE_MESSAGES environment variable. Remove hard-coding that skipped _mimage devices from 11-dm-lvm.rules. Use udev transactions in test suite. Set udev state automatically instead of using LVM_UDEV_DISABLE_CHECKING. Add lvm_pv_get_size, lvm_pv_get_free and lvm_pv_get_dev_size to lvm2app. Change lvm2app to return all sizes in bytes as documented (not sectors). Add 'fail_if_percent_unsupported' arg to _percent and _percent_run. Remove false "failed to find tree node" error when activating merging origin. Exit with success when lvconvert --repair --use-policies performs no action. Accept a list of LVs with 'lvconvert --merge @tag' using process_each_lv. Avoid unnecessary second resync when adding mimage to core-logged mirror. Exclude internal VG names and uuids from lists returned through liblvm. Add %ORIGIN support to lv{create,extend,reduce,resize} --extents. Add _mda_copy to clone a struct metadata_area. Remove pointless versioned symlinks to dmeventd plugin libraries. Fix dmeventd snapshot plugin build dependency. Make clvmd -V return status zero. Remove unnecessary 'dmsetup resume' following 'dmsetup create' in tests. Fix cmirrord segfault in clog_cpg list processing when converting mirror log. Deactivate temporary pvmove mirror cluster-wide when activating it fails. Always query device by uuid and not name in clvmd. Add missing metadata vg_reverts in pvmove error paths. Unlock shared lock in clvmd if activation calls fail. Return success from dev_manager_info with non-existent uuid if ioctl succeeds. device-mapper: Version 1.02.44 - 15th February 2010 ==================================== Add DM_UDEV_DISABLE_LIBRARY_FALLBACK udev flag to rely on udev only. Export dm_udev_create_cookie function to create new cookies on demand. Add --udevcookie, udevcreatecookie and udevreleasecookie to dmsetup. Set udev state automatically instead of using DM_UDEV_DISABLE_CHECKING.

5 6

Re: [arch-dev-public] [arch-general] Fwd: FS#17503: [unzip] zsh completion missing for unzip patches
by Thayer Williams 11 Mar '10

11 Mar '10

On Fri, Feb 26, 2010 at 12:34 PM, Xavier Chantry <chantry.xavier(a)gmail.com> wrote: > On Fri, Feb 26, 2010 at 8:20 PM, Thayer Williams <thayerw(a)gmail.com> wrote: >> >> Bumping this for feedback. 7z correctly unzips localized win32 zip >> files, but bsdtar/unzip cannot. Is that good enough to remove the >> conflicting win32 patches from unzip? >> > > Links to feature request for adding support to bsdtar / unzip would be good. > If I understand correctly, there should already be some for unzip. > And what about bsdtar ? Sorry Xavier, all of that info was in my original email, included below for reference. The patch we currently use for unzip has been rejected more than once upstream and it is conflicting with zsh autocompletion. bsdtar apparently doesn't support localized win32 zip files either, but p7zip does. If the bsdtar maintainer wants to take it upstream that's fine, but in the meantime I'd like to move forward with the unzip fix unless we have a reason not to. On Tue, Jan 19, 2010 at 12:06 PM, Thayer Williams <thayerw(a)gmail.com> wrote: > > Hoping for some feedback here from more experienced devs on this one: > > At some point we began patching unzip with additional flags, allowing it to > properly extract UTF-encoded zip files made on the win32 platform. Apparently > this has broken zsh autocompletion features. Similar unzip patches have been > submitted upstream and all have been rejected. Upstream has considered adding > proper support, but has stopped short of committing to it. > > The question is do we keep the patch and make this a zsh issue, or do we > remove the patch, fixing zsh in the process and screwing some win32 zip files? > > More info: > > http://bugs.archlinux.org/task/17503 > http://bugs.archlinux.org/task/15256 > >

3 3

[arch-dev-public] [signoff] openssh-5.3p1-4
by Daniel J Griffiths (Ghost1227) 09 Mar '10

09 Mar '10

Release addressed the issue of startup scripts not properly checking pid files (FS#17138). Please sign off both architectures. --

4 4

[arch-dev-public] Automating creation of i686 chroots on x86_64 systems with mkarchroot.
by Daniel J Griffiths (Ghost1227) 09 Mar '10

09 Mar '10

I've always thought the method of modifying your local mirrorlist, running mkarchroot, then reverting the changes to be more tedious than necessary for creation of i686 chroots on x86_64. My recent work with setting up a dedicated build server gave me plenty of time and an excuse to actually do something about it. As such, I've put together a little patch that allows specification of creation of an i686 chroot at runtime. When set, this flag will automatically modify your local mirrorlist, create the requested i686 chroot, then revert the changes to the mirrorlist file. I don't know if others would find this useful or not, but I figured it wouldn't hurt to post it.

5 14

[arch-dev-public] Fixing groupadd
by Allan McRae 07 Mar '10

07 Mar '10

Hi, At the moment, groupadd always creates system groups with GID=99. (http://bugs.archlinux.org/task/16092). We can fix this by adding something quite standard like: SYS_UID_MIN = 100 SYS_GID_MIN = 100 SYS_UID_MAX = 999 SYS_GID_MAX = 999 in /etc/login.defs But this will lead to possible issues with packages using fixed GID >= 100. e.g. I could create a bunch system groups and then install a package who has predetermined that an already used group ID is for it. There are two possible solutions: 1) Set SYS_{U,G}ID_MIN to (e.g.) 500 and have all packages use numbers below 500. 2) Have the packages create a group without a specified ID. Anything requiring a fixed group ID at compile time (e.g. mailman) must use a number < 100. I am in favour of #2 (slightly) as it seems the better solution, but #1 would only require shadow to be fixed and no rebuilds for other packages (the number of rebuilds for #2 would be very small). Opinions? Allan

4 9

[arch-dev-public] monotone needs boost 1.8.x
by Andrea Scarpino 05 Mar '10

05 Mar '10

Hi DEVs, monotone in [extra] does not work with the current boost (FS#17297). It requires explicitly boost < 1.9. It's orphan too. So, we have two possibility now: 1) add boost18 to [extra] 2) move monotone to AUR What do you think about? Regards -- Andrea `bash` Scarpino Arch Linux Developer

6 11

[arch-dev-public] [PATCH 0/4] create-filelists patchset
by Dan McGee 03 Mar '10

03 Mar '10

This is a series of patches to make create-filelists a lot more efficient at what it does, and also make the files database a lot more useful. The end-user result is that the files database also includes the 'desc' and 'depends' entries found in a normal .db.tar.gz database. As far as other changes, the package loop rework patch is the most important one. Rather than inefficiently unzip every package to get the .PKGINFO file and determine its name and version, we use the .db.tar.gz directly which saves us a ton of work in most cases. Comments welcome, I'm not sure who is the head honcho that will pull these in, but it does help setup re-adding file support in archweb in addition to making this cron job suck a bit less. We might even think about running it more often than once a day now. -Dan Dan McGee (4): create-filelists: general cleanups create-filelists: s/REPO_DB_FILE/FILES_DB_FILE/g create-filelists: rework the package loop completely create-filelists: include desc/depends entries cron-jobs/create-filelists | 78 ++++++++++++++++++++++++++++---------------- 1 files changed, 50 insertions(+), 28 deletions(-)

3 8