August 2011 - Arch-releng - lists.archlinux.org

[arch-releng] archiso: also putting the hour in version string
by Dieter Plaetinck 21 Aug '11

21 Aug '11

Hi, I would like to run multiple builds per day. For this I would like to also put the hour of building in the iso filenames. something like: diff --git a/configs/releng/build.sh b/configs/releng/build.sh index 1aa80fd..7fce685 100755 --- a/configs/releng/build.sh +++ b/configs/releng/build.sh @@ -4,7 +4,7 @@ set -e -u name=archlinux iso_label="ARCH_$(date +%Y%m)" -version=$(date +%Y.%m.%d) +version=$(date +%Y.%m.%d.%H) install_dir=arch arch=$(uname -m) work_dir=work Or, maybe this is too releng-specific (i.e. most people who run archiso probably prefer $(date +%Y.%m.%d), in which case: can you give archiso a flag so that I can control the version as a parameter? ./build.sh all_iso_single 2011.08.14.12 ./build.sh all_iso_dual 2011.08.14.12 ./build.sh all_iso_dual 2011.08.14-lets-try-some-new-code passing it as a flag would also be more robust. Things could go wrong (I think?) if the all_iso_single runs at 23:45 of one day and all_iso_dual runs at 00:15 the next morning. Dieter

2 15

[arch-releng] archiso / aif log
by Dieter Plaetinck 20 Aug '11

20 Aug '11

In preparation for the new release, I went over git logs since 2010.05 and jotted down what seems to me is important. I will put this list in the news announcement, so suggestions welcome. Archiso (image builds): * TODO fill in: snapshot of current core, including kernel 3., pacman-3 and glibc. * Big overhaul: use dm-snapshot instead of aufs2 * Consolidate image building, use single build.sh script which also does dual-arch images. * Allow changing NBD export name * Allow using serial console with console kernel parameter. * Allow starting custom script with script kernel parameter, autologin tty1. * Add support to mount iso in loopback mode * Add new menu entry "Power off" * Add rsync,hdparm,dhclient,crda, wpa_actiond, netcf, curl, nilfs-utils, btrfs-progs-unstable to live-enviroment * Remove joe from packagelist. * Remove x86test, add HDT to initial syslinux menu * Add support for booting from memdisk * Various cleanups, improvements and bugfixes. AIF (installation tool): * experimental support for btrfs and nilfs2. * support syslinux next to grub. * changes to configuration formats to support new rc.conf and linux3.0 * make selecting source more flexible (multiple local and/or remote repos) * remove joe * show package descriptions when installing packages * run with debugging and logging enabled by default, add /arch/report-issues script * make automatic profiles switch source depending on whether core or netinstall system is running * remove support for tcp_wrappers in accordance to Arch Linux policy * change develop model: primary development goes on in (rewritable) develop branch, master == stable. * various code cleanups, improvements and bugfixes.

4 8

[arch-releng] [RFC] [PATCH] [configs/releng] Add four packages to live-enviroment
by Gerardo Exequiel Pozzi 19 Aug '11

19 Aug '11

core/linux-atm: * This was present in 2010.05 * Optionally needed by iproute2. Needed for ATM connections. extra/irssi: * Requested by Florian Pritz http://mailman.archlinux.org/pipermail/arch-releng/2011-July/001853.html extra/smartmontools: * Requested by Thomas Mudrunka https://bugs.archlinux.org/task/25633 extra/mtools: * This was present in 2010.05 * Optionally dependency of syslinux. Needed if want to install syslinux on vfat. Signed-off-by: Gerardo Exequiel Pozzi <vmlinuz386(a)yahoo.com.ar> --- configs/releng/packages.i686 | 4 ++++ configs/releng/packages.x86_64 | 4 ++++ 2 files changed, 8 insertions(+), 0 deletions(-) diff --git a/configs/releng/packages.i686 b/configs/releng/packages.i686 index a7427aa..27db22c 100644 --- a/configs/releng/packages.i686 +++ b/configs/releng/packages.i686 @@ -16,8 +16,11 @@ hdparm inetutils ipw2100-fw ipw2200-fw +irssi lftp lilo +linux-atm +mtools netcfg nfs-utils nilfs-utils @@ -32,6 +35,7 @@ parted pptpclient rp-pppoe rsync +smartmontools speedtouch tcpdump vpnc diff --git a/configs/releng/packages.x86_64 b/configs/releng/packages.x86_64 index a7427aa..27db22c 100644 --- a/configs/releng/packages.x86_64 +++ b/configs/releng/packages.x86_64 @@ -16,8 +16,11 @@ hdparm inetutils ipw2100-fw ipw2200-fw +irssi lftp lilo +linux-atm +mtools netcfg nfs-utils nilfs-utils @@ -32,6 +35,7 @@ parted pptpclient rp-pppoe rsync +smartmontools speedtouch tcpdump vpnc -- 1.7.6

3 6

[arch-releng] [RFC] [PATCH] [configs/releng] Replace rc.d/archiso with initscripts hooks.
by Gerardo Exequiel Pozzi 18 Aug '11

18 Aug '11

In this way: * Prepare locales requested by boot param mostly early possible. * Setup special console at end of rc.sysinit Remove unneded include from automated_script (already included by rc.conf) Signed-off-by: Gerardo Exequiel Pozzi <vmlinuz386(a)yahoo.com.ar> --- configs/releng/root-image/etc/rc.conf | 2 +- configs/releng/root-image/etc/rc.d/archiso | 45 -------------------- .../etc/rc.d/functions.d/automated_script | 2 - .../etc/rc.d/functions.d/prepare_locale_gen | 11 +++++ .../etc/rc.d/functions.d/setup_special_console | 25 +++++++++++ 5 files changed, 37 insertions(+), 48 deletions(-) delete mode 100755 configs/releng/root-image/etc/rc.d/archiso create mode 100644 configs/releng/root-image/etc/rc.d/functions.d/prepare_locale_gen create mode 100644 configs/releng/root-image/etc/rc.d/functions.d/setup_special_console diff --git a/configs/releng/root-image/etc/rc.conf b/configs/releng/root-image/etc/rc.conf index 42084f6..a3e3d8a 100644 --- a/configs/releng/root-image/etc/rc.conf +++ b/configs/releng/root-image/etc/rc.conf @@ -30,4 +30,4 @@ USELVM="no" HOSTNAME="archiso" -DAEMONS=(hwclock syslog-ng archiso) +DAEMONS=(hwclock syslog-ng) diff --git a/configs/releng/root-image/etc/rc.d/archiso b/configs/releng/root-image/etc/rc.d/archiso deleted file mode 100755 index cc930f6..0000000 --- a/configs/releng/root-image/etc/rc.d/archiso +++ /dev/null @@ -1,45 +0,0 @@ -# vim: set ft=sh: -. /etc/rc.conf -. /etc/rc.d/functions - -do_locale_gen () -{ - if [[ ${LOCALE} != "en_US.UTF-8" ]]; then - stat_busy "Generating locales..." - sed -i "s/#$${LOCALE/[@.]*}$/\1/" /etc/locale.gen - /usr/sbin/locale-gen > /dev/null - stat_done - fi -} - -# If an alternate console was specified on the kernel command line, -# start agetty on it too. -do_special_console() -{ - local cmdline_console - if cmdline_console=$(kernel_cmdline console); then - stat_busy "Starting agetty on console: ${cmdline_console}" - local port options baud rts - port=${cmdline_console%%,*} - options=${cmdline_console#${port}} - options=${options#,} - baud=${options%%[neo]*} - [[ ${options} =~ r$ ]] && rts="-h" - if ! grep -q "^${port}" /etc/securetty; then - echo ${port} >> /etc/securetty - fi - if ! grep -q "^z0:" /etc/inittab; then - echo "z0:2345:respawn:/sbin/agetty -8 -s ${rts} ${baud:-9600} ${port} linux" >> /etc/inittab - fi - /sbin/telinit q - stat_done - fi -} - -case "$1" in - start) - do_locale_gen - do_special_console - ;; -esac -exit 0 diff --git a/configs/releng/root-image/etc/rc.d/functions.d/automated_script b/configs/releng/root-image/etc/rc.d/functions.d/automated_script index edb8ea3..7a35acb 100644 --- a/configs/releng/root-image/etc/rc.d/functions.d/automated_script +++ b/configs/releng/root-image/etc/rc.d/functions.d/automated_script @@ -1,5 +1,3 @@ -. /etc/archiso/functions - automated_script () { script="$(kernel_cmdline script)" diff --git a/configs/releng/root-image/etc/rc.d/functions.d/prepare_locale_gen b/configs/releng/root-image/etc/rc.d/functions.d/prepare_locale_gen new file mode 100644 index 0000000..47ed79d --- /dev/null +++ b/configs/releng/root-image/etc/rc.d/functions.d/prepare_locale_gen @@ -0,0 +1,11 @@ +prepare_locale_gen () +{ + if [[ ${LOCALE} != "en_US.UTF-8" ]]; then + stat_busy "Generating locales..." + sed -i "s/#$${LOCALE/[@.]*}$/\1/" /etc/locale.gen + /usr/sbin/locale-gen > /dev/null + stat_done + fi +} + +add_hook sysinit_postmount prepare_locale_gen diff --git a/configs/releng/root-image/etc/rc.d/functions.d/setup_special_console b/configs/releng/root-image/etc/rc.d/functions.d/setup_special_console new file mode 100644 index 0000000..93553a6 --- /dev/null +++ b/configs/releng/root-image/etc/rc.d/functions.d/setup_special_console @@ -0,0 +1,25 @@ +# If an alternate console was specified on the kernel command line, +# start agetty on it too. +setup_special_console() +{ + local cmdline_console + if cmdline_console=$(kernel_cmdline console); then + stat_busy "Starting agetty on console: ${cmdline_console}" + local port options baud rts + port=${cmdline_console%%,*} + options=${cmdline_console#${port}} + options=${options#,} + baud=${options%%[neo]*} + [[ ${options} =~ r$ ]] && rts="-h" + if ! grep -q "^${port}" /etc/securetty; then + echo ${port} >> /etc/securetty + fi + if ! grep -q "^z0:" /etc/inittab; then + echo "z0:2345:respawn:/sbin/agetty -8 -s ${rts} ${baud:-9600} ${port} linux" >> /etc/inittab + fi + /sbin/telinit q + stat_done + fi +} + +add_hook sysinit_end setup_special_console -- 1.7.6

2 3

[arch-releng] Please test the recent isos
by Dieter Plaetinck 18 Aug '11

18 Aug '11

Hi all, I would like to push out a new official release soon, both archiso and aif are brought up to date and things seem pretty good. Official media are pretty much broken because of their outdatedness so it's important to come out with something new soon, and I will be a bit less pedantic in terms of quality control. Here's how you can help: get 2011.08.13 or 2011.08.14 (will start building in a few hours) or later and do an installation with it. Preferably pick options and features that have no mention yet on http://www.archlinux.org/releng/feedback/ (i.e. if "last success" shows 2011.08.13 or 2011.08.14 for architectures i686 and x86_64, then try a dual image, similarly try to try a filesystem that others haven't tried yet, etc) There is a bug with 2011.08.13 in that it will solely use the first repository you picked in "Select source", you can ignore that, it's fixed already in git. (if you use these images, make sure your first select item is a [core] repo) http://releng.archlinux.org/isos/ http://www.archlinux.org/releng/feedback/ thanks for your help, Dieter

7 28

[arch-releng] [PATCH] Bugfix: correctly prevent empty labels/uuid's
by Dieter Plaetinck 17 Aug '11

17 Aug '11

Actually check the return value of the getlabel/getuuid calls to decide whether to overwrite $part, not the return value of the local declaration. --- src/core/libs/lib-blockdevices-filesystems.sh | 6 ++++-- src/core/libs/lib-ui-interactive.sh | 6 ++++-- 2 files changed, 8 insertions(+), 4 deletions(-) diff --git a/src/core/libs/lib-blockdevices-filesystems.sh b/src/core/libs/lib-blockdevices-filesystems.sh index fafbd1a..c7bf47b 100644 --- a/src/core/libs/lib-blockdevices-filesystems.sh +++ b/src/core/libs/lib-blockdevices-filesystems.sh @@ -871,9 +871,11 @@ process_filesystem () then case "$PART_ACCESS" in label) - local label="$(getlabel $part)" && part="LABEL=$label";; + local label + label="$(getlabel $part)" && part="LABEL=$label";; uuid) - local uuid="$(getuuid $part)" && part="UUID=$uuid";; + local uuid + uuid="$(getuuid $part)" && part="UUID=$uuid";; esac if ! grep -q "$part $fs_mountpoint $fs_type defaults 0 " $TMP_FSTAB 2>/dev/null #$TMP_FSTAB may not exist yet then diff --git a/src/core/libs/lib-ui-interactive.sh b/src/core/libs/lib-ui-interactive.sh index 6e2324a..4973e22 100644 --- a/src/core/libs/lib-ui-interactive.sh +++ b/src/core/libs/lib-ui-interactive.sh @@ -1274,10 +1274,12 @@ get_kernel_parameters() { case "$PART_ACCESS" in label) - local label="$(getlabel $rootpart)" && \ + local label + label="$(getlabel $rootpart)" && \ rootpart="/dev/disk/by-label/$label" ;; uuid) - local uuid="$(getuuid $rootpart)" && \ + local uuid + uuid="$(getuuid $rootpart)" && \ rootpart="/dev/disk/by-uuid/$uuid" ;; esac -- 1.7.6

1 0

[arch-releng] showing a list of all isos with number of failures and success for each
by Dieter Plaetinck 16 Aug '11

16 Aug '11

Hey Tom, would it be possible to add on http://www.archlinux.org/releng/feedback/, a list of all iso names with the numbers of failures and successes for each? and each iso could be a link to a page like http://www.archlinux.org/releng/feedback/iso/15/ In absense of real supported iso's, a short overview like this would be the next best thing for a community member to figure out which iso he should download. Dieter

3 6

Re: [arch-releng] [arch-dev-public] [signoff] mkinitcpio-busybox 1.18.5-1
by Gerardo Exequiel Pozzi 16 Aug '11

16 Aug '11

On 08/13/2011 08:32 PM, Thomas Bächler wrote: > Upstream update, also enable md5sum, sha1sum, sha256sum and sha512sum. > > Please sign off. > Signoff, i686 (testing with configs/baseline) :: Mounted archiso volume successfully. :: Self-test requested, please wait...done. Checksum is OK, continue booting. :: Mounting /cowspace (tmpfs) filesystem, size=75%...done. :: Mounted archiso volume successfully. :: Self-test requested, please wait...ERROR: one or more files are corrupted see /checksum.log for details sh: can't access tty; job control turned off [ramfs /]# cat checksum.log ./i686/root-image.fs.sfs: FAILED ./aitab: OK ./boot/syslinux/menu.c32: OK ./boot/syslinux/syslinux.cfg: OK ./boot/i686/vmlinuz: OK ./boot/i686/archiso.img: OK md5sum: WARNING: 1 of 6 computed checksums did NOT match -- Gerardo Exequiel Pozzi \cos^2\alpha + \sin^2\alpha = 1

2 1

[arch-releng] new test isos for upcoming release, testing needed
by Dieter Plaetinck 15 Aug '11

15 Aug '11

Hi guys, here are the latest testbuilds, please give them a spin. I want to do a new official release asap! http://releng.archlinux.org/isos/2011.08.15/ If you find bugs -> https://bugs.archlinux.org/index.php?project=6 To let me know how your installation went -> http://www.archlinux.org/releng/feedback/submit/ This is sort of a signoff system but you can specify exactly which options you tested. I want to see as many mentions of 2011.08.15 in the "last success" column of http://www.archlinux.org/releng/feedback/ as possible. So have a look there first, you'll see that it needs more testing on x86_64 systems, a physical install, PXE boot, etc. thank you, Dieter PS: a draft of the news message, so you know what's included. 2011.08 snapshots. Hi, time for a much needed update to the Arch installation media, as the last release (<a href="http://www.archlinux.org/news/201005-snapshots-less-is-more/">2010.05</a>) is not only quite outdated, but yields broken installations if you do a netinstall (because the old installer is not aware of the <a href="http://www.archlinux.org/news/changes-to-kernel-package-and-filenames/">changed kernel/initramfs filename</a> in our new Linux 3.0 packages). What has changed in this period of more then a year? <a href="http://projects.archlinux.org/archiso.git/">Archiso</a> (image builds): * TODO fill in snapshot of current core, including kernel 3., pacman-3 and * glibc,, mkinitcpio/initscripts/netcfg * Big overhaul: use dm-snapshot instead of aufs2 * Consolidate image building, use single build.sh script which also does dual-arch images. * All needed files to boot for custom USB mediums installed on /arch * Allow changing NBD export name * Allow using serial console with console kernel parameter. * Allow starting custom script with script kernel parameter, autologin tty1. * Add support to mount iso in loopback mode * Add new menu entry "Power off" * Added packages: btrfs-progs-unstable crda curl dhclient dialog dnsmasq hdparm netcfg nilfs-utils openconnect rp-pppoe rsync vpnc wpa_actiond * Removed packages: aufs2 aufs2-util joe ndiswrapper ndiswrapper-utils tiacx tiacx-firmware * Remove x86test, add HDT to initial syslinux menu * Add support for booting from memdisk * XZ compression for SquashFS and initramfs. * Various cleanups, improvements and bugfixes. <a href="http://projects.archlinux.org/aif.git/"AIF</a> (installation tool): * experimental support for btrfs and nilfs2. * support syslinux next to grub. * changes to configuration formats to support new rc.conf and linux3.0 * make selecting source more flexible (multiple local and/or remote repos) * show package descriptions when installing packages * run with debugging and logging enabled by default, add /arch/report-issues script * make automatic profiles switch source depending on whether core or netinstall system is running * remove support for tcp_wrappers in accordance to Arch Linux policy * change develop model: primary development goes on in (rewritable) develop branch, master == stable. * various code cleanups, improvements and bugfixes. <a href="https://github.com/Dieterbe/libui-sh">libui.sh</a> (bash UI framework) * made long checklists much easier in CLI mode, by using $EDITOR * fix an endless loop in CLI mode. * more flexible initialisation <a href"=http://wiki.archlinux.org/index.php/Official_Arch_Linux_Install_Guide"Official installation guide</a>: * brought up to date. For those interested in the build environment (which is now set up on a <a href="releng.archlinux.org">new server</a>), can check <a href="http://projects.archlinux.org/users/dieter/releng.git/">releng.git</a> Please assure tickets exist in the <a href="https://bugs.archlinux.org/index.php?project=6">bugtracker - Release Engineering project</a> for any issues you may find. * <a href="http://www.archlinux.org/download/">Download</a> * <a href="http://wiki.archlinux.org/index.php/DeveloperWiki:2011.08">List of * packages</a>

2 1

[arch-releng] archiso master branch updated
by Gerardo Exequiel Pozzi 15 Aug '11

15 Aug '11

b6df75e [archiso] Delete README.old c2aefad [archiso] Makefile trivial fix (if configs/ already on DESTDIR) 90cfe3c [archiso] Add checksum= boot param 12e9d32 [configs/releng] Add purge_* commands 808c1a0 [configs/*] Use $script_path for "source" files. 8b2acca [configs/*] Remove custom fstab, not needed anymore. -- Gerardo Exequiel Pozzi \cos^2\alpha + \sin^2\alpha = 1

1 1