March 2010 - Arch-releng - lists.archlinux.org

[arch-releng] Make archiso PXE & NBD friendly (server and client mode)
by Gerardo Exequiel Pozzi 23 Mar '10

23 Mar '10

Hello I recently done some changes for archiso, to make it booteable via PXE (Preboot eXecution Environment) and using NBD (Network Block Device). Also a minimal server script can be launched to act as server ;) If booted from network, there is a [nbd] hook, (based on [net]), that configures an IP address, then setup a /dev/nbd0 (via nbd-client). (and /dev/archiso will point to this device), all the rest is done by current archiso hook :) (copytoram option can be used) If booted normally, [nbd] hook does nothing. Inside the /root, there is a simple script that launches dnsmasq enabling tftp and dhcp server, finally start the nbd-server that serve the iso file via network. Tested on real machine, kvm and Virtualbox, works very nice. Relevant commit (adding nbd hook to pxe_nbd branch ) [#1] and sample usage (diff based on my avr-toolchain branch) [#2] All step to make iso are here [#3] NOTE: nbd [#4] package from AUR is needed, so additional steps should be done than normal process. :( Just for fun, all comments welcomed. Good luck! [#1] http://github.com/djgera/archiso/commit/6023d6f78e3e68c2ad9ae595879a53b6771… [#2] http://github.com/djgera/archiso/commit/ed15360b828671fb6732f8f52ff00de09b2… [#3] http://github.com/djgera/archiso/blob/037d265360c76275be0745d77e2f008137550… [#4] http://aur.archlinux.org/packages.php?ID=9691 -- Gerardo Exequiel Pozzi ( djgera ) http://www.djgera.com.ar KeyID: 0x1B8C330D Key fingerprint = 0CAA D5D4 CD85 4434 A219 76ED 39AB 221B 1B8C 330D

3 6

Re: [arch-releng] isohybrid -offset 1, can't mount partitions inside live env
by Gerardo Exequiel Pozzi 23 Mar '10

23 Mar '10

On 03/15/2010 10:25 PM, Sven-Hendrik Haase wrote: > On 15.03.2010 16:41, Gerardo Exequiel Pozzi wrote: > >> Hello, >> >> There is another issue with offset 1. This does not happen with offset 0. >> >> My scenario: >> * 2G USB key >> * isohybrid -offset 1 >> * another primary partition created (also is the same issue happens with a logical part instead) >> >> >> # mount /dev/sdc2 /home/hola >> mount: /dev/sdc2 already mounted or /home/hola busy >> >> ** strace shows: >> mount("/dev/sdc2", "/home/hola/", "ext2", MS_MGC_VAL, NULL) = -1 EBUSY (Device or resource busy) >> >> >> # mkfs.ext2 /dev/sdc2 >> mke2fs 1.41.10 (10-Feb-2009) >> /dev/sdc2 is apparently in use by the system; will not make a filesystem here! >> >> ** strace shows: >> open("/dev/sdc2", O_RDONLY|O_EXCL) = -1 EBUSY (Device or resource busy) >> >> >> My conclusion is, isohybrid mode is a great hack!. But of course, carries some inevitable issues. >> >> The big dichotomy: >> * offset 1: >> + allows some partitions programs works without issues. (at least I know about parted issue) >> - Can not use extra partitions created in the medium. >> - Can not use /dev/disk/by-label/ skip archiso_early. >> >> * offset 0: >> - Cause issues with some partitions programs. >> + Can use extra partitions. >> + Can use "by-label" (under condition that all partitions must have a LABEL) >> >> >> Good luck! >> >> >> > Ok, so let's use the upstream recommended offset 0 for now as well. By > the way, I was actually able to use extra partitions and boot from them > with offset 1 but my results do not appear to be consistent. > Okey. Note that archboot use the default mode. > They are currently deciding on a more proper way for isohybrid on the > syslinux mailing list to work while being integrated in the iso > generation process itself so as not to be a hack anymore. Until then, > we'll have to think about something ourselves. > Good. > So use offset 0 instead of 1 for now? > Yes. I agree. I will push the patch that removes archiso_early on my git branch to be merged in master ;) Thanks for the feedback. -- Gerardo Exequiel Pozzi ( djgera ) http://www.djgera.com.ar KeyID: 0x1B8C330D Key fingerprint = 0CAA D5D4 CD85 4434 A219 76ED 39AB 221B 1B8C 330D

3 8

[arch-releng] [PATCH 14/15] [syslinux-iso] Set iso and kernel version dynamically.
by Gerardo Exequiel Pozzi 17 Mar '10

17 Mar '10

Signed-off-by: Gerardo Exequiel Pozzi <vmlinuz386(a)yahoo.com.ar> --- configs/syslinux-iso/Makefile | 7 ++++--- 1 files changed, 4 insertions(+), 3 deletions(-) diff --git a/configs/syslinux-iso/Makefile b/configs/syslinux-iso/Makefile index 9368d1e..04c2de1 100644 --- a/configs/syslinux-iso/Makefile +++ b/configs/syslinux-iso/Makefile @@ -1,5 +1,4 @@ -ver=2010.03 -kver=2.6.32-ARCH +ver=$(shell date +%Y.%m.%d) WORKDIR=work @@ -11,6 +10,8 @@ COREname=$(PWD)/archlinux-$(ver)-core-$(ARCH).iso PACKAGES="$(shell cat packages.$(ARCH))" +kver_FILE=$(WORKDIR)/root-image/etc/mkinitcpio.d/kernel26.kver + all: net-iso core-iso # Rules for each type of image @@ -48,7 +49,7 @@ bootfiles: root-image initcpio: $(WORKDIR)/iso/boot/archiso.img $(WORKDIR)/iso/boot/archiso.img: mkinitcpio.conf $(WORKDIR)/root-image/.arch-chroot mkdir -p $(WORKDIR)/iso/boot - mkinitcpio -c ./mkinitcpio.conf -b $(WORKDIR)/root-image -k $(kver) -g $@ + mkinitcpio -c ./mkinitcpio.conf -b $(WORKDIR)/root-image -k $(shell grep ^ALL_kver $(kver_FILE) | cut -d= -f2) -g $@ # overlay filesystem -- 1.7.0.2

1 2

Re: [arch-releng] [PATCH 07/13] version update in Makefile
by Gerardo Exequiel Pozzi 16 Mar '10

16 Mar '10

On 03/16/2010 11:22 AM, Gerardo Exequiel Pozzi wrote: > On 03/16/2010 06:11 AM, Dieter Plaetinck wrote: >> On Tue, 16 Mar 2010 03:29:17 -0300 >> Gerardo Exequiel Pozzi<vmlinuz386(a)yahoo.com.ar> wrote: >> >>> Signed-off-by: Gerardo Exequiel Pozzi<vmlinuz386(a)yahoo.com.ar> >>> --- >>> configs/syslinux-iso/Makefile | 2 +- >>> 1 files changed, 1 insertions(+), 1 deletions(-) >>> >>> diff --git a/configs/syslinux-iso/Makefile >>> b/configs/syslinux-iso/Makefile index 8118a8d..9368d1e 100644 >>> --- a/configs/syslinux-iso/Makefile >>> +++ b/configs/syslinux-iso/Makefile >>> @@ -1,4 +1,4 @@ >>> -ver=2010.02 >>> +ver=2010.03 >>> kver=2.6.32-ARCH >>> >>> WORKDIR=work >> wouldn't it be better to set ver=$((date +'%Y-%m-%d')) or however you >> should write that in Makefile syntax. >> >> now that the plan is to build automatically and frequently... >> >> Dieter >> > Yes, I done a similar change on my custom config. I can change here. > Internal label must keep with short-date ARCH_YYYYMM (11 chars). > > Also, will be good something but for kver= I thinking in parsing > $(WORKDIR)/root-image/etc/mkinitcpio.d/kernel26.kver > > What do you think? agree? > brb, missing sending this to ML. Sending the patch now... -- Gerardo Exequiel Pozzi ( djgera ) http://www.djgera.com.ar KeyID: 0x1B8C330D Key fingerprint = 0CAA D5D4 CD85 4434 A219 76ED 39AB 221B 1B8C 330D

1 0

[arch-releng] [PATCH 07/13] version update in Makefile
by Gerardo Exequiel Pozzi 16 Mar '10

16 Mar '10

Signed-off-by: Gerardo Exequiel Pozzi <vmlinuz386(a)yahoo.com.ar> --- configs/syslinux-iso/Makefile | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/configs/syslinux-iso/Makefile b/configs/syslinux-iso/Makefile index 8118a8d..9368d1e 100644 --- a/configs/syslinux-iso/Makefile +++ b/configs/syslinux-iso/Makefile @@ -1,4 +1,4 @@ -ver=2010.02 +ver=2010.03 kver=2.6.32-ARCH WORKDIR=work -- 1.7.0.2

2 7

[arch-releng] isohybrid -offset 1, can't mount partitions inside live env
by Gerardo Exequiel Pozzi 15 Mar '10

15 Mar '10

Hello, There is another issue with offset 1. This does not happen with offset 0. My scenario: * 2G USB key * isohybrid -offset 1 * another primary partition created (also is the same issue happens with a logical part instead) # mount /dev/sdc2 /home/hola mount: /dev/sdc2 already mounted or /home/hola busy ** strace shows: mount("/dev/sdc2", "/home/hola/", "ext2", MS_MGC_VAL, NULL) = -1 EBUSY (Device or resource busy) # mkfs.ext2 /dev/sdc2 mke2fs 1.41.10 (10-Feb-2009) /dev/sdc2 is apparently in use by the system; will not make a filesystem here! ** strace shows: open("/dev/sdc2", O_RDONLY|O_EXCL) = -1 EBUSY (Device or resource busy) My conclusion is, isohybrid mode is a great hack!. But of course, carries some inevitable issues. The big dichotomy: * offset 1: + allows some partitions programs works without issues. (at least I know about parted issue) - Can not use extra partitions created in the medium. - Can not use /dev/disk/by-label/ skip archiso_early. * offset 0: - Cause issues with some partitions programs. + Can use extra partitions. + Can use "by-label" (under condition that all partitions must have a LABEL) Good luck! -- Gerardo Exequiel Pozzi ( djgera ) http://www.djgera.com.ar KeyID: 0x1B8C330D Key fingerprint = 0CAA D5D4 CD85 4434 A219 76ED 39AB 221B 1B8C 330D Yahoo! Cocina Encontra las mejores recetas con Yahoo! Cocina. http://ar.mujer.yahoo.com/cocina/

1 0

[arch-releng] [PATCH] Provide wpa_supplicant in the CD environment.
by Christopher Brannon 14 Mar '10

14 Mar '10

Some people might need to use a WPA-encrypted network in conjunction with the ArchLinux CD, so this patch should make that possible. --- configs/syslinux-iso/packages.i686 | 1 + configs/syslinux-iso/packages.x86_64 | 1 + 2 files changed, 2 insertions(+), 0 deletions(-) diff --git a/configs/syslinux-iso/packages.i686 b/configs/syslinux-iso/packages.i686 index 9846482..dccc17e 100644 --- a/configs/syslinux-iso/packages.i686 +++ b/configs/syslinux-iso/packages.i686 @@ -40,4 +40,5 @@ tcpdump tiacx tiacx-firmware wireless_tools +wpa_supplicant zd1211-firmware diff --git a/configs/syslinux-iso/packages.x86_64 b/configs/syslinux-iso/packages.x86_64 index 9846482..dccc17e 100644 --- a/configs/syslinux-iso/packages.x86_64 +++ b/configs/syslinux-iso/packages.x86_64 @@ -40,4 +40,5 @@ tcpdump tiacx tiacx-firmware wireless_tools +wpa_supplicant zd1211-firmware -- 1.7.0.2

1 0

[arch-releng] aif UI-code has been split off -> new dependency/package
by Dieter Plaetinck 10 Mar '10

10 Mar '10

Hi all, [most of] AIF's user interface code has been moved into it's own project: http://github.com/Dieterbe/libui-sh http://projects.archlinux.org/aif.git/commit/?id=05e95cfbcad5965df5dc2c7e98… since aif will obviously depend on this new project and aif is in extra, this means i will have to create a new package in extra for this library. (very simple package btw, one file in /usr/lib and one in /usr/share/doc/libui-sh/) first however, i need to check if the code still behaves as it should. Dieter

1 0

[arch-releng] 2010.03 TODO for installation media.
by Gerardo Exequiel Pozzi 07 Mar '10

07 Mar '10

* Merge pending changes to archiso from me repo [#1] @ archiso2dual tool @ copytoram= option again :) @ misc changes * Make an updated AIF package with latest fixes. * TAG archiso.git with "2010.03-1" * Update the very^N old archiso package in [extra] to "2010.03-1" * Release archiso (2010.03) with the current [core] @ With current Linux 2.6.32.9. (for now) @ With future Linux 2.6.33 (if moved) * Take a decision about what isos should be available for download: @ core-dual + netinstall-dual @ core-dual + netinstall-i686($) + netinstall-x86_64($) % ($) advantage : fit on 200MB mini-cd :) @ all isos or some other combination. @@ These are the sizes: (*-dual.iso are generated by archiso2dual -T full) % 652M core-dual | 363M core-i686 | 385M core-x86_64 % 220M net-dual | 153M net-i686 | 163M net-x86_64 * Update wiki articles about installation and archiso. All comments are welcomed. Good luck! [#1] http://github.com/djgera/archiso/tree/djgera -- Gerardo Exequiel Pozzi ( djgera ) http://www.djgera.com.ar KeyID: 0x1B8C330D Key fingerprint = 0CAA D5D4 CD85 4434 A219 76ED 39AB 221B 1B8C 330D

3 4

[arch-releng] [PATCH] Fix grub lines for various encryption setups
by Thomas Bächler 06 Mar '10

06 Mar '10

The first one used a deprecated syntax and failed whenever / was not called /dev/mapper/root The second one got a cosmetical cleanup to be more consistent with what was set during the installer The third one also failed whenever / was not called /dev/mapper/root --- src/core/libs/lib-ui-interactive.sh | 9 +++++---- 1 files changed, 5 insertions(+), 4 deletions(-) diff --git a/src/core/libs/lib-ui-interactive.sh b/src/core/libs/lib-ui-interactive.sh index 586abc9..d9f8795 100644 --- a/src/core/libs/lib-ui-interactive.sh +++ b/src/core/libs/lib-ui-interactive.sh @@ -1089,20 +1089,21 @@ generate_grub_menulst() { then debug 'FS' 'Grub kernel line? Found / on dm_crypt on raw' raw_device=`echo "$ANSWER_DEVICES" | sed -n '2p' | cut -d ' ' -f1` - kernel="kernel $subdir/vmlinuz26 root=$raw_device ro" + crypt_device=`echo "$ANSWER_DEVICES" | sed -n '1p' | cut -d ' ' -f1` + kernel="kernel $subdir/vmlinuz26 root=$crypt_device cryptdevice=$raw_device:`basename $crypt_device` ro" elif echo "$ANSWER_DEVICES" | sed -n '1p' | grep -q 'lvm-lv$' && echo "$ANSWER_DEVICES" | sed -n '4p' | grep -q 'dm_crypt$' && echo "$ANSWER_DEVICES" | sed -n '5p' | grep -q 'raw$' then debug 'FS' 'Grub kernel line? Found / on lvm on dm_crypt on raw' lv_device=`echo "$ANSWER_DEVICES" | sed -n '1p' | cut -d ' ' -f1` - vg_device=`echo "$ANSWER_DEVICES" | sed -n '2p' | cut -d ' ' -f1` + crypt_device=`echo "$ANSWER_DEVICES" | sed -n '4p' | cut -d ' ' -f1` raw_device=`echo "$ANSWER_DEVICES" | sed -n '5p' | cut -d ' ' -f1` - kernel="kernel $subdir/vmlinuz26 root=$lv_device cryptdevice=$raw_device:`basename $vg_device` ro" + kernel="kernel $subdir/vmlinuz26 root=$lv_device cryptdevice=$raw_device:`basename $crypt_device` ro" elif echo "$ANSWER_DEVICES" | sed -n '1p' | grep -q 'dm_crypt$' && echo "$ANSWER_DEVICES" | sed -n '2p' | grep -q 'lvm-lv$' && echo "$ANSWER_DEVICES" | sed -n '5p' | grep -q 'raw$' then debug 'FS' 'Grub kernel line? Found / on dm_crypt on lvm on raw' crypt_device=`echo "$ANSWER_DEVICES" | sed -n '1p' | cut -d ' ' -f1` lv_device=`echo "$ANSWER_DEVICES" | sed -n '2p' | cut -d ' ' -f1` - kernel=" kernel $subdir/vmlinuz26 root=$crypt_device cryptdevice=$lv_device:root ro" + kernel=" kernel $subdir/vmlinuz26 root=$crypt_device cryptdevice=$lv_device:`basename $crypt_device` ro" elif echo "$ANSWER_DEVICES" | sed -n '1p' | grep -q 'raw$' then debug 'FS' 'Grub kernel line? Found / on raw' -- 1.6.4.1

2 1