- Arch-releng - lists.archlinux.org

[arch-releng] [PATCH] download: add a link to the new netboot environment
by Thomas Bächler 04 Dec '11

04 Dec '11

--- public/views.py | 1 + settings.py | 3 +++ templates/public/download.html | 2 ++ 3 files changed, 6 insertions(+), 0 deletions(-) diff --git a/public/views.py b/public/views.py index 4051261..8fb60c7 100644 --- a/public/views.py +++ b/public/views.py @@ -63,6 +63,7 @@ def download(request): ) context = { 'releng_iso_url': settings.ISO_LIST_URL, + 'releng_pxeboot_url': settings.PXEBOOT_URL, } return list_detail.object_list(request, qset.order_by('mirror__country', 'mirror__name', 'protocol'), diff --git a/settings.py b/settings.py index 77f84ba..b22b429 100644 --- a/settings.py +++ b/settings.py @@ -118,6 +118,9 @@ # URL to fetch a current list of available ISOs ISO_LIST_URL = 'http://releng.archlinux.org/isos/' +# URL to the PXE netboot instructions +PXEBOOT_URL = 'http://releng.archlinux.org/pxeboot/' + # URL for SVN access for fetching commit messages (note absence of packages or # community bit on the end, repo.svn_root is appended) SVN_BASE_URL = 'svn+ssh://svn.archlinux.org/srv/svn-' diff --git a/templates/public/download.html b/templates/public/download.html index 36aca9a..3e33ab3 100644 --- a/templates/public/download.html +++ b/templates/public/download.html @@ -122,6 +122,8 @@ <ul> <li><a href="{{ releng_iso_url }}" title="Release Engineering ISO download">Download snapshots</a></li> + <li><a href="{{ releng_pxeboot_url }}" + title="Arch Linux Netboot Live System">Boot latest snapshots over the network</a></li> <li><a href="{% url releng-test-overview %}" title="Release Engineering ISO feedback">Feedback</a></li> </ul> -- 1.7.8

1 0

[arch-releng] [RFC] [PATCH] [archiso] Cleanup: Remove *.fs support.
by Gerardo Exequiel Pozzi 03 Dec '11

03 Dec '11

This was useful to me during development of dm-snapshot support to create very quickly isos without wating for SquashFS compression. Is time to remove this, I think the is no practical usage, and make the code a bit more simple. Signed-off-by: Gerardo Exequiel Pozzi <vmlinuz386(a)yahoo.com.ar> --- README | 8 -------- archiso/hooks/archiso | 8 ++------ archiso/hooks/archiso_pxe_curl | 6 +----- archiso/mkarchiso | 20 +++++--------------- 4 files changed, 8 insertions(+), 34 deletions(-) diff --git a/README b/README index 53dabd0..9de113d 100644 --- a/README +++ b/README @@ -178,10 +178,6 @@ if nothing is specified on command line. * image-name.fs.sfs SquashFS with only one file inside (image-name.fs), which is an image of some type of filesystem (ext4, ext3, ext2, xfs), all files reside on it. -* image-name.fs Like image-name.fs.sfs but without SquashFS. - (For testing purposes only. The option copytoram - for archiso hook does not have any effect on these images) - *** File format for aitab. @@ -196,7 +192,6 @@ It consists of some fields which define the behaviour of images. <mnt> Mount point. <arch> Architecture { i686 | x86_64 | any }. <sfs_comp> SquashFS compression type { gzip | lzo | xz }. - A special value of "none" denotes no usage of SquashFS. <fs_type> Set the filesystem type of the image { ext4 | ext3 | ext2 | xfs }. A special value of "none" denotes no usage of a filesystem. In that case all files are pushed directly to SquashFS filesystem. @@ -207,9 +202,6 @@ It consists of some fields which define the behaviour of images. This is an estimation, and calculated in a simple way. Space used + 10% (estimated for metadata overhead) + desired % -Note: Some combinations are invalid, example: sfs_comp=none and fs_type=none - - *** Why the /isolinux and /arch/boot/syslinux directories? diff --git a/archiso/hooks/archiso b/archiso/hooks/archiso index e4ed52b..202325f 100644 --- a/archiso/hooks/archiso +++ b/archiso/hooks/archiso @@ -213,12 +213,8 @@ archiso_mount_handler() { [[ "${aitab_img#\#}" != "${aitab_img}" ]] && continue [[ "${aitab_arch}" != "any" && "${aitab_arch}" != "${arch}" ]] && continue if [[ "${aitab_fs_type}" != "none" ]]; then - if [[ "${aitab_sfs_comp}" != "none" ]]; then - _mnt_sfs "/run/archiso/bootmnt/${archisobasedir}/${aitab_arch}/${aitab_img}.fs.sfs" "/run/archiso/sfs/${aitab_img}" - _mnt_fs "/run/archiso/sfs/${aitab_img}/${aitab_img}.fs" "${newroot}${aitab_mnt}" - else - _mnt_fs "/run/archiso/bootmnt/${archisobasedir}/${aitab_arch}/${aitab_img}.fs" "${newroot}${aitab_mnt}" - fi + _mnt_sfs "/run/archiso/bootmnt/${archisobasedir}/${aitab_arch}/${aitab_img}.fs.sfs" "/run/archiso/sfs/${aitab_img}" + _mnt_fs "/run/archiso/sfs/${aitab_img}/${aitab_img}.fs" "${newroot}${aitab_mnt}" else _mnt_sfs "/run/archiso/bootmnt/${archisobasedir}/${aitab_arch}/${aitab_img}.sfs" "${newroot}${aitab_mnt}" fi diff --git a/archiso/hooks/archiso_pxe_curl b/archiso/hooks/archiso_pxe_curl index 27deee9..858bacb 100644 --- a/archiso/hooks/archiso_pxe_curl +++ b/archiso/hooks/archiso_pxe_curl @@ -47,11 +47,7 @@ archiso_pxe_curl_mount_handler () { [[ "${aitab_img#\#}" != "${aitab_img}" ]] && continue [[ "${aitab_arch}" != "any" && "${aitab_arch}" != "${arch}" ]] && continue if [[ "${aitab_fs_type}" != "none" ]]; then - if [[ "${aitab_sfs_comp}" != "none" ]]; then - _curl_get "${archiso_curl_url}${archisobasedir}/${aitab_arch}/${aitab_img}.fs.sfs" "${archisobasedir}/${aitab_arch}" - else - _curl_get "${archiso_curl_url}${archisobasedir}/${aitab_arch}/${aitab_img}.fs" "${archisobasedir}/${aitab_arch}" - fi + _curl_get "${archiso_curl_url}${archisobasedir}/${aitab_arch}/${aitab_img}.fs.sfs" "${archisobasedir}/${aitab_arch}" else _curl_get "${archiso_curl_url}${archisobasedir}/${aitab_arch}/${aitab_img}.sfs" "${archisobasedir}/${aitab_arch}" fi diff --git a/archiso/mkarchiso b/archiso/mkarchiso index fed953e..b3aa5cd 100755 --- a/archiso/mkarchiso +++ b/archiso/mkarchiso @@ -363,25 +363,15 @@ command_prepare () { if [[ ${_aitab_img} =~ ^# ]]; then continue fi - if [[ ${_aitab_sfs_comp} == "none" && ${_aitab_fs_type} == "none" ]]; then - _msg_error "In aitab, both fields 'sfs_comp' and 'fs_type' are set to none for '${_aitab_img}' image" 1 - fi local _src="${work_dir}/${_aitab_img}" local _dst="${work_dir}/iso/${install_dir}/${_aitab_arch}" mkdir -p "${_dst}" if [[ ${_aitab_fs_type} != "none" ]]; then - if [[ ${_aitab_sfs_comp} != "none" ]]; then - if _is_directory_changed "${_src}" "${_dst}/${_aitab_img}.fs.sfs"; then - _mkfs ${_aitab_img} ${_aitab_fs_type} ${_aitab_fs_size} - _mksfs ${_aitab_img}.fs ${_aitab_sfs_comp} - mv "${_src}.fs.sfs" "${_dst}" - rm "${_src}.fs" - fi - else - if _is_directory_changed "${_src}" "${_dst}/${_aitab_img}.fs"; then - _mkfs ${_aitab_img} ${_aitab_fs_type} ${_aitab_fs_size} - mv "${work_dir}/${_aitab_img}.fs" "${_dst}" - fi + if _is_directory_changed "${_src}" "${_dst}/${_aitab_img}.fs.sfs"; then + _mkfs ${_aitab_img} ${_aitab_fs_type} ${_aitab_fs_size} + _mksfs ${_aitab_img}.fs ${_aitab_sfs_comp} + mv "${_src}.fs.sfs" "${_dst}" + rm "${_src}.fs" fi else if _is_directory_changed "${_src}" "${_dst}/${_aitab_img}.sfs"; then -- 1.7.7.4

1 0

[arch-releng] Syslinux (ext*/fat) loadconfig file
by Thomas Bächler 03 Dec '11

03 Dec '11

$ cat configs/releng/syslinux/syslinux.cfg DEFAULT loadconfig LABEL loadconfig CONFIG /%INSTALL_DIR%/boot/syslinux/archiso.cfg APPEND /%INSTALL_DIR%/ Shouldn't this path be relative? Syslinux (in contrast to isolinux and pxelinux) can handle relative paths containing '..'. If we can make this relative, we can make the loadconfig trick independent of the path on the target medium.

2 3

[arch-releng] [PATCH 1/4] [configs/releng] Split syslinux cfgs in single arch, like in dual arch
by Gerardo Exequiel Pozzi 02 Dec '11

02 Dec '11

Signed-off-by: Gerardo Exequiel Pozzi <vmlinuz386(a)yahoo.com.ar> --- configs/releng/syslinux/archiso.cfg | 72 +---------------------------- configs/releng/syslinux/archiso_head.cfg | 28 ++++++++++++ configs/releng/syslinux/archiso_sys.cfg | 10 ++++ configs/releng/syslinux/archiso_tail.cfg | 29 ++++++++++++ 4 files changed, 70 insertions(+), 69 deletions(-) create mode 100644 configs/releng/syslinux/archiso_head.cfg create mode 100644 configs/releng/syslinux/archiso_sys.cfg create mode 100644 configs/releng/syslinux/archiso_tail.cfg diff --git a/configs/releng/syslinux/archiso.cfg b/configs/releng/syslinux/archiso.cfg index e508bcc..1228355 100644 --- a/configs/releng/syslinux/archiso.cfg +++ b/configs/releng/syslinux/archiso.cfg @@ -1,69 +1,3 @@ -SERIAL 0 38400 -DEFAULT boot/syslinux/vesamenu.c32 -PROMPT 0 -MENU TITLE Arch Linux -MENU BACKGROUND boot/syslinux/splash.png -TIMEOUT 3000 - -MENU WIDTH 78 -MENU MARGIN 4 -MENU ROWS 6 -MENU VSHIFT 10 -MENU TIMEOUTROW 13 -MENU TABMSGROW 11 -MENU CMDLINEROW 11 -MENU HELPMSGROW 16 -MENU HELPMSGENDROW 29 - -# Refer to http://syslinux.zytor.com/wiki/index.php/Doc/menu - -MENU COLOR border 30;44 #40ffffff #a0000000 std -MENU COLOR title 1;36;44 #9033ccff #a0000000 std -MENU COLOR sel 7;37;40 #e0ffffff #20ffffff all -MENU COLOR unsel 37;44 #50ffffff #a0000000 std -MENU COLOR help 37;40 #c0ffffff #a0000000 std -MENU COLOR timeout_msg 37;40 #80ffffff #00000000 std -MENU COLOR timeout 1;37;40 #c0ffffff #00000000 std -MENU COLOR msg07 37;40 #90ffffff #a0000000 std -MENU COLOR tabmsg 31;40 #30ffffff #00000000 std - -LABEL arch -TEXT HELP -Boot the Arch Linux live medium. It allows you to install Arch Linux or -perform system maintenance. -ENDTEXT -MENU LABEL Boot Arch Linux -LINUX boot/%ARCH%/vmlinuz -INITRD boot/%ARCH%/archiso.img -APPEND archisobasedir=%INSTALL_DIR% archisolabel=%ARCHISO_LABEL% -IPAPPEND 3 - -LABEL existing -TEXT HELP -Boot an existing operating system. Press TAB to edit the disk and partition -number to boot. -ENDTEXT -MENU LABEL Boot existing OS -COM32 boot/syslinux/chain.c32 -APPEND hd0 0 - -# http://www.memtest.org/ -LABEL memtest -MENU LABEL Run Memtest86+ (RAM test) -LINUX boot/memtest - -# http://hdt-project.org/ -LABEL hdt -MENU LABEL Hardware Information (HDT) -COM32 boot/syslinux/hdt.c32 -APPEND modules_alias=boot/syslinux/hdt/modalias.gz pciids=boot/syslinux/hdt/pciids.gz - -LABEL reboot -MENU LABEL Reboot -COM32 boot/syslinux/reboot.c32 - -LABEL poweroff -MENU LABEL Power Off -COMBOOT boot/syslinux/poweroff.com - -ONTIMEOUT arch +INCLUDE boot/syslinux/archiso_head.cfg +INCLUDE boot/syslinux/archiso_arch.cfg +INCLUDE boot/syslinux/archiso_tail.cfg diff --git a/configs/releng/syslinux/archiso_head.cfg b/configs/releng/syslinux/archiso_head.cfg new file mode 100644 index 0000000..d9dee2e --- /dev/null +++ b/configs/releng/syslinux/archiso_head.cfg @@ -0,0 +1,28 @@ +SERIAL 0 38400 +DEFAULT boot/syslinux/vesamenu.c32 +PROMPT 0 +MENU TITLE Arch Linux +MENU BACKGROUND boot/syslinux/splash.png +TIMEOUT 3000 + +MENU WIDTH 78 +MENU MARGIN 4 +MENU ROWS 6 +MENU VSHIFT 10 +MENU TIMEOUTROW 13 +MENU TABMSGROW 11 +MENU CMDLINEROW 11 +MENU HELPMSGROW 16 +MENU HELPMSGENDROW 29 + +# Refer to http://syslinux.zytor.com/wiki/index.php/Doc/menu + +MENU COLOR border 30;44 #40ffffff #a0000000 std +MENU COLOR title 1;36;44 #9033ccff #a0000000 std +MENU COLOR sel 7;37;40 #e0ffffff #20ffffff all +MENU COLOR unsel 37;44 #50ffffff #a0000000 std +MENU COLOR help 37;40 #c0ffffff #a0000000 std +MENU COLOR timeout_msg 37;40 #80ffffff #00000000 std +MENU COLOR timeout 1;37;40 #c0ffffff #00000000 std +MENU COLOR msg07 37;40 #90ffffff #a0000000 std +MENU COLOR tabmsg 31;40 #30ffffff #00000000 std diff --git a/configs/releng/syslinux/archiso_sys.cfg b/configs/releng/syslinux/archiso_sys.cfg new file mode 100644 index 0000000..1326db8 --- /dev/null +++ b/configs/releng/syslinux/archiso_sys.cfg @@ -0,0 +1,10 @@ +LABEL arch +TEXT HELP +Boot the Arch Linux live medium. It allows you to install Arch Linux or +perform system maintenance. +ENDTEXT +MENU LABEL Boot Arch Linux +LINUX boot/%ARCH%/vmlinuz +INITRD boot/%ARCH%/archiso.img +APPEND archisobasedir=%INSTALL_DIR% archisolabel=%ARCHISO_LABEL% +IPAPPEND 3 diff --git a/configs/releng/syslinux/archiso_tail.cfg b/configs/releng/syslinux/archiso_tail.cfg new file mode 100644 index 0000000..984aace --- /dev/null +++ b/configs/releng/syslinux/archiso_tail.cfg @@ -0,0 +1,29 @@ +LABEL existing +TEXT HELP +Boot an existing operating system. Press TAB to edit the disk and partition +number to boot. +ENDTEXT +MENU LABEL Boot existing OS +COM32 boot/syslinux/chain.c32 +APPEND hd0 0 + +# http://www.memtest.org/ +LABEL memtest +MENU LABEL Run Memtest86+ (RAM test) +LINUX boot/memtest + +# http://hdt-project.org/ +LABEL hdt +MENU LABEL Hardware Information (HDT) +COM32 boot/syslinux/hdt.c32 +APPEND modules_alias=boot/syslinux/hdt/modalias.gz pciids=boot/syslinux/hdt/pciids.gz + +LABEL reboot +MENU LABEL Reboot +COM32 boot/syslinux/reboot.c32 + +LABEL poweroff +MENU LABEL Power Off +COMBOOT boot/syslinux/poweroff.com + +ONTIMEOUT arch -- 1.7.7.4

2 12

[arch-releng] [RFC] Selective syslinux menu if PXE/non-PXE
by Gerardo Exequiel Pozzi 01 Dec '11

01 Dec '11

As proof of concept only for single arch. If approved, I will do the same for dual arch.

1 6

[arch-releng] [archiso] pxe_curl/pxe_nfs now in master ;)
by Gerardo Exequiel Pozzi 30 Nov '11

30 Nov '11

Not that mkinitcpio-0.8.0 hits core, I pushed all archiso patched to master. Wait for next next testbuild, or build yourself! 5b9eba9 [archiso] Add checksum support to pxe_curl cd359bc [archiso] Checksum only aitab and *.sfs (per architecture) 0411fc9 [configs/releng] Make all syslinux bootloaders works with the sames configs. 8bd0674 [archiso] Add DNS resolver support to archiso_pxe_common 76dea16 [archiso] Add PXE NFS support 8eb4c62 [archiso] Add archiso_pxe_curl hook 1edaf15 [archiso] Split archiso_pxe_nbd in two hooks. 4096546 [configs/*] chroot to root-image for initramfs build 334db09 [archiso] Check if /run/archiso/bootmnt is a mountpoint. f097724 [archiso] Only accepts aitab inside e03ed81 [archiso] Use different logic when archisodevice == cow_device e135003 [archiso] simplify _mnt_dev() (mount is now from util-linux) -- Gerardo Exequiel Pozzi \cos^2\alpha + \sin^2\alpha = 1

5 35

[arch-releng] [archiso] [PATCH] [configs/releng] actually copy the archiso_kms hook to workdir
by Thomas Bächler 29 Nov '11

29 Nov '11

--- configs/releng/build.sh | 1 + 1 files changed, 1 insertions(+), 0 deletions(-) diff --git a/configs/releng/build.sh b/configs/releng/build.sh index 28181c6..1251c79 100755 --- a/configs/releng/build.sh +++ b/configs/releng/build.sh @@ -32,6 +32,7 @@ make_setup_mkinitcpio() { cp /lib/initcpio/hooks/${_hook} ${work_dir}/root-image/lib/initcpio/hooks cp /lib/initcpio/install/${_hook} ${work_dir}/root-image/lib/initcpio/install done + cp /lib/initcpio/install/archiso_kms ${work_dir}/root-image/lib/initcpio/install cp /lib/initcpio/archiso_shutdown ${work_dir}/root-image/lib/initcpio cp /lib/initcpio/archiso_pxe_nbd ${work_dir}/root-image/lib/initcpio cp ${script_path}/mkinitcpio.conf ${work_dir}/root-image/etc/mkinitcpio-archiso.conf -- 1.7.7.4

2 1

[arch-releng] [archiso] [PATCH 1/2] Add common KMS modules to the releng initramfs image.
by Thomas Bächler 29 Nov '11

29 Nov '11

On machines with common graphics chipsets (radeon, intel, nvidia), enable KMS early. Downloading images from a remote server can take time, better view the status with a nice resolution. --- archiso/Makefile | 2 ++ archiso/install/archiso_kms | 14 ++++++++++++++ configs/releng/mkinitcpio.conf | 2 +- 3 files changed, 17 insertions(+), 1 deletions(-) create mode 100644 archiso/install/archiso_kms diff --git a/archiso/Makefile b/archiso/Makefile index 11aff53..a073adf 100644 --- a/archiso/Makefile +++ b/archiso/Makefile @@ -26,6 +26,7 @@ install-hooks: install -D -m 644 install/archiso_pxe_nfs $(DESTDIR)/lib/initcpio/install/archiso_pxe_nfs install -D -m 644 hooks/archiso_loop_mnt $(DESTDIR)/lib/initcpio/hooks/archiso_loop_mnt install -D -m 644 install/archiso_loop_mnt $(DESTDIR)/lib/initcpio/install/archiso_loop_mnt + install -D -m 644 install/archiso_kms $(DESTDIR)/lib/initcpio/install/archiso_kms install-examples: # install examples @@ -55,6 +56,7 @@ uninstall: rm -f $(DESTDIR)/lib/initcpio/install/archiso_pxe_nfs rm -f $(DESTDIR)/lib/initcpio/hooks/archiso_loop_mnt rm -f $(DESTDIR)/lib/initcpio/install/archiso_loop_mnt + rm -f $(DESTDIR)/lib/initcpio/install/archiso_kms rm -rf $(DESTDIR)/usr/share/archiso/ .PHONY: install install-program install-hooks install-examples install-doc uninstall diff --git a/archiso/install/archiso_kms b/archiso/install/archiso_kms new file mode 100644 index 0000000..1dd18cc --- /dev/null +++ b/archiso/install/archiso_kms @@ -0,0 +1,14 @@ +#!/bin/bash + +build() { + MODULES="radeon nouveau i915 via-agp sis-agp intel-agp" + if [[ $(uname -m) = i686 ]]; then + MODULES+=" amd64-agp ati-agp sworks-agp ali-agp amd-k7-agp nvidia-agp efficeon-agp" + fi +} + +help() { + cat << HELPEOF +Adds all common KMS drivers to the initramfs image. +HELPEOF +} diff --git a/configs/releng/mkinitcpio.conf b/configs/releng/mkinitcpio.conf index 8d77dee..5570ed6 100644 --- a/configs/releng/mkinitcpio.conf +++ b/configs/releng/mkinitcpio.conf @@ -1,2 +1,2 @@ -HOOKS="base udev memdisk archiso_shutdown archiso archiso_loop_mnt archiso_pxe_common archiso_pxe_nbd archiso_pxe_curl archiso_pxe_nfs pata scsi sata virtio usb fw pcmcia filesystems usbinput" +HOOKS="base udev memdisk archiso_shutdown archiso archiso_loop_mnt archiso_pxe_common archiso_pxe_nbd archiso_pxe_curl archiso_pxe_nfs archiso_kms pata scsi sata virtio usb fw pcmcia filesystems usbinput" COMPRESSION="xz" -- 1.7.7.4

2 3

[arch-releng] [archiso] checksum logic changes, opinions?
by Gerardo Exequiel Pozzi 27 Nov '11

27 Nov '11

Hello We are currently checksuming all files inside $archisobasedir (aitab, *sfs, kernel/initramfs and boot/syslinux related files) this is stored in one file only. Its works good for now, but I think we only need to checksum only aitab and *.sfs if they are needed. Currently if you boot a dual-iso in i686, you are also checksuming *.sfs for x86_64. Not a big issue, this just take a bit more time. The real issue is when booting via PXE with HTTP/FTP methods, since they download only aitab and only needed *.sfs files, so you can not use directly the only one file where checksums are stored. My proposition is: (1) Do not checksum syslinux related files, anyway you are already reach initramfs stage. (2) Do not checksum kernel/initramfs files, for the same as (1) (3) Two options here in how to make checksums: (3.1) Two checksum.${arch}.md5 for each i686 and x86_64 for only aitab and *.sfs (I like this, is much more simple to implement) (3.2) One checksum for each *.sfs and aitab placed in the same directory where such file reside, (i.e /arch/boot/i686/root-image.fs.sfs.md5) Opinions? Thanks. -- Gerardo Exequiel Pozzi \cos^2\alpha + \sin^2\alpha = 1

1 1

Re: [arch-releng] [PATCH] [configs/releng] Make kernel and initramfs patch relative for syslinux
by Gerardo Exequiel Pozzi 26 Nov '11

26 Nov '11

Aha! I now rebember why I pushed absolute paths in syslinux.cfg: isolinux does not support ".." in paths! Only (ext|sys)linux have this and other nice features like install it on any path. ;) PS: Sorry I for "de-chain-email" am outside my home from webmail.

3 11