- Arch-projects - lists.archlinux.org

[arch-projects] [dbscripts] [GIT] Official repo DB scripts branch master updated. 20180603-15-g948a181
by eschwartz＠archlinux.org 10 Jan '19

10 Jan '19

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "Official repo DB scripts". The branch, master has been updated via 948a181f5f09ca1cc03d450081f296222ca26d2f (commit) from f11a038c43270a70eafdba34ff33e134b6726a04 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 948a181f5f09ca1cc03d450081f296222ca26d2f Author: Eli Schwartz <eschwartz(a)archlinux.org> Date: Thu Jan 10 10:59:25 2019 -0500 Fix db-archive not running at the correct time. At the point when it was being run, the signature was not yet moved to PKGPOOL. ----------------------------------------------------------------------- Summary of changes: db-update | 2 +- test/cases/db-update.bats | 1 + 2 files changed, 2 insertions(+), 1 deletion(-) hooks/post-receive -- Official repo DB scripts

1 0

[arch-projects] [dbscripts] [PATCH] Fix db-archive not running at the correct time.
by Eli Schwartz 10 Jan '19

10 Jan '19

At the point when it was being run, the signature was not yet moved to PKGPOOL. Signed-off-by: Eli Schwartz <eschwartz(a)archlinux.org> --- Discovered while debugging the verify branch. db-update | 2 +- test/cases/db-update.bats | 1 + 2 files changed, 2 insertions(+), 1 deletion(-) diff --git a/db-update b/db-update index 3a66c859..4848fef0 100755 --- a/db-update +++ b/db-update @@ -86,13 +86,13 @@ for repo in "${repos[@]}"; do # any packages might have been moved by the previous run if [[ -f ${pkg} ]]; then mv "${pkg}" "$FTP_BASE/${PKGPOOL}" - "$(dirname "$(readlink -e "${BASH_SOURCE[0]}")")/db-archive" "${FTP_BASE}/${PKGPOOL}/${pkg##*/}" fi ln -s "../../../${PKGPOOL}/${pkgfile}" "$FTP_BASE/$repo/os/${pkgarch}" # also move signatures if [[ -f ${pkg}.sig ]]; then mv "${pkg}.sig" "$FTP_BASE/${PKGPOOL}" fi + "$(dirname "$(readlink -e "${BASH_SOURCE[0]}")")/db-archive" "${FTP_BASE}/${PKGPOOL}/${pkg##*/}" if [[ -f $FTP_BASE/${PKGPOOL}/${pkgfile}.sig ]]; then ln -s "../../../${PKGPOOL}/${pkgfile}.sig" "$FTP_BASE/$repo/os/${pkgarch}" fi diff --git a/test/cases/db-update.bats b/test/cases/db-update.bats index bc978302..e1782a59 100644 --- a/test/cases/db-update.bats +++ b/test/cases/db-update.bats @@ -91,6 +91,7 @@ load ../lib/common releasePackage extra pkg-any-a db-update [[ -f ${ARCHIVE_BASE}/packages/p/pkg-any-a/pkg-any-a-1-1-any${PKGEXT} ]] + [[ -f ${ARCHIVE_BASE}/packages/p/pkg-any-a/pkg-any-a-1-1-any${PKGEXT}.sig ]] } @test "update same any package to same repository fails" { -- 2.20.1

1 0

[arch-projects] [dbscripts] [GIT] Official repo DB scripts branch verify-update-plus-rebuild created. 20180603-17-g77c7269
by eschwartz＠archlinux.org 10 Jan '19

10 Jan '19

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "Official repo DB scripts". The branch, verify-update-plus-rebuild has been created at 77c72694e608decd63978f3ae6d941487476ef98 (commit) - Log ----------------------------------------------------------------- commit 77c72694e608decd63978f3ae6d941487476ef98 Author: Eli Schwartz <eschwartz(a)archlinux.org> Date: Sun Dec 2 12:07:05 2018 -0500 db-move: also block moving package from staging to extra without handling testing Don't allow anomalous testing packages floating around after a rebuild which are older than stable. commit aeeaac2e9979c8bf51f1e3401cc3c3f94fba7571 Author: Eli Schwartz <eschwartz(a)archlinux.org> Date: Sun Dec 2 11:28:20 2018 -0500 db-update: die when trying to update a package without updating a pending rebuild A semi-common pattern is for one maintainer to stage a rebuild of a package due to e.g. cascading repository-wide python/boost/whatever rebuilds, and then for the original maintainer of the package to not notice and update the package in the stable repo, leaving an out of date rebuild in staging or testing. Then the the out of date package gets moved and ends up breaking things, possibly via a package downgrade, possibly via breaking compatibility with a much more targeted rebuild uploaded all at once. Ultimately, Things Happen™ and the repository hierarchy gets broken. Prevent this by enforcing for all packages that exist in multiple levels of the repo: staging -> testing -> stable That updates to one must come with an update to all the others. commit 4a0f58b1eb729755bc2e5c2f68968c41bb859b76 Author: Eli Schwartz <eschwartz(a)archlinux.org> Date: Sun Dec 2 12:28:36 2018 -0500 testing2x: be more generic and accept multiple testing repos Currently multilib is a second-class citizen the way it is lumped into community, and dbscripts cannot even keep track of whether it constitutes a testing repo. Teach config to track both testing and staging repos just like the stable ones, and teach testing2x to search through TESTING_REPOS to determine which one it is operating on. ----------------------------------------------------------------------- hooks/post-receive -- Official repo DB scripts

1 0

[arch-projects] [dbscripts] [GIT] Official repo DB scripts branch master updated. 20180603-14-gf11a038
by eschwartz＠archlinux.org 10 Jan '19

10 Jan '19

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "Official repo DB scripts". The branch, master has been updated via f11a038c43270a70eafdba34ff33e134b6726a04 (commit) via 490b2d11c87580eb3a954f655911074dca87029d (commit) from 549fe0017f44031b24fb5322726721b95cca395b (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit f11a038c43270a70eafdba34ff33e134b6726a04 Author: Eli Schwartz <eschwartz(a)archlinux.org> Date: Thu Nov 22 15:44:42 2018 -0500 Add reproducible archive of packages. Whenever adding new package files to the pool of distributed packages, copy the file into a longterm archive. This is the first step to merging the functionality of archivetools, as this implements the shared pool while also guaranteeing that all packages are archived at the time of entry rather than once per day if they still exist. commit 490b2d11c87580eb3a954f655911074dca87029d Author: Eli Schwartz <eschwartz(a)archlinux.org> Date: Thu Nov 22 21:46:38 2018 -0500 tests: make dummy archive copies of all packages in the test environment Prerequisite for reproducible archives of packages. ----------------------------------------------------------------------- Summary of changes: config | 2 ++ db-archive | 21 +++++++++++++++++++++ db-functions | 39 +++++++++++++++++++++++++++++++-------- db-update | 5 +++++ test/cases/db-update.bats | 6 ++++++ test/lib/common.bash | 10 ++++++++++ 6 files changed, 75 insertions(+), 8 deletions(-) create mode 100755 db-archive hooks/post-receive -- Official repo DB scripts

1 0

[arch-projects] [dbscripts] [PATCH 1/4] tests: make dummy copies of all pkgpool packages in the test environment
by Eli Schwartz 09 Jan '19

09 Jan '19

Prerequisite for reproducible archives of packages. Signed-off-by: Eli Schwartz <eschwartz(a)archlinux.org> --- test/lib/common.bash | 12 +++++++++++- 1 file changed, 11 insertions(+), 1 deletion(-) diff --git a/test/lib/common.bash b/test/lib/common.bash index bc2b4e6d..3dda5f62 100644 --- a/test/lib/common.bash +++ b/test/lib/common.bash @@ -102,6 +102,7 @@ setup() { SVNREPO="file://${TMP}/svn-packages-repo" PKGREPOS=('core' 'extra' 'testing') PKGPOOL='pool/packages' + EXTRA_PKGPOOLS=('pool/community') SRCPOOL='sources/packages' TESTING_REPO='testing' STABLE_REPOS=('core' 'extra') @@ -123,9 +124,18 @@ eot mkdir -p "${TMP}/ftp/${r}/os/${a}" done done - mkdir -p "${TMP}/ftp/${PKGPOOL}" + mkdir -p "${TMP}/ftp/${PKGPOOL}"{,-reproducible} + mkdir -p "${TMP}/ftp/${EXTRA_PKGPOOLS[0]}" mkdir -p "${TMP}/ftp/${SRCPOOL}" + # make dummy packages for "reproducibility" + comm -12 <(pacman -Sql core extra | sort -u) <(pacman -Qq | sort -u) | pacman -Sddp - | while read -r line; do + touch "${FTP_BASE}/${PKGPOOL}/${line##*/}"{,.sig} + done + comm -12 <(pacman -Sql community | sort -u) <(pacman -Qq | sort -u) | pacman -Sddp - | while read -r line; do + touch "${FTP_BASE}/${EXTRA_PKGPOOLS[0]}/${line##*/}"{,.sig} + done + svnadmin create "${TMP}/svn-packages-repo" svn checkout -q "file://${TMP}/svn-packages-repo" "${TMP}/svn-packages-copy" } -- 2.19.2

3 18

[arch-projects] [namcap] [PATCH] recognize arch-specific variables even if packages is for only one architecture
by arch＠eckner.net 09 Jan '19

09 Jan '19

From: Erich Eckner <arch(a)eckner.net> Architecture-specific variables should be useable as soon as a package is not built for 'any' architecture. With the deprecation of i686, this becomes relevant, as many packages are now only built for x86_64. However, the source (and checksums) may be _not_ architecture-agnostic, e.g. should _not_ be listed as source= but source_x86_64=. This patch silences the extra-var-begins-without-underscore message which is currently emitted in that case. Signed-off-by: Erich Eckner <arch(a)eckner.net> --- Namcap/rules/extravars.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/Namcap/rules/extravars.py b/Namcap/rules/extravars.py index ba4df2d..81084f8 100644 --- a/Namcap/rules/extravars.py +++ b/Namcap/rules/extravars.py @@ -31,7 +31,7 @@ class package(PkgbuildRule): 'pkgbase', 'pkgver', 'pkgrel', 'epoch', 'pkgdesc', 'groups', 'url', 'install', 'changelog', 'options', 'validpgpkeys'] + carch_vars - if 'arch' in pkginfo and len(pkginfo["arch"]) >= 2: + if 'arch' in pkginfo and pkginfo['arch'] != ['any']: stdvars.extend(v+'_'+a for v,a in product(carch_vars, pkginfo["arch"])) for varname in pkginfo["setvars"]: if varname.islower() and varname not in stdvars \ -- 2.20.1

1 0

[arch-projects] [devtools] [PATCH v2] Expand check_root keepenv variables
by foxboron＠archlinux.org 21 Dec '18

21 Dec '18

From: Morten Linderud <foxboron(a)archlinux.org> Les us source makepkg.conf settings from the environemnt. This also includes `GNUPGHOME` which is present in `makechrootpkg`, but not included in archbuild. Signed-off-by: Morten Linderud <foxboron(a)archlinux.org> --- archbuild.in | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/archbuild.in b/archbuild.in index 1e5b582..bd5706d 100644 --- a/archbuild.in +++ b/archbuild.in @@ -39,7 +39,7 @@ while getopts 'hcr:' arg; do esac done -check_root SOURCE_DATE_EPOCH +check_root SOURCE_DATE_EPOCH,SRCDEST,SRCPKGDEST,PKGDEST,LOGDEST,MAKEFLAGS,PACKAGER,GNUPGHOME # Pass all arguments after -- right to makepkg makechrootpkg_args+=("${@:$OPTIND}") -- 2.20.1

1 0

[arch-projects] [mkinitcpio] [PATCH] --rsyncable option
by Charles Duffy 15 Dec '18

15 Dec '18

At present, mkinitcpio outputs are not particularly stable: Generating two consecutive initramfs images from the same inputs can generate archives which are quite entirely unlike each other from the perspective of binary diff tools (rsync, casync, rdiff-backup, xdelta, etc). Making some adjustments to compression and archival can greatly reduce the size of this delta. A ticket with a proposed patch (adding a --rsyncable option to mkinitcpio) has been opened at https://bugs.archlinux.org/task/56128 -- however, as the advice there has been to consult this mailing list, it may no longer be open as of this writing. :) The change consists of the following: - Sort the list of files (in the C locale) before passing it to cpio. - When --rsyncable is passed, set all datestamps to the UNIX epoch before generating the cpio archive. - When --rsyncable is passed, pass the --reproducible option to cpio (this creates a dependency on GNU cpio 2.12, prevents device numbers from being included in the archive, and renumbers inode numbers to be consistent when file ordering is unchanged). - When --rsyncable is passed, pass the --rsyncable and --no-name options to gzip (the former tells it to reset the compression table on occasion, sacrificing compression ratio to prevent the effect from changes from cascading throughout too much of the stream; the latter prevents name and timestamp data from being stored in the gzip header itself). A version of the patch squashing together the two commits already present on the ticket is attached.

1 1

[arch-projects] [namcap] FS#34300 False positive on Mach-O universal binary
by Michael Straube 03 Dec '18

03 Dec '18

Hi, namcap does not distinguish java class files from Mach-O files since both use the same byte magic CAFEBABE. See FS#34300 Implementing this would only need a test if the value of the byte at offset 7 is greater than 0x30. See: https://github.com/file/file/blob/master/magic/Magdir/cafebabe I think having Mach-O files in a package is a _very_ rare case. But on the other hand implementing would be no big deal. Would a patch for this be accepted, or is it not worth? Regards, Michael

1 0

[arch-projects] [namcap] [PATCH] namcap-tags: Add back missing dependency reason tags (FS#56898)
by Michael Straube 03 Dec '18

03 Dec '18

There are two missing tags that are needed in rules added (back) in commit e385ac93a354 (Restore and refactor accidentally removed tests). Add back the missing tags. Signed-off-by: Michael Straube <michael.straube(a)posteo.de> --- namcap-tags | 2 ++ 1 file changed, 2 insertions(+) diff --git a/namcap-tags b/namcap-tags index 17b9506..70dabb2 100644 --- a/namcap-tags +++ b/namcap-tags @@ -101,6 +101,8 @@ depends-by-namcap-sight depends=(%s) :: Depends as namcap sees them: depends=(%s dconf-needed-for-glib-schemas :: needed for glib schemas glib2-needed-for-gio-modules :: needed for GIO modules hicolor-icon-theme-needed-for-hicolor-dir :: needed for hicolor theme hierarchy +shared-mime-info-needed :: needed for update-mime-database +desktop-file-utils-needed :: needed for update-desktop-database kdebase-runtime-needed %s :: needed for programs %s java-runtime-needed %s :: found class files %s libraries-needed %s %s :: libraries %s needed in files %s -- 2.19.2

2 2