December 2006 - Pacman-dev - lists.archlinux.org

[pacman-dev] rankmirrors script
by Dan McGee 08 Dec '06

08 Dec '06

Here is a alternative to the current sortmirrrors script. It was designed to address this bug: http://bugs.archlinux.org/task/2952. It does not touch your current mirror lists, it simply reads them and outputs timing information for each, and outputs a Server format that can be used in the mirrors list. I've never done any python before, and this is heavily based off the script found in the forums but slightly refined to do different and slightly more intuitive output. (http://bbs.archlinux.org/viewtopic.php?t=19278&sid=475ab18a5d9b31952459fd99…) Dan __________________________________ #! /usr/bin/python # # rankmirrors : read a list of mirrors from a file and rank them by speed # # Original Idea copyright (c) 2006 R.G. <chesercat> # Modified 2006 by Dan McGee <dpmcgee(a)gmail.com> # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111-1307, # USA. # import sys, time, socket, urllib2 from optparse import OptionParser socket.setdefaulttimeout(10) def createOptParser(): parser = OptionParser() parser.add_option("-n", dest="num", default=0, help="number of servers to print, 0 for all") parser.add_option("-v", "--verbose", action="store_true", dest="verbose", default=False, help="be verbose in output") return parser def timeCmd(cmd): before = time.time(); try: cmd(); except KeyboardInterrupt, ki: raise ki except socket.timeout, ioe: return 'timeout' except Exception, e: return 'unreachable' return time.time() - before; def talkToServer(serverUrl): opener = urllib2.build_opener() tmp = opener.open(serverUrl).read() def getFuncToTime(serverUrl): return lambda : talkToServer(serverUrl) def cmpPairBySecond(p1, p2): if p1[1] == p2[1]: return 0 if p1[1] < p2[1]: return -1 return 1 if __name__ == "__main__": parser = createOptParser() (options, args) = parser.parse_args() if len(args) != 1: parser.print_help() sys.exit(0) fl = open(args[0], 'r') serverToTime = {} print 'Querying servers, this may take some time...' for ln in fl.readlines(): splitted = ln.split('=') if splitted[0].strip() != 'Server': continue serverUrl = splitted[1].strip() if serverUrl[-1] == '\n': serverUrl = serverUrl[0:-1] if options.verbose: print serverUrl, '...', else: print ' * ', sys.stdout.flush() serverToTime[serverUrl] = timeCmd(getFuncToTime(serverUrl)) if options.verbose: print serverToTime[serverUrl] items = serverToTime.items() items.sort(cmpPairBySecond) numToShow = int(options.num) if numToShow == 0: numToShow = len(items) if len(items) > 0: print print ' Servers sorted by time:' print for i in items[0:numToShow]: print i[1], ':', i[0] if len(items) > 0: print print ' Server list format:' print for i in items[0:numToShow]: print 'Server =', i[0]

3 8

[pacman-dev] pacman.conf possible changes
by Dan McGee 08 Dec '06

08 Dec '06

I've included a patch to clean up pacman.conf a bit and move the instructions it provides at the top to a more applicable position in the file. I removed most of the NoUpgrade lines in the file because all of these files are already protected by their respective packages (at least in Arch, and I would assume in Frugal as well). I also moved the comment about reordering the mirrors to right above where the server lists are specified. I removed the reference to sortmirrors for two reasons- it isn't in the current pacman CVS, and I am working on a script that may do the job slightly better and not delete mirrors as the current script does (Flyspray #2952). It is based off the script noted in the bug report that was posted in the forums. Dan --- pacman-lib.orig/etc/pacman.conf.in 2006-11-15 15:22:46.000000000 -0500 +++ pacman-lib/etc/pacman.conf.in 2006-12-05 18:06:23.000000000 -0500 @@ -1,16 +1,6 @@ # # /etc/pacman.conf # -# NOTE: If you find a mirror that is geographically close to you, please -# move it to the top of the server list, so pacman will choose it -# first. -# -# To re-sort your mirror lists by ping/traceroute results, use the -# /usr/bin/sortmirrors.pl script. It requires the "netselect" package. -# -# # sortmirrors.pl </etc/pacman.conf >pacman.conf.new -# - # See the pacman manpage for option directives # @@ -18,42 +8,40 @@ # [options] LogFile = /var/log/pacman.log -NoUpgrade = etc/passwd etc/group etc/shadow etc/sudoers -NoUpgrade = etc/fstab etc/raidtab etc/mdadm.conf etc/ld.so.conf -NoUpgrade = etc/inittab etc/rc.conf etc/rc.local -NoUpgrade = etc/modprobe.conf etc/modules.conf -NoUpgrade = etc/lilo.conf boot/grub/menu.lst etc/mkinitrd.conf HoldPkg = pacman glibc #XferCommand = /usr/bin/wget --passive-ftp -c -O %o %u # # REPOSITORIES # - can be defined here or included from another file -# - pacman will search repositories in the order defined here. +# - pacman will search repositories in the order defined here # - local/custom mirrors can be added here or in separate files -# +# - to add a preferred server, place it before an Include directive or first +# in the included file +# +# NOTE: If you find a mirror that is geographically close to you, please move +# it to the top of the server list, so pacman will choose it first. By default +# mirror lists are located in /etc/pacman.d/ +# + #[testing] #Server = ftp://ftp.archlinux.org/testing/os/i686 [current] -# Add your preferred servers here, they will be used first Include = /etc/pacman.d/current [extra] -# Add your preferred servers here, they will be used first Include = /etc/pacman.d/extra -#[unstable] -# Add your preferred servers here, they will be used first -#Include = /etc/pacman.d/unstable - [community] -# Add your preferred servers here, they will be used first Include = /etc/pacman.d/community -# An example of a custom package repository. See the pacman manpage for -# tips on creating your own repositories. +#[unstable] +#Include = /etc/pacman.d/unstable + +# See the pacman manpage for tips on creating your own repositories. #[custom] #Server = file:///home/custompkgs

4 6

[pacman-dev] [PATCH] libalpm: new config option - maxtries
by VMiklos 06 Dec '06

06 Dec '06

hi i've split up the patch to 3 parts for easier reviewing: the feature itself: http://darcs.frugalware.org/darcsweb/darcsweb.cgi?r=pacman;a=commit;h=20061… indentation fixup: http://darcs.frugalware.org/darcsweb/darcsweb.cgi?r=pacman;a=commit;h=20061… documentation: http://darcs.frugalware.org/darcsweb/darcsweb.cgi?r=pacman;a=commit;h=20061… udv / greetings, VMiklos -- Developer of Frugalware Linux, to make things frugal - http://frugalware.org

5 9

[pacman-dev] makepkg: unsetting variables
by Alexander Baldeck 06 Dec '06

06 Dec '06

Hey again, sorry for being such a nagger today. Then again, I have a problem with this change - see attachment - to makepkg. Imagine you want to build glibc from Archlinux ABS. I have two cases for you in which it starts messing things up: 1) comparisons in if-clauses make makepkg freak out The following example: if [ "${CARCH}" = "i686" ]; then # Hack to fix NPTL issues with Xen, only required on 32bit platforms export CFLAGS="${CFLAGS} -mno-tls-direct-seg-refs" fi causes: /usr/bin/makepkg: line 415: unset: `[': not a valid identifier /usr/bin/makepkg: line 415: unset: `"${CARCH}"': not a valid identifier /usr/bin/makepkg: line 415: unset: `=': not a valid identifier /usr/bin/makepkg: line 415: unset: `"i686"': not a valid identifier 2) appending strings in bash-style does not work anymore After getting rid of the if-clauses in the PKGBUILD for the sake of testing, a line like this: $ CFLAGS="-O2" $ export CFLAGS="${CFLAGS} -mno-tls-direct-seg-refs" will result in: $ echo $CFLAGS $ -mno-tls-direct-seg-refs This can't be right... sorry. Since the commit message shows that frugal changes were merged at that time plus that they may still be incomplete, I understand the fact that it might not be ready for general use but at least import something that doesn't fail so obviously. :) BTW, is there no bug tracker for pacman? Cheers, -O

3 3

[pacman-dev] makepkg.conf: problematic assumption for ppc
by Alex 06 Dec '06

06 Dec '06

Hey all, the autotool stuff for pacman-lib writes a makepkg.conf with the following C/XXFLAGS when configured on ppc: CFLAGS="-mcpu=750 -O2 -pipe" CXXFLAGS="-mcpu=750 -O2 -pipe" This is problematic! The past has shown us on archppc that -mcpu=750 might cause problems on G4 AND earlier variants of the PowerPC such as the 604 (pre-G3). Instead we started to use: export CFLAGS="-mtune=powerpc -O2 -pipe -mpowerpc-gfxopt -fPIC" export CXXFLAGS="-mtune=powerpc -O2 -pipe -mpowerpc-gfxopt -fPIC" of which "-mtune=powerpc" is the one which can be generalized, as opposed to "-mpowerpc-gfxopt" which will break compatibility to POWER which is the way I decided to go with archppc. -mtune is a relaxed optimization as you can see. It has proven to produce stable code on all PowerPCs we've seen so far. Also, I'd like to suggest to add "-fPIC" as a ppc default as well. Relocation does not work the way it does on x86 PHP 5.1+ being the most prominent representative for the problem. Every single library it links against must be built with -fPIC in order to load extensions in php.ini. This is only one example. Cheers, -Z

1 0

[pacman-dev] mtab required to install packages; intended behaviour?
by Alex 06 Dec '06

06 Dec '06

Hey all, I just gave the latest Pacman CVS state a go on archppc. I ran into a few problems of which one made me curious about wether this was intended or not. Let me explain: To try pacman fully, I decided to build a archppc/base. First I was trying quickinst with new pacman3 on my root system. It segfaulted, if this issue is not known, let me know. Anyway, installed the chroot with pacman 2.9.8 and rebuilt pacman3 inside of it. When instaling mc it was saying that there was not enough space left. Come to think of it, `df -h` doesn't really say anything cos of missing mtab. Is this intended? Cheers, -I

2 1