- Pacman-dev - lists.archlinux.org

[pacman-dev] NoUpgrade issues
by Aaron Griffin 21 Dec '06

21 Dec '06

First off, thanks to Thomas and Travis for helping me out with this one. There is an issue with pacman and the NoUpgrade removal. Let me try to breeze over it. Files marked in the backup=() array have saved MD5 sums in pacman's db. Theses are used for comparison when upgrading. It compares the 'local' md5 sum (on the file system), the 'new' md5 sum, from the package, and the 'original' md5 sum from the database. Here is the problem: in BOTH pacman 2 and 3, when a package is marked NoUpgrade, pacman stores the 'local' md5 sum in the database instead of the 'original' md5 sums. I can see this _possibly_ being intentional, but here's where the problem occurs. When you remove NoUpgrade, the 'original' and 'local' md5 sums are the same. The comparission says "oh this file hasn't been touched since it was installed, we can overwrite it" and kills your configs. So, the proposed solution, which is the easiest: Fix pacman3 to store the correct md5 sum even if it is a NoUpgrade file. Then, we leave the NoUpgrade lines in pacman.conf and wait one release (or more) to remove them. Removing them will happen after each NoUpgrade package has been upgraded (or artificially version bumped). Those packages: initscripts module-init-tools pacman grub lilo filesystem ...and one or two others I forget... Does anyone have an issue with this solution?

3 3

[pacman-dev] [PATCH] fix automake conditional for java bindings
by Jürgen Hötzel 21 Dec '06

21 Dec '06

Hi, I work on Lua bindings and found this problem. Patch enclosed: Don't build java bindings when swig is NOT installed. Jürgen

2 1

[pacman-dev] My thoughts for development
by Dan McGee 21 Dec '06

21 Dec '06

Since I've been spending quite a bit of time looking at the code lately, I've been making a TODO list of things worth looking into. I thought I'd put it up on the list for input. makepkg issues: 1. We went through and added some of the undocumented options to the makepkg.conf file, but I haven't done a whole lot of testing on this to see if it works correctly. I also don't know if all the checking is correct, and I see Aaron put some x's in front of these checks. Has anyone else? They also aren't documented in the man page if anyone wants to step up to the plate... 2. Remove use of multiple `` or $() calls to the same function. I have a local update of calling $(id -u) once and storing it to a variable for later use, I can publish a patch sometime. 3. I posted a patch for #5223 (source cache) and it has been patched. However, it is now a triple conditional with three different possible locations for package source (current dir, $SRCDEST, and /var/cache/pacman/src). Is the last one necessary since it is highly recommended to not build as root? Should we deprecate this path? Looking even further ahead, should we make fakeroot a requirement for running makepkg? 4. Aaron, you brought up that `` is the older standard and $() should be used. It is a pretty simple find that will allow you to change these for consistency, I've done it on my working copy. 5. Already mentioned, but a modeline in makepkg. 6. Overabundance of options in makepkg- I was trying to find a new letter for a '--repackage' option and we are pretty much out of lowercase letters. At the moment we have two basic types of options: things that can be done in the pkgbuild options line, and things that directly affect the way makepkg works (geninteg, skip integs, location of PKGBUILD). Are the first type truly necessary? It would make makepkg a bit more streamlined if the only options were those that can't be done somewhere else. So i propose the '--nostrip', '--keepdocs', and any other option like this be removed. 7. Integrity checking- currently generating integrity checks will only generate those from the first one in the INTEGRITY_CHECK array. This seems to make sense as long as the array in makepkg.conf is ordered the way we want it to be. When checking, we do get warning messages for other types that may be in the array but are not in the PKGBUILD. I just wanted to confirm this is the behavior you are looking for. Other issues: 1. Move the PKGBUILD man page to section 5 2. How are you guys doing side-by-side builds with the old pacman? At least for me, the current build system seems horribly complicated with shell scripts, configure, automaking and such. Is there a good reason for this? 3. Everyone talks about pacman slowness (even though it isn't really that bad), and looking though the mailing list archives I believe Aaron implemented a form of lazy caching (not loading the descriptions when unnecessary). Anything else on this front? I thought of something and I may be way off track, but what if when generating a repository we make (in addition to the flat file format) a single file with lines consisting of pkgname-pkgver:description? This file could be loaded and searched a lot quicker than flat files, and I think the operation people complain about being slow the most is a search. Wow, long list, but maybe it will provoke other great ideas. Feel free to respond to any or all of it. -Dan

4 10

[pacman-dev] makepkg program flow and linearity
by Dan McGee 21 Dec '06

21 Dec '06

I feel like I haven't wrote enough emails to the list today, so here is another. :) I wrote out this little chart for my own good today and noticed that the flow is relatively linear, but some of the checks for options play some crazy tricks on how it flows. In some sense, the operations I list below can all be split up without overlap (read: be made into functions). I'm wondering if we should think a little more about program flow now that all these options such as 'don't check dependencies' and 'use existing source' are present? There are some very long sections of code all indented inside an if-block, and it makes changing things a lot harder (ex. the generate integrity/check integrity/extract sources block). What if before each definable section, we do the 'if' statement instead, even if it means two sections in a row might have the same if clause? I don't know if that explanation made sense, so let me know. makepkg program flow and steps: determine fakeroot status (using -F) source makepkg.conf set correct options from $ARGLIST check for sudo convert relative $PKGDEST to absolute if $CLEANCACHE clean cache unset all variables we use check if buildscript exists source buildscript check for no-nos in build script enter fakeroot if necessary (calling makepkg again) check runtime dependencies check buildtime dependencies retrieve sources loop through $INTEGRITY_CHECK if $GENINTEG generate integrity checks else check integrity checks extract sources check file ownership, remove pkg/, use distcc, use ccache if $LOGGING log build build remove info/doc files move man pages if necessary remove possibly empty /usr/share directory compress man pages strip binaries remove libtool files remove empty directories get package meta info and make .PKGINFO check for an install script build a filelist tar up the package if $CLEANUP then cleanup if $RMDEPS then remove installed dependencies if $INSTALL then install with sudo or as root, etc. -Dan

1 0

[pacman-dev] Patch for makepkg bug #5021
by Dan McGee 20 Dec '06

20 Dec '06

This is a _preliminary_ patch for bug 5021. It should do everything the original code does plus some. A few comments: 1. I have very little familiarity with info or doc files, and the find operation could be tightened up by adding an extension if they are always packaged this way (e.g. .info). 2. Is there ever a time where a folder would exist with the doc or info name and it shouldn't be deleted? Obviously these find operations will do that, so I would want to make sure this is the case. Good naming of directories would lead me to believe it shouldn't happen, but who knows... If anyone knows a good package to test this behavior on, let me know. I haven't yet ran it on a lot of packages. I tried running it on the gnubiff package listed in the bug report but got a linking error (with both the version in the PKGBUILD and the updated 2.2.4 version). -Dan ============= --- /home/dmcgee/projects/pacman-lib.orig/scripts/makepkg 2006-12-19 11:40:51.000000000 -0500 +++ makepkg 2006-12-20 01:13:56.000000000 -0500 @@ -774,13 +774,17 @@ fi fi -if [ ! "`check_option KEEPDOCS`" -a "$KEEPDOCS" = "0" ]; then +if [ ! "$(check_option KEEPDOCS)" -a "$KEEPDOCS" = "0" ]; then # remove info/doc files msg "Removing info/doc files..." cd $startdir - rm -rf pkg/usr/info pkg/usr/share/info - rm -rf pkg/usr/doc pkg/usr/share/doc - rm -rf pkg/{usr,opt/gnome}/share/gtk-doc + # fix flyspray bug #5021 + find pkg -type f -wholename "pkg/*/info/*" -exec rm -f {} \; + find pkg -type d -wholename "pkg/*/info" -exec rmdir {} \; + find pkg -type f -wholename "pkg/*/doc/*" -exec rm -f {} \; + find pkg -type d -wholename "pkg/*/doc" -exec rmdir {} \; + find pkg -type f -wholename "pkg/*/gtk-doc/*" -exec rm -f {} \; + find pkg -type d -wholename "pkg/*/gtk-doc" -exec rmdir {} \; fi # move /usr/share/man files to /usr/man

4 12

[pacman-dev] script spaces/tabs, modelines, etc.
by Dan McGee 18 Dec '06

18 Dec '06

Since I've been working on the makepkg script a decent amount, I noticed it had no vim modeline. I also noticed that many of the other scripts do not have a modeline, others are inconsistant, and the abs script actually has 2: $ grep vim * abs:# vim: set ft=sh ts=2 sw=2 abs:# vim: set ts=2 noet: gensync:# vim: set ts=2 sw=2 noet: rankmirrors:# vim: set ts=4 sw=4 sta et sts ai: The rankmirrors one is going to be a bit different because it is a python script, but should we standardize some sort of thing for the bash/sh scripts? Right now the makepkg script is starting to turn into an interesting mix of tabs and spaces, especially if someone uses a ts size different than 4. Here is my take on the situation: 1. Update the modeline for abs- ft should be detected anyway, and no need for two modelines. 2. Standardize the inclusion of the modeline used by the gensync script across all bash scripts included with pacman. It makes sense to have one standard and this seems to be the one most readily available for scripting. Always place this modeline as the last line of the file. If spacing/tabs is a no-no here, I apologize. :) -Dan

3 9

[pacman-dev] patch for makepkg bug #3289
by Dan McGee 18 Dec '06

18 Dec '06

http://bugs.archlinux.org/task/3289 is the ftp status bug, I took the idea from the patch that was sitting there and updated it a bit and made it work for this version of makepkg. No promises that the patch applies smoothly, I have a lot of local changes to my makepkg... -Dan P.S. Aaron, when you apply these, you can take my comments out with my name, I don't really need or want the credit for each little change. I'm fine with just being an additional author in the authors list. I just figured I would at least put a comment in referencing the bug it fixed for clarity now and this can be cleaned up later. =================================================================== RCS file: /home/cvs-pacman/pacman-lib/scripts/makepkg,v retrieving revision 1.19 diff -u -r1.19 makepkg --- makepkg 14 Dec 2006 05:23:08 -0000 1.19 +++ makepkg 18 Dec 2006 06:40:11 -0000 @@ -568,7 +576,10 @@ fi msg " Downloading $file" $FTPAGENT "$netfile" 2>&1 - if [ ! -f "$file" ]; then - error "Failed to download $file" + # fix flyspray bug #3289 - Dan McGee <dpmcgee(a)gmail.com> + ftpret=$? + if [ $ftpret -gt 0 ]; then + error "Failure while downloading $file" msg "Aborting..." + rm "$file" exit 1

2 2

[pacman-dev] makepkg script changes
by Dan McGee 12 Dec '06

12 Dec '06

This is a relatively big patch with a few different things in it. As always, take it or leave it. * Addresses FS bugs 5223 and 5973, comments are in the patch noting the start of these changes. * Allows makepkg script to be usable again. I did notice that integrity checks are not working at the moment, but I assume that is known. * Removed some duplicate lines of code (e.g. things that were moved earlier in the script or outside of loops) * Adds quotes around filename references to ensure we do not break the script with weird filenames. * Changes use of `` and $() to be a bit more consistent- `` are used wherever possible. * Removes /usr/share from man page compression search- they are explicitly moved from this location ten lines before in the script so there better not be anything there. Dan ____________________ --- pacman-lib.orig/scripts/makepkg 2006-12-05 17:30:23.000000000 -0500 +++ pacman-lib/scripts/makepkg 2006-12-11 20:02:59.000000000 -0500 @@ -25,11 +25,12 @@ # USA. # -myver='2.9.8' +myver='3.0.0' startdir=`pwd` PKGDEST=$startdir # Options +BUILDSCRIPT="./PKGBUILD" CLEANUP=0 CLEANCACHE=0 DEP_BIN=0 @@ -187,18 +188,18 @@ if [ "$INFAKEROOT" = "1" ]; then export FAKEROOTKEY=$FAKEROOTKEY2 unset FAKEROOTKEY2 - fi + fi elif [ "$DEP_SRC" = "1" ]; then # install missing deps by building them from source. # we look for each package name in $SRCROOT and build it. if [ "$SRCROOT" = "" ]; then - error "Source root cannot be found - please make sure it is specified in /etc/makepkg.conf" + error "Source root cannot be found - please make sure it is specified in /etc/makepkg.conf" exit 1 fi # TODO: handle version comparators (eg, glibc>=2.2.5) msg "Building missing dependencies..." for dep in $deplist; do - candidates=$(find $SRCROOT -type d -name "$dep") + candidates=`find $SRCROOT -type d -name "$dep"` if [ "$candidates" = "" ]; then error "Could not find \"$dep\" under $SRCROOT" exit 1 @@ -266,12 +267,14 @@ echo " -k, --keepdocs Keep doc and info directories" echo " -L, --log Log package build process" echo " -m, --nocolor Disable colorized output messages" - echo " -n, --nostrip Do not strip binaries/libraries" + echo " -n, --nostrip Do not strip symbols from binaries/libraries" echo " -o, --nobuild Download and extract files only" echo " -p <buildscript> Use an alternate build script (instead of '$BUILDSCRIPT')" echo " -r, --rmdeps Remove installed dependencies after a successful build" echo " -s, --syncdeps Install missing dependencies with pacman" echo " -S, --sudosync Install missing dependencies with pacman and sudo" + # fix flyspray feature request #5223 + echo " -t <sourcedir> Cache source files in <sourcedir>" echo " -w <destdir> Write package to <destdir> instead of the working dir" echo echo "These options can be passed to pacman:" @@ -279,22 +282,19 @@ echo " --noconfirm Do not ask for confirmation when resolving dependencies" echo " --noprogressbar Do not show a progress bar when downloading files" echo - echo "If -p is not specified, makepkg will look for './$BUILDSCRIPT'" + echo "If -p is not specified, makepkg will look for '$BUILDSCRIPT'" echo } ARGLIST=$@ -if [ -f /etc//makepkg.conf ]; then +if [ -f /etc/makepkg.conf ]; then source /etc/makepkg.conf else error "/etc/makepkg.conf not found. cannot continue" exit 1 fi -#Let's be courteous and support frugalware's extensions -[ -e /usr/lib/frugalware/fwmakepkg ] && . /usr/lib/frugalware/fwmakepkg - while [ "$#" -ne "0" ]; do case $1 in # pacman @@ -327,7 +327,7 @@ exit 1 ;; -*) - while getopts "bBcCdefghij:Lmnop:rsSw:-" opt; do + while getopts "bBcCdefghij:kLmnop:rsSt:w:-" opt; do case $opt in b) DEP_SRC=1 ;; B) USE_CCACHE=0 ;; @@ -352,6 +352,7 @@ r) RMDEPS=1 ;; s) DEP_BIN=1 ;; S) DEP_SUDO=1 ;; + t) SRCDEST=$OPTARG ;; w) PKGDEST=$OPTARG ;; -) OPTIND=0 @@ -387,13 +388,19 @@ cd $OLDPWD if [ "$CLEANCACHE" = "1" ]; then - if [ "`id -u`" = "0" -a "$INFAKEROOT" != "1" ]; then + if [ -n "$SRCDEST" ]; then msg "Cleaning up source files from the cache." - rm -rf /var/cache/pacman/src/* + rm -rf $SRCDEST/* exit 0 else - error "You must be root to clean the cache." - exit 1 + if [ "`id -u`" = "0" -a "$INFAKEROOT" != "1" ]; then + msg "Cleaning up source files from the cache." + rm -rf /var/cache/pacman/src/* + exit 0 + else + error "You must be root to clean the cache." + exit 1 + fi fi fi @@ -401,7 +408,6 @@ unset replaces depends conflicts backup source install build makedepends unset options - # some applications (eg, blackbox) will not build with some languages unset LC_ALL LANG umask 0022 @@ -409,11 +415,6 @@ if [ ! -f $BUILDSCRIPT ]; then error "$BUILDSCRIPT does not exist." exit 1 -else - #this is fun.... we'll unset - for var in $(grep "=" $BUILDSCRIPT | sed "s|.*$\<.*\>$=.*|\1|g"); do - unset $var - done fi source $BUILDSCRIPT @@ -427,16 +428,18 @@ error "pkgrel is not allowed to be empty." exit 1 fi -if [ $(echo $pkgver | grep '-') ]; then +if [ `echo $pkgver | grep '-'` ]; then error "pkgver is not allowed to contain hyphens." exit 1 fi -if [ $(echo $pkgrel | grep '-') ]; then +if [ `echo $pkgrel | grep '-'` ]; then error "pkgrel is not allowed to contain hyphens." exit 1 fi if ! in_array $CARCH ${arch[@]}; then error "$pkgname is not available for the '$CARCH' architecture." + plain "Note that many packages may need a line added to their $BUILDSCRIPT" + plain "such as arch=('$CARCH')." exit 1 fi @@ -457,8 +460,6 @@ fi fi -# some applications (eg, blackbox) will not build with some languages -unset LC_ALL LANG # Enter the fakeroot environment if necessary. This will call the makepkg script again # as the fake root user. We detect this by passing a sentinel option (-F) to makepkg @@ -488,7 +489,8 @@ msg "Making package: $pkgname $pkgver-$pkgrel (`date`)" unset deplist makedeplist -if [ `type -p pacman` -a "$NODEPS" = "0" ]; then +# fix flyspray bug #5973 +if [ `type -p pacman` -a "$NODEPS" = "0" -a "$GENINTEG" = "0" -a "$NOBUILD" = "0" ]; then msg "Checking Runtime Dependencies..." deplist=`checkdeps ${depends[@]}` handledeps $deplist @@ -507,7 +509,7 @@ if [ $? -gt 0 ]; then exit 1 fi -elif [ "$NODEPS" = "1" ]; then +elif [ "$NODEPS" = "1" -o "$GENINTEG" = "1" -o "$NOBUILD" = "1" ]; then warning "skipping dependency checks." else warning "pacman was not found in PATH. skipping dependency checks." @@ -520,13 +522,16 @@ mkdir -p src cd $startdir/src for netfile in ${source[@]}; do - file=`strip_url $netfile` - if [ -f ../$file ]; then + file=`strip_url "$netfile"` + if [ -f "../$file" ]; then msg " Found $file in build dir" - cp ../$file . - elif [ -f /var/cache/pacman/src/$file ]; then - msg " Using local copy of $file" - cp /var/cache/pacman/src/$file . + cp "../$file" . + elif [ -f "$SRCDEST/$file" ]; then + msg " Using cached copy of $file" + cp "$SRCDEST/$file" . + elif [ -f "/var/cache/pacman/src/$file" ]; then + msg " Using cached copy of $file" + cp "/var/cache/pacman/src/$file" . else # check for a download utility if [ -z "$FTPAGENT" ]; then @@ -540,35 +545,35 @@ msg "Aborting..." exit 1 fi - proto=`echo $netfile | sed 's|://.*||'` + proto=`echo "$netfile" | sed 's|://.*||'` if [ "$proto" != "ftp" -a "$proto" != "http" -a "$proto" != "https" ]; then error "$netfile was not found in the build directory and is not a proper URL." msg "Aborting..." exit 1 fi msg " Downloading $file" - $FTPAGENT $netfile 2>&1 - if [ ! -f $file ]; then + $FTPAGENT "$netfile" 2>&1 + if [ ! -f "$file" ]; then error "Failed to download $file" msg "Aborting..." exit 1 fi - if [ "`id -u`" = "0" -a "$INFAKEROOT" != "1" ]; then - mkdir -p /var/cache/pacman/src && cp $file /var/cache/pacman/src + if [ -n "$SRCDEST" ]; then + mkdir -p $SRCDEST && cp "$file" $SRCDEST + elif [ "`id -u`" = "0" -a "$INFAKEROOT" != "1" ]; then + mkdir -p /var/cache/pacman/src && cp "$file" /var/cache/pacman/src else - cp $file .. + cp "$file" .. fi fi done - - if [ "$NOEXTRACT" = "1" ]; then warning "Skipping source extraction -- using existing src/ tree" warning "Skipping source integrity checks -- using existing src/ tree" else for integ in ${INTEGRITY_CHECK[@]}; do - integ="$(echo $integ | tr A-Z a-z)" + integ=`echo $integ | tr A-Z a-z` case "$integ" in md5) integrity_name="md5sum" ;; sha1) integrity_name="sha1sum" ;; @@ -577,12 +582,13 @@ sha512) integrity_name="sha512sum" ;; *) error "Invalid integrity algorithm '$integ' specified"; exit 1;; esac - if [ ! $(type -p $integrity_name) ]; then + if [ ! `type -p $integrity_name` ]; then error "Cannot find the $integrity_name program." exit 1 fi - if [ "$GENINTEG" = "1" ]; then + # Generate integrity checks + if [ "$GENINTEG" = "1" ]; then msg "Generating ${integrity_name}s for source files" plain "" ct=0 @@ -590,7 +596,7 @@ numsrc=${#source[@]} for netfile in "${source[@]}"; do file=`strip_url "$netfile"` - sum=$(eval "$integrity_name '$file' | cut -d' ' -f 1") + sum=`eval "$integrity_name '$file' | cut -d' ' -f 1"` if [ $ct -eq 0 ]; then echo -n "${integrity_name}s=(" else @@ -607,7 +613,8 @@ done plain "" exit 0 - else #validation + # Validate integrity checks + else integrity_sums=($(eval echo \${${integrity_name}s[@]})) if [ ${#integrity_sums[@]} -eq ${#source[@]} ]; then @@ -615,7 +622,7 @@ errors=0 idx=0 for netfile in "${source[@]}"; do - file=$(strip_url "$netfile") + file=`strip_url "$netfile"` echo -n " $file ... " >&2 echo "${integrity_sums[$idx]} $file" | $integrity_name -c - >/dev/null 2>&1 if [ $? -ne 0 ]; then @@ -723,9 +730,6 @@ mv "$BUILDLOG" "$BUILDLOG.$i" fi - echo $SHELLOPTS | grep errexit 2>&1 >/dev/null - set_e=$? - #use 'errexit' to bail on syntax error [ $set_e -eq 1 ] && set -e build 2>&1 | tee "$BUILDLOG" @@ -771,12 +775,12 @@ # compress man pages msg "Compressing man pages..." -find $startdir/pkg/{usr{,/local,/share},opt/*}/man -type f 2>/dev/null | while read i ; do +find $startdir/pkg/{usr{,/local},opt/*}/man -type f 2>/dev/null | while read i ; do ext="${i##*.}" fn="${i##*/}" if [ "$ext" != "gz" -a "$ext" != "bz2" ]; then # update symlinks to this manpage - find $startdir/pkg/{usr{,/local,/share},opt/*}/man -lname "$fn" 2> /dev/null | while read ln ; do + find $startdir/pkg/{usr{,/local},opt/*}/man -lname "$fn" 2> /dev/null | while read ln ; do rm -f "$ln" ln -sf "${fn}.gz" "${ln}.gz" done --- pacman-lib.orig/etc/makepkg.conf.in 2006-11-16 20:40:22.000000000 -0500 +++ pacman-lib/etc/makepkg.conf.in 2006-12-11 20:09:54.000000000 -0500 @@ -61,8 +61,10 @@ # PACKAGE OUTPUT ######################################################################### # -#-- Destination: specify a fixed directory where all packages will be placed +#-- Destination: specify a fixed directory where made packages will be placed #PKGDEST=/home/packages +#-- Source cache: specify a fixed directory where source files will be cached +#SRCDEST=/home/source #-- Packager: name/email of the person or organization building packages #PACKAGER="John Doe <john(a)doe.com>"

2 2

[pacman-dev] rankmirrors script
by Dan McGee 08 Dec '06

08 Dec '06

Here is a alternative to the current sortmirrrors script. It was designed to address this bug: http://bugs.archlinux.org/task/2952. It does not touch your current mirror lists, it simply reads them and outputs timing information for each, and outputs a Server format that can be used in the mirrors list. I've never done any python before, and this is heavily based off the script found in the forums but slightly refined to do different and slightly more intuitive output. (http://bbs.archlinux.org/viewtopic.php?t=19278&sid=475ab18a5d9b31952459fd99…) Dan __________________________________ #! /usr/bin/python # # rankmirrors : read a list of mirrors from a file and rank them by speed # # Original Idea copyright (c) 2006 R.G. <chesercat> # Modified 2006 by Dan McGee <dpmcgee(a)gmail.com> # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111-1307, # USA. # import sys, time, socket, urllib2 from optparse import OptionParser socket.setdefaulttimeout(10) def createOptParser(): parser = OptionParser() parser.add_option("-n", dest="num", default=0, help="number of servers to print, 0 for all") parser.add_option("-v", "--verbose", action="store_true", dest="verbose", default=False, help="be verbose in output") return parser def timeCmd(cmd): before = time.time(); try: cmd(); except KeyboardInterrupt, ki: raise ki except socket.timeout, ioe: return 'timeout' except Exception, e: return 'unreachable' return time.time() - before; def talkToServer(serverUrl): opener = urllib2.build_opener() tmp = opener.open(serverUrl).read() def getFuncToTime(serverUrl): return lambda : talkToServer(serverUrl) def cmpPairBySecond(p1, p2): if p1[1] == p2[1]: return 0 if p1[1] < p2[1]: return -1 return 1 if __name__ == "__main__": parser = createOptParser() (options, args) = parser.parse_args() if len(args) != 1: parser.print_help() sys.exit(0) fl = open(args[0], 'r') serverToTime = {} print 'Querying servers, this may take some time...' for ln in fl.readlines(): splitted = ln.split('=') if splitted[0].strip() != 'Server': continue serverUrl = splitted[1].strip() if serverUrl[-1] == '\n': serverUrl = serverUrl[0:-1] if options.verbose: print serverUrl, '...', else: print ' * ', sys.stdout.flush() serverToTime[serverUrl] = timeCmd(getFuncToTime(serverUrl)) if options.verbose: print serverToTime[serverUrl] items = serverToTime.items() items.sort(cmpPairBySecond) numToShow = int(options.num) if numToShow == 0: numToShow = len(items) if len(items) > 0: print print ' Servers sorted by time:' print for i in items[0:numToShow]: print i[1], ':', i[0] if len(items) > 0: print print ' Server list format:' print for i in items[0:numToShow]: print 'Server =', i[0]

3 8

[pacman-dev] pacman.conf possible changes
by Dan McGee 08 Dec '06

08 Dec '06

I've included a patch to clean up pacman.conf a bit and move the instructions it provides at the top to a more applicable position in the file. I removed most of the NoUpgrade lines in the file because all of these files are already protected by their respective packages (at least in Arch, and I would assume in Frugal as well). I also moved the comment about reordering the mirrors to right above where the server lists are specified. I removed the reference to sortmirrors for two reasons- it isn't in the current pacman CVS, and I am working on a script that may do the job slightly better and not delete mirrors as the current script does (Flyspray #2952). It is based off the script noted in the bug report that was posted in the forums. Dan --- pacman-lib.orig/etc/pacman.conf.in 2006-11-15 15:22:46.000000000 -0500 +++ pacman-lib/etc/pacman.conf.in 2006-12-05 18:06:23.000000000 -0500 @@ -1,16 +1,6 @@ # # /etc/pacman.conf # -# NOTE: If you find a mirror that is geographically close to you, please -# move it to the top of the server list, so pacman will choose it -# first. -# -# To re-sort your mirror lists by ping/traceroute results, use the -# /usr/bin/sortmirrors.pl script. It requires the "netselect" package. -# -# # sortmirrors.pl </etc/pacman.conf >pacman.conf.new -# - # See the pacman manpage for option directives # @@ -18,42 +8,40 @@ # [options] LogFile = /var/log/pacman.log -NoUpgrade = etc/passwd etc/group etc/shadow etc/sudoers -NoUpgrade = etc/fstab etc/raidtab etc/mdadm.conf etc/ld.so.conf -NoUpgrade = etc/inittab etc/rc.conf etc/rc.local -NoUpgrade = etc/modprobe.conf etc/modules.conf -NoUpgrade = etc/lilo.conf boot/grub/menu.lst etc/mkinitrd.conf HoldPkg = pacman glibc #XferCommand = /usr/bin/wget --passive-ftp -c -O %o %u # # REPOSITORIES # - can be defined here or included from another file -# - pacman will search repositories in the order defined here. +# - pacman will search repositories in the order defined here # - local/custom mirrors can be added here or in separate files -# +# - to add a preferred server, place it before an Include directive or first +# in the included file +# +# NOTE: If you find a mirror that is geographically close to you, please move +# it to the top of the server list, so pacman will choose it first. By default +# mirror lists are located in /etc/pacman.d/ +# + #[testing] #Server = ftp://ftp.archlinux.org/testing/os/i686 [current] -# Add your preferred servers here, they will be used first Include = /etc/pacman.d/current [extra] -# Add your preferred servers here, they will be used first Include = /etc/pacman.d/extra -#[unstable] -# Add your preferred servers here, they will be used first -#Include = /etc/pacman.d/unstable - [community] -# Add your preferred servers here, they will be used first Include = /etc/pacman.d/community -# An example of a custom package repository. See the pacman manpage for -# tips on creating your own repositories. +#[unstable] +#Include = /etc/pacman.d/unstable + +# See the pacman manpage for tips on creating your own repositories. #[custom] #Server = file:///home/custompkgs

4 6