Everyone, Xavier and I noticed when walking through the translations tonight that we haven't done the greatest job keep our workload down here. There are a lot of messages that differ by punctuation only, or contain a hardcoded path vs. another one with a '%s', etc. I hacked together a quick script to find some of these awesome mistakes. The script is attached (and instructions if you want to run it locally are roughly in the top, it requires the python-Levenshtein module), the results are pasted below from both of our pot files. Should we try and fix some of this mess right now while we are waiting on translations? For most people it should not increase your workload as we will be reducing the number of translations and not be adding more than a handful of new ones (that can be based off of the existing ones if necessary). -Dan dmcgee@galway ~/projects/pacman (master) $ ./similar-messages.py lib/libalpm/po/libalpm.pot Read 136 messages Found 36 similar messages 0.815: could not change directory to %s (%s)\n could not change the root directory (%s)\n 0.815: could not open file %s: %s\n could not open pipe (%s)\n 0.815: invalid or corrupted package invalid or corrupted delta 0.816: could not open %s: %s\n could not open pipe (%s)\n 0.821: unexpected system error unexpected error 0.824: could not create directory %s: %s\n could not create temp directory\n 0.825: could not change the root directory (%s)\n could not change directory to / (%s)\n 0.828: removing invalid database: %s\n removing invalid file: %s\n 0.828: transaction already initialized transaction not initialized 0.829: %s-%s is up to date -- skipping\n %s-%s is up to date -- reinstalling\n 0.833: %s saved as %s\n %s installed as %s\n 0.833: could not open database could not create database 0.833: could not find database could not update database 0.838: could not change directory to %s (%s)\n could not create directory %s: %s\n 0.842: could not find or read file could not find or read package 0.847: missing package name in %s\n missing package version in %s\n 0.847: could not find or read file could not find or read directory 0.852: could not create pipe (%s)\n could not open pipe (%s)\n 0.853: failed to retrieve some files failed to retrieve some files from %s\n 0.853: problem occurred while upgrading %s\n problem occurred while installing %s\n 0.857: duplicated database entry '%s'\n corrupted database entry '%s'\n 0.867: missing package name in %s\n missing package metadata in %s\n 0.870: could not open database could not find database 0.872: could not update database entry %s-%s\n could not remove database entry %s-%s\n 0.874: could not get filesystem information\n could not get filesystem information for %s: %s\n 0.875: could not open database could not update database 0.880: could not create database could not update database 0.882: could not commit removal transaction\n could not commit transaction\n 0.886: could not remove database entry could not remove database entry %s-%s\n 0.902: could not open file %s: %s\n could not open %s: %s\n 0.924: %s database is inconsistent: name mismatch on package %s\n %s database is inconsistent: version mismatch on package %s\n 0.929: %s: ignoring package upgrade (%s => %s)\n %s: ignoring package downgrade (%s => %s)\n 0.937: failed retrieving file '%s' from %s : %s\n failed retrieving file '%s' from %s\n 0.961: could not change directory to %s (%s)\n could not change directory to / (%s)\n 0.962: warning given when extracting %s (%s)\n warning given while extracting %s (%s)\n 0.963: not enough free disk space not enough free disk space\n dmcgee@galway ~/projects/pacman (master) $ ./similar-messages.py po/pacman.pot Read 487 messages Found 107 similar messages 0.803: Usage: repo-add [-d] [-f] [-q] <path-to-db> <package|delta> ...\\n Usage: repo-remove [-q] <path-to-db> <packagename|delta> ...\\n\\n 0.806: group \"%s\" was not found\n repository \"%s\" was not found.\n 0.807: The source directory is empty, there is nothing to build! The package directory is empty, there is nothing to repackage! 0.808: %s file (%s) does not exist. File '%s' does not exist 0.809: --asdeps mark packages as non-explicitly installed\n --asexplicit install packages as explicitly installed\n 0.809: --asexplicit mark packages as explicitly installed\n --asdeps install packages as non-explicitly installed\n 0.810: %s does not exist. File '%s' does not exist 0.810: -i, --info view package information (-ii for backup files)\n -i, --info view package information\n 0.812: problem setting dbpath '%s' (%s)\n problem setting logfile '%s' (%s)\n 0.812: Total Download Size: %.2f MB\n Total Removed Size: %.2f MB\n 0.812: Total Installed Size: %.2f MB\n Total Removed Size: %.2f MB\n 0.815: package \"%s\" not found\n package '%s' was not found\n 0.817: failed to prepare transaction (%s)\n failed to commit transaction (%s)\n 0.817: failed to commit transaction (%s)\n failed to release transaction (%s)\n 0.817: removing old packages from cache...\n removing all files from cache...\n 0.818: operation operations:\n 0.818: --config <path> set an alternate configuration file\n --logfile <path> set an alternate log file\n 0.818: Total Download Size: %.2f MB\n Total Installed Size: %.2f MB\n 0.821: %s is not allowed to start with a hyphen. %s is not allowed to contain hyphens. 0.821: Copyright (c) 2010-2011 Pacman Development Team <pacman-dev@archlinux.org>.\\nThis is free software; see the source for copying conditions.\\nThere is NO WARRANTY, to the extent permitted by law.\\n Copyright (c) 2009 Xavier Chantry <shiningxc@gmail.com>.\\n\\nThis is free software; see the source for copying conditions.\\nThere is NO WARRANTY, to the extent permitted by law.\\n 0.821: Searching for delta '%s'... Searching for package '%s'... 0.825: :: %s and %s are in conflict (%s). Remove %s? :: %s and %s are in conflict (%s)\n 0.826: target not found: %s\n database not found: %s\n 0.827: :: %s and %s are in conflict. Remove %s? :: %s and %s are in conflict (%s)\n 0.828: Adding %s file... Adding %s... 0.829: Creating package... Compressing package... 0.829: Tar'ing up %s failed. Untar'ing %s failed. 0.830: checking dependencies...\n resolving dependencies...\n 0.831: no install reason specified (use -h for help)\n no operation specified (use -h for help)\n 0.833: checking package integrity...\n checking delta integrity...\n 0.838: could not access database directory\n could not access cache directory %s\n 0.839: Delta matching '%s' not found. Package matching '%s' not found. 0.841: problem setting rootdir '%s' (%s)\n problem setting dbpath '%s' (%s)\n 0.841: failed to prepare transaction (%s)\n failed to init transaction (%s)\n 0.841: failed to init transaction (%s)\n failed to release transaction (%s)\n 0.841: Copyright (c) 2006-2011 Pacman Development Team <pacman-dev@archlinux.org>.\\nCopyright (C) 2002-2006 Judd Vinet <jvinet@zeroflux.org>.\\n\\nThis is free software; see the source for copying conditions.\\nThere is NO WARRANTY, to the extent permitted by law.\\n Copyright (C) 2006-2008 Aaron Griffin <aaron@archlinux.org>.\\nCopyright (c) 2007-2008 Dan McGee <dan@archlinux.org>.\\n\\nThis is free software; see the source for copying conditions.\\nThere is NO WARRANTY, to the extent permitted by law.\\n 0.844: Creating package... Creating source package... 0.845: Failed to create package file. Failed to create symlink to package file. 0.846: Failed to create symlink to package file. Failed to create source package file. 0.852: Leaving fakeroot environment. Entering fakeroot environment... 0.854: no targets specified (use -h for help)\n no operation specified (use -h for help)\n 0.857: problem setting rootdir '%s' (%s)\n problem setting logfile '%s' (%s)\n 0.857: A package has already been built. (use -f to overwrite) Part of the package group has already been built. (use -f to overwrite) 0.857: Part of the package group has already been built. (use -f to overwrite) A source package has already been built. (use -f to overwrite) 0.858: Copyright (c) 2006-2011 Pacman Development Team <pacman-dev@archlinux.org>.\\nCopyright (C) 2002-2006 Judd Vinet <jvinet@zeroflux.org>.\\n\\nThis is free software; see the source for copying conditions.\\nThere is NO WARRANTY, to the extent permitted by law.\\n Copyright (c) 2010-2011 Pacman Development Team <pacman-dev@archlinux.org>.\\nThis is free software; see the source for copying conditions.\\nThere is NO WARRANTY, to the extent permitted by law.\\n 0.862: Creating 'depends' db entry... Creating 'files' db entry... 0.863: Compressing package... Compressing source package... 0.868: Installing package %s with %s -U... Installing %s package group with %s -U... 0.870: -d, --nodeps skip dependency checks\n -d, --nodeps Skip all dependency checks 0.870: Invalid package '%s' Invalid package file '%s'. 0.871: Failed to create source package file. Failed to create symlink to source package file. 0.872: Adding %s file... Adding %s file (%s)... 0.873: Creating source package... Compressing source package... 0.874: no targets specified (use -h for help)\n no install reason specified (use -h for help)\n 0.875: --asdeps mark packages as non-explicitly installed\n --asexplicit mark packages as explicitly installed\n 0.875: error: %s error: 0.878: The package names don't match : '%s' and '%s' The package architectures don't match : '%s' and '%s' 0.880: The package group has already been built. (use -f to overwrite) A source package has already been built. (use -f to overwrite) 0.881: --asdeps install packages as non-explicitly installed\n --asexplicit install packages as explicitly installed\n 0.881: %s is not allowed to contain colons or hyphens. %s is not allowed to contain hyphens. 0.883: --allsource Generate a source-only tarball including downloaded sources --source Generate a source-only tarball without downloaded sources 0.886: Determining latest darcs revision... Determining latest git revision... 0.887: You do not have write permission to store packages in %s. You do not have write permission to store downloads in %s. 0.889: downloading %s...\n Downloading %s... 0.892: '%s' is not a valid archive extension. '%s' does not have a valid archive extension. 0.896: Failed to create package file. Failed to create source package file. 0.899: Determining latest darcs revision... Determining latest hg revision... 0.900: warning: %s warning: 0.900: Skipping source retrieval -- using existing src/ tree Skipping source extraction -- using existing src/ tree 0.906: You must have correct permissions to upgrade the database. You must have correct permissions to optimize the database. 0.906: New optional dependencies for %s\n Optional dependencies for %s\n 0.909: function: %s function: 0.909: Checking runtime dependencies... Checking buildtime dependencies... 0.909: Creating 'desc' db entry... Creating 'files' db entry... 0.912: failed to commit transaction (%s)\n failed to init transaction (%s)\n 0.912: Determining latest cvs revision... Determining latest git revision... 0.912: Determining latest cvs revision... Determining latest bzr revision... 0.912: Determining latest git revision... Determining latest svn revision... 0.912: Determining latest git revision... Determining latest bzr revision... 0.912: Determining latest svn revision... Determining latest bzr revision... 0.912: checking package integrity...\n checking package integrity 0.912: Creating 'desc' db entry... Creating 'depends' db entry... 0.914: Determining latest darcs revision... Determining latest svn revision... 0.914: Determining latest darcs revision... Determining latest bzr revision... 0.915: checking for file conflicts...\n checking for file conflicts 0.915: A package has already been built. (use -f to overwrite) The package group has already been built. (use -f to overwrite) 0.917: failed to prepare transaction (%s)\n failed to release transaction (%s)\n 0.920: A package has already been built, installing existing package... The package group has already been built, installing existing packages... 0.920: --check Run the check() function in the %s --nocheck Do not run the check() function in the %s 0.921: checking available disk space...\n checking available disk space 0.921: Failed to create symlink to package file. Failed to create symlink to source package file. 0.923: :: %s and %s are in conflict\n :: %s and %s are in conflict (%s)\n 0.925: Determining latest cvs revision... Determining latest hg revision... 0.925: Determining latest svn revision... Determining latest hg revision... 0.925: Determining latest bzr revision... Determining latest hg revision... 0.925: The package group has already been built. (use -f to overwrite) Part of the package group has already been built. (use -f to overwrite) 0.927: ERROR: Can not create temp directory for database building. Cannot create temp directory for database building. 0.929: --asexplicit mark packages as explicitly installed\n --asexplicit install packages as explicitly installed\n 0.933: --asdeps mark packages as non-explicitly installed\n --asdeps install packages as non-explicitly installed\n 0.933: invalid option\n invalid option 0.940: A package has already been built. (use -f to overwrite) A source package has already been built. (use -f to overwrite) 0.941: :: %s and %s are in conflict. Remove %s? :: %s and %s are in conflict (%s). Remove %s? 0.941: Determining latest cvs revision... Determining latest svn revision... 0.943: Determining latest darcs revision... Determining latest cvs revision... 0.944: --noprogressbar do not show a progress bar when downloading files\n --noprogressbar Do not show a progress bar when downloading files 0.944: directive '%s' without value not recognized\n directive '%s' with a value not recognized\n 0.955: Determining latest git revision... Determining latest hg revision...