[arch-general] a python rewrite of pkgfile
hi. I started in August a rewrite in python of pkgfile from pkgtools package. The idea was to speed it up and avoid the use of a tree of file and use a sqlite3 db instead. I wrote it quickly and proposed a merge (on github) to Daenyth. He seems to respond well, reviewing the code. But then nothing, except that I vaguely begin to hear about a C python module that read *.files.tar.gz directly. I had to guess that my solution of using an sqlite3 db was not appreciated. I have to admit the intermediate step needed to convert *.files.tar.gz files into sqlite3 db was not that good. By accident, on IRC, I learned that it was brain0 that wrote the module and picked it up on its git repo. I modifed my python code, and made addition to the C module. Later, I also added to the module the possibility to extract full info of a package from desc and depend files in *.db.tar.gz to finalize the rewrite. So it's finished for quite some time now. Daenyth says "he appreciated the hard work" but I see no progress on merging or releasing something so far. The benefit of the rewrite: - super faster speed (thanks to brain0 C module) - download database files from mirror only if updates are available (for http mirrors only) - as a bonus you got a python module written in C that can read packages info in *.files.tar.gz or *.db.tar.gz it's on github https://github.com/solsticedhiver/pkgtools/tree/plan-A a PKGBUILD to build a package of pkgtools with the new pkgfile http://paste.pocoo.org/show/321584/
On Sun, Jan 16, 2011 at 10:54, solsTiCe d'Hiver <solstice.dhiver@gmail.com> wrote:
hi. I started in August a rewrite in python of pkgfile from pkgtools package. Wow, was it really way back in August? Wow... It's been a really busy year for me. I'll try to get that release out today, since I have time. I've been sitting on it way too long. Thanks for the kick in the ass on it :P
Le dimanche 16 janvier 2011 à 11:02 -0500, Daenyth Blank a écrit :
Wow, was it really way back in August? Wow... I started it. That last time we talked about it must have been in december though
On 01/16/2011 05:54 PM, solsTiCe d'Hiver wrote:
By accident, on IRC, I learned that it was brain0 that wrote the module and picked it up on its git repo. I modifed my python code, and made addition to the C module.
have you sent the changes to Thomas to incorporate in his git repo? -- Ionuț
Am 16.01.2011 17:16, schrieb Ionuț Bîru:
On 01/16/2011 05:54 PM, solsTiCe d'Hiver wrote:
By accident, on IRC, I learned that it was brain0 that wrote the module and picked it up on its git repo. I modifed my python code, and made addition to the C module.
have you sent the changes to Thomas to incorporate in his git repo?
My repo is sort of dead. The current status should be in solstice's repo.
On Sun, Jan 16, 2011 at 9:54 AM, solsTiCe d'Hiver <solstice.dhiver@gmail.com> wrote:
hi. I started in August a rewrite in python of pkgfile from pkgtools package.
The idea was to speed it up and avoid the use of a tree of file and use a sqlite3 db instead.
I wrote it quickly and proposed a merge (on github) to Daenyth. He seems to respond well, reviewing the code. But then nothing, except that I vaguely begin to hear about a C python module that read *.files.tar.gz directly.
I had to guess that my solution of using an sqlite3 db was not appreciated. I have to admit the intermediate step needed to convert *.files.tar.gz files into sqlite3 db was not that good.
By accident, on IRC, I learned that it was brain0 that wrote the module and picked it up on its git repo. I modifed my python code, and made addition to the C module.
Later, I also added to the module the possibility to extract full info of a package from desc and depend files in *.db.tar.gz to finalize the rewrite.
So it's finished for quite some time now. Daenyth says "he appreciated the hard work" but I see no progress on merging or releasing something so far.
The benefit of the rewrite: - super faster speed (thanks to brain0 C module) - download database files from mirror only if updates are available (for http mirrors only) - as a bonus you got a python module written in C that can read packages info in *.files.tar.gz or *.db.tar.gz
it's on github https://github.com/solsticedhiver/pkgtools/tree/plan-A
a PKGBUILD to build a package of pkgtools with the new pkgfile http://paste.pocoo.org/show/321584/
Maybe you could provide the PKGBUILD in the AUR?
On Sun, Jan 16, 2011 at 11:26, Thomas Dziedzic <gostrc@gmail.com> wrote:
Maybe you could provide the PKGBUILD in the AUR? I'll have the package pushed to community by the end of the day, so it shouldn't be needed.
participants (5)
-
Daenyth Blank
-
Ionuț Bîru
-
solsTiCe d'Hiver
-
Thomas Bächler
-
Thomas Dziedzic