On Thu, Apr 9, 2009 at 13:40, Chris Brannon
Daenyth Blank wrote:
How is the filesize of the REPO.db? CMB was reporting that community was taking up more than 75mb with his version. Regardless of how the sqlite features would be implemented, I will also keep the flat file version available, and configurable. How are the searching and updating speeds compared to before?
Here are the rest of my results from yesterday. Inserting all of core, extra, and community took less than 6 minutes, on a machine with a single 2.5 GHz Pentium 4 CPU and 512 MB of RAM. The database weighed in at a whopping 240 megabytes. I haven't tried an incremental update yet.
Here is what I know about search speeds. A query like "select * from files where filename = 'usr/bin/getmail'" is practically instantaneous, as one would expect. "select * from files where filename like '%/getmail'" takes 5 seconds or so, because it has to iterate through all the filenames in the table.
If sqlite were used for pkgfile, that second query would need to be quite a bit faster than it is now.
-- Chris
Can you elaborate on the structure of your database? Perhaps that is influencing it. Have a look at Abhidg's sqlite-bash branch to compare, his .db feels seem MUCH smaller. I haven't tested any speeds yet, but I am poking at the code a bit.