On Wed, Sep 2, 2009 at 11:58, Roman Kyrylych wrote:

On Wed, Sep 2, 2009 at 11:55, Roman Kyrylych wrote:

...

On Wed, Sep 2, 2009 at 11:41, Dieter Plaetinck wrote:

...

I think a big improvemt will be when we fix it so that if we move packages from testing to extra/core, mirrors will not see as a "file remove and a new file", which causes a lot of unneeded traffic. if we make this system use symlinks or whatever this can be handled much better. but other then that, I think the current syncing system is fine. (the "getting" part is something different. see tiered setup,mirrorbrain etc. discussions)

Since we already use symlinks for -any packages this proposal looks okay. The layout could be like this then:

Oops, copy-paste error. Should be this way.

Double FAIL!!! core/os/i686/foobar-1.2.3-1-i686.pkg.tar.gz -> ../../../all-packages/os/i686/foobar-1.2.3-1-i686.pkg.tar.gz extra/os/i686/foobaz-4.5.6-1-i686.pkg.tar.gz -> ../../../all-packages/os/i686/foobar-4.5.6-1-i686.pkg.tar.gz all-packages/os/i686/foobar-4.5.6-1-i686.pkg.tar.gz This is just an idea. Feel free to shoot it if you don't like it. -- Roman Kyrylych (Роман Кирилич)

On Wed, 2009-09-02 at 11:05 +0200, Thomas Bächler wrote:

This can be avoided if we (instead of moving everything at once), just start doing this for new packages and leave the old ones where they are. There is no need to resync already synced packages.

+1 Just place new packages in /all/ or /pool/ and symlink them to the repos. One issue is that mirrors need to synchronize this new directory also. This will reduce a lot of traffic when packages are moved from testing to core.

On Wed, Sep 2, 2009 at 12:05, Thomas Bächler wrote:

Roman Kyrylych schrieb:

...

The negative side is that this will need one-time redownload of all packages by mirrors,

Which will take several weeks!

True

...

though this can be avoided by manual moving of the files by mirror admin (need to be done in this way: wait until /all syncing starts, kill rsync, move packages manually, start rsync).

This can be avoided if we (instead of moving everything at once), just start doing this for new packages and leave the old ones where they are. There is no need to resync already synced packages.

Good point!

...

BTW I always wondered why we have that silly "os" subdir. Would be nice to get rid of it during this big mirroring change (if it'll happen).

So, you also want to break user's configurations now? Why fix something that isn't broken?

Workaround by another symlink (<repo>/os -> ../)? :-P I agree that this is just cosmetics (extra /os/ is ugly IMO), so this is not that important. -- Roman Kyrylych (Роман Кирилич)