[aur-general] New AUR Metadata Archives

[zoorat]

hi kevin,

thanks for replying
but look at this output...
```
❯ zcat packages-meta-ext-v1.json.broken.gz > packages-meta-ext-v1.broken.json

gzip: packages-meta-ext-v1.json.broken.gz: invalid compressed data--crc error

gzip: packages-meta-ext-v1.json.broken.gz: invalid compressed data--length error
❯ jq . packages-meta-ext-v1.broken.json
parse error: Invalid numeric literal at line 56106, column 838
❯ sed -n -e '56106,56106p' packages-meta-ext-v1.broken.json
{"ID":702872,"Name":"pulseaudio-bluedio","PackageBaseID":149681,"PackageBase":"pulseaudio-bluedio","Version":"13.0-3","Description":"A featureful, general-purpose sound server","URL":"https://www.freedesktop.org/wiki/Software/PulseAudio/","NumVotes":0,"Popularity":0.0,"OutOfDate":null,"Maintainer":"sdrik","FirstSubmitted":1583056828,"LastModified":1583066523,"URLPath":"/cgit/aur.git/snapshot/pulseaudio-bluedio.tar.gz","License":["GPL"],"Keywords":[],"Depends":["libpulse-bluedio=13.0-3","rtkit","libltdl","speexdsp","tdb","orc","libsoxr","webrtc-audio-processing"],"MakeDepends":["libasyncns","libcap","attr","libxtst","libsm","libsndfile","rtkit","libsoxr","speexdsp","tdb","systemd","dbus","avahi","bluez","bluez-libs","jack2","sbc","lirc","openssl","fftw","orc","gtk3","webrtc-audio-processing","check","git","meson","xmltomp,"git","i-xbrtrdmmm/lets-cli/lets"kdh7rtrdmmm/lGPL"],"Kprof2-git"],"Prcheck","gitxen<=9],"Decheck","gitends"<=1ackds":["goldendictMakeDepends":,"License":["ools"]},
❯ sed -n -e '56106,56106p' packages-meta-ext-v1.broken.json | jq
parse error: Invalid numeric literal at line 1, column 838
```

before sending that first mail, I tried to uncompress it with '7z'
and 'jq' gave me the same error. but, '7z' worked without any problem...
I noticed something wrong when I tried to prettyprint the original json file with 'jq'.

yours,
zoorat.
‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐

On Thursday, November 11th, 2021 at 23:27, Kevin Morris <kevr at 0cost.org> wrote:

> Hi zoorat,
>
> The files are downloadable in gzip format; when you receive
>
> the file, you'll need to uncompress it.
>
> Example:
>
> $ curl --output packages-meta-ext-v1.json.gz \
>
> 'https://aur.archlinux.org/packages-meta-ext-v1.json.gz'
>
> # zcat is cat for gz files; it uncompresses and cats the content.
>
> $ zcat packages-meta-ext-v1.json.gz > packages-meta-ext-v1.json
>
> You do bring up a nice point about the signature; perhaps we should
>
> provide sigs for all of these archives.
>
> Regards,
>
> Kevin
>
> On Thu, Nov 11, 2021 at 06:34:31AM +0000, zoorat via aur-general wrote:
>
> > On 11/11/21 06:22, aur-general-request at lists.archlinux.org wrote:
> >
> > > Hello AUR users,
> > >
> > > In addition to pre-existing archives, we've introduced two new
> > >
> > > archives that can be used instead of bulk queries against the RPC.
> > >
> > > Pre-existing archives:
> > >
> > > -   packages.gz
> > >     -   Listing of all packages separated by line break.
> > > -   pkgbase.gz
> > >     -   Listing of all package bases separated by line break.
> > > -   users.gz
> > >     -   Listening of all users separated by line break.
> > >
> > > Metadata archives:
> > >
> > > -   packages-meta-v1.json.gz
> > >     -   A complete `type=search` formatted JSON package archive.
> > > -   packages-meta-ext-v1.json.gz
> > >     -   A complete `type=multiinfo` formatted JSON package archive.
> > >
> > > All archives support Last-Modified and ETag. Each archive is updated
> > >
> > > on a rough ~5 minute interval. For any bulk users of the RPC, we ask
> > >
> > > that you consider these archives as a solution to repeated searches
> > >
> > > or bulk multiinfo requests.
> > >
> > > All archives are available for download athttps://aur.archlinux.org/archive-name.gz
> > >
> > > Using these archives will drastically help the AUR with the amount
> > >
> > > of traffic required for API clients. Particularly with clients who
> > >
> > > are able to query by themselves en masse.
> > >
> > > We thank you all for contributing to the world of AUR and helping
> > >
> > > those who can use your maintained software as a result.
> > >
> > > Regards,
> > >
> > > Kevin
> > >
> > > --
> > >
> > > Kevin Morris
> > >
> > > Software Developer
> >
> > That's awesome kevin,
> >
> > I got into a problem while downloading the
> >
> > 'packages-meta-ext-v1.json.gz' with wget.
> >
> > I somehow corrupted it ...
> >
> > so, is there any hash I can check against ??
> >
> > like '.sig' file for '.iso' files  but, as a hash is a text file maybe ??...
> >
> > sorry if I'm being dumb.
> >
> > yours,
> >
> > zoorat.
>
> Kevin Morris
>
> Software Developer
>
> Identities:
>
> -   kevr @ Libera