Launchpad should provide dgettable URLs

The right way to solve this problem is to offer a virtual mapping of the librarian's dsc + orig + diff (and other dependencies) into a single directory. That shouldn't be too hard and we could actually stick it under sourcepackagerelease/+files/ or something like that. I suspect it could actually be implemented using "virtual" files that just redirected to the librarian URLs; that'd be easier than streaming the librarian content, but even that is pretty easy.

Yeah, this bug is really annoying :-) Virtual files would probably be ok as long as they don't confuse wget.

We cannot change the Librarian behavior - we need one directory per file to avoid namespace conflicts.

We could provide dget-able link in Launchpad as kiko suggests, although it is not optimal in that Launchpad serves everything via https at the moment.

So two questions for William (or other dget luminaries) to assist us in implementing this:

  - Does dget support HTTP redirects?
  - Does dget support HTTPS?

I'm not sure about HTTP redirects, my guess is no, but I'm not positive. dget uses curl (and wget if curl isn't available). I do see that dget has a --insecure option to not check SSL certs so I'm guessing HTTPS is ok.

On Sat, Aug 04, 2007 at 09:03:21PM -0000, Jordan Mantha wrote:
> I'm not sure about HTTP redirects, my guess is no, but I'm not positive.
> dget uses curl (and wget if curl isn't available). I do see that dget

Both curl and wget know how to follow HTTP redirects, so I'd guess yes,
but it'd be really cool if somebody could test and come back with the
advice so we can move on with this :-)

wget handles redirects just fine. With curl you have to pass it the -L flag to get it to follow. I dug around the dget script and found that it does use -L for curl, \o/

I did a simple test redirect dgetting a real source package on my server and it works for both the wget and curl backends. Looks like we're ready to go.

Okay, started on a patch that works.

Wow, this is so easy to actually do. Fun! I need a test for it now, though.. and I'll need Celso to tell me how to test it.

So to confirm: if the DSC in Y/foo.dsc itself redirects to location X/foo.dsc, will dget try and find the files it refers to under Y or X?

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Christian Reis wrote:
> So to confirm: if the DSC in Y/foo.dsc itself redirects to location
> X/foo.dsc, will dget try and find the files it refers to under Y
> or X?

I've just tested this, and it looks under where it was redirected from
(ie. Y), not the destination, which likely makes things significantly
easier for you.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFHVLMAAc+S8KckfcURAn6UAJ4nfr7aMQJX+rOC9p4snS9YkkhkfACeIO8J
nXd6LFIUvJ8hcOn7fInCUY8=
=kM+7
-----END PGP SIGNATURE-----

Cool, that's what I had assumed. This patch will land today and you'll
be able to use it on edge by tomorrow.

\o/

Well done kiko!

Landed in RF 5298. Edge should update tonight and if so please take a look at the package downloads (not PPAs or the upload queue; those are next) and see if they work. I'd love feedback!