Projects
New Ticket     Wiki     Browse Source     Timeline     Roadmap     Bug Reports     Search

Ticket #8571 (assigned enhancement)

Opened 3 years ago

Last modified 13 months ago

REF: Make MP download archives from a remote machine

Reported by: dluke@… Owned by: dluke@…
Priority: Low Milestone: MacPorts base enhancements
Component: base Version:
Keywords: Cc: yeled@…
Port:

Description (last modified by jmpp@…) (diff)

This patch adds support for a new conf key, remotearchiveurl, if archive mode and this key is set to a webserver having darwinports packages, it will download the pre-build packages from the URL and use the package to install the port (instead of building it).

Patch is a little rough (due to my lack of serious tcl-foo), but it seems to work pretty well for me right now.

Intended behavior is to look for a local archive first, then the remote archive (if necessary), and then if necessary build the port normally.

Since it's fairly easy to point apache to a darwinports packages directory, this makes maintaining ports on multiple machines take less time (as each port only needs to be built once).

If we ever get around to auto-building ports, we could conceivably make packages available this way as well.

Patch will be attached shortly.

Attachments

dp_remote_archive.patch (3.9 KB) - added by dluke@… 3 years ago.
Enable archive mode to pull archives from a remote machine
dp_remote_archive.2.patch (3.9 KB) - added by dluke@… 3 years ago.
updated patch
dp_remote_archive.3.patch (4.0 KB) - added by dluke@… 3 years ago.
Updated patch

Change History

Changed 3 years ago by dluke@…

Enable archive mode to pull archives from a remote machine

Changed 3 years ago by dluke@…

updated patch

Changed 3 years ago by dluke@…

  • attachments.isobsolete changed from 0 to 1

Changed 3 years ago by dluke@…

  • attachments.isobsolete changed from 0 to 1

Changed 3 years ago by dluke@…

Updated patch

Changed 3 years ago by dluke@…

I'm running this on two machines and so far it looks good.

I'd like feedback, if possible. I think this would be useful for many users.

Changed 3 years ago by dluke@…

Bueller?

Changed 3 years ago by dluke@…

(In reply to comment #5)

Bueller?

Anyone else try this?

Changed 3 years ago by yeled@…

  • cc yeled@… added

will test today

Changed 3 years ago by dluke@…

(In reply to comment #7)

will test today

If you have a 10.4 machine, you can test with remotearchiveurl http://geeklair.net/packages

Changed 3 years ago by yeled@…

thanks, it works - but it needs a certain feature - a cksum for each package.

also - if the download fails - i get a bus error...

Changed 3 years ago by dluke@…

(In reply to comment #9)

thanks, it works - but it needs a certain feature - a cksum for each package.

Where would this checksum go? [do we need to ask maintainers to have 2 checksums in each portfile for this to work?]

Perhaps the remote archives could be gpg-signed instead? (or there could be a gpg-signed checksum file?)

If the remote host is trusted, why is it necessary (or is that your point?)?

also - if the download fails - i get a bus error...

updates to the patch are welcome :-)

Changed 2 years ago by dluke@…

For better integration, I'm now thinking that this needs to be a new phase (ie, fetcharchive).

Otherwise, it interacts poorly with the upgrade code.

When I get some time, I'll code it up that way and see if I can include as much of Charlie's feedback as possible.

Changed 2 years ago by yeled@…

thanks - I am not able to input any Tcl I'm afriad :)

Changed 2 years ago by dluke@…

(In reply to comment #12)

thanks - I am not able to input any Tcl I'm afriad :)

I couldn't either before I decided to do this ;-)

Changed 2 years ago by jmpp@…

Hey Daniel! As disussed yesterday through mail, I checked in my fix to get upgrade and archivemode working. I know this might break your patch here, but this "remotearchiveurl" thing is not yet complete and I feel the former is a rather important fix. Lets rethink your patch and try to get it working with the current sources, do let me know if you need my help (my tcl foo being most probably lower than everybody else's, maybe I can still provide ideas and testing).

-jmpp

Changed 2 years ago by dluke@…

(In reply to comment #14)

Hey Daniel! As disussed yesterday through mail, I checked in my fix to get upgrade and archivemode working. I know this might break your patch here, but this "remotearchiveurl" thing is not yet complete and I feel the former is a rather important fix.

I think your decision was correct (I forgot that that change you proposed only broke my remotearchive stuff).

Lets rethink your patch and try to get it working with the current sources, do let me know if you need my help (my tcl foo being most probably lower than everybody else's, maybe I can still provide ideas and testing).

I was planning on re-writing it to make it a full stage and support gpg-signed archives anyway, as soon as I get some time.

I'll be sure to ask for testing help once I have something ready.

Changed 2 years ago by markd@…

  • type changed from defect to enhancement

Changed 2 years ago by dluke@…

  • owner changed from macports-tickets@… to dluke@…
  • status changed from new to assigned

Changed 21 months ago by markd@…

  • summary changed from Make dp download archives from a remote machine to REF: Make MP download archives from a remote machine

Changed 17 months ago by jmpp@…

  • priority changed from Expected to Nice to have
  • description modified (diff)
  • milestone set to Feature Requests

Not too sure if this is still a wanted feature, if many users see the value in archivemode. But at least for tracking purposes I'm moving this ticket to the "Feature Requests" milestone. Any updates on it, Daniel?

-jmpp

Changed 16 months ago by jmpp@…

  • milestone changed from Feature Requests to MacPorts base enhancements

Milestone Feature Requests deleted

Changed 16 months ago by nox@…

  • cc yeled@… added; yeled@… removed
  • priority changed from Nice to have to Low
  • version 1.2 deleted

Changed 13 months ago by jmpp@…

Ticket #10919 has been marked as duplicate of this one, noted here for tracking purposes.

-jmpp

Note: See TracTickets for help on using tickets.