Opened 10 years ago

Closed 8 years ago

#41452 closed defect (invalid)

Fetching distfiles will inexplicably hang in Mavericks

Reported by: elfprince13 (Thomas Dickerson) Owned by: macports-tickets@…
Priority: Normal Milestone:
Component: ports Version: 2.2.1
Keywords: mavericks Cc: ryandesign (Ryan Carsten Schmidt), jeremyhu (Jeremy Huddleston Sequoia)
Port:

Description

Since upgrading to Mavericks, I've noticed that fetching distfiles from certain servers (notably GNU, but some others as well) seems to just hang (not even any network traffic on the Activity Monitor). I've done a complete reinstall of MacPorts and all of my installed ports, and had to manually download a good 60 or so distfile packages in the process. As I'm typing this, I've watched the fetching process for gstreamer hang for a good 30 minutes with no evidence of activity (including any network traffic at all).

Attachments (1)

Screen Shot 2013-11-19 at 8.13.15 PM.png (100.8 KB) - added by elfprince13 (Thomas Dickerson) 10 years ago.

Download all attachments as: .zip

Change History (13)

comment:1 Changed 10 years ago by elfprince13 (Thomas Dickerson)

Cc: elfprince13@… added

Cc Me!

comment:2 Changed 10 years ago by ryandesign (Ryan Carsten Schmidt)

Cc: ryandesign@… added; elfprince13@… removed

What are some of the URLs that are hanging? Do you get the same problem if you try to access those URLs in a web browser? Do you use any unusual network setup, such as a proxy server?

comment:3 in reply to:  2 Changed 10 years ago by elfprince13 (Thomas Dickerson)

Replying to ryandesign@…:

What are some of the URLs that are hanging? Do you get the same problem if you try to access those URLs in a web browser? Do you use any unusual network setup, such as a proxy server?

ftp://ftp.gnu.org/gnu/* are the worst offenders (just hanging forever), but ftp://ftp.x.org/pub/individual/* and ftp://ftp.cse.buffalo.edu/pub/Gnome/sources/* both seem to hang for 10-20 minutes before jumping to a mirror. I managed to get the packages installed by opening the URLs in Firefox (which worked instantly) and then copying them to the distfiles folder, removing the 0 byte temp file that had been created, and restarting the install sequence.

No unusual network setup or proxies.

comment:4 Changed 10 years ago by ryandesign (Ryan Carsten Schmidt)

Hmm. Well, MacPorts sets the following curl options:

#define _CURL_CONNECTION_TIMEOUT	((long)(30))		/* 30 seconds */
#define _CURL_MINIMUM_XFER_SPEED	((long)1024)		/* 1KB/sec */
#define _CURL_MINIMUM_XFER_TIMEOUT	((long)(60))		/* 1 minute */

This means the connection will be aborted (and another mirror tried) if:

  • it takes more than 30 seconds to establish the connection to the server, or
  • the transfer is going at less than 1KB/sec for one minute

Based on this, I assume that your transfers are not stalled, but are merely running very slowly. You could do the installs with the -d flag to see download progress, or you could look in the distfiles directory and see the size of the file increase.

Not sure why the transfer speed would be higher when using Firefox.

comment:5 Changed 10 years ago by elfprince13 (Thomas Dickerson)

The temp file never grew at all. My Activity Monitor registered ~3Bytes/sec (no I'm not missing a prefix) for everything running on my entire system. I'll try with -d next time and see if that provides any insight.

The transfer speed wasn't just higher, it was basically instantaneous (I'm on a university connection with >200Mb/s down).

Changed 10 years ago by elfprince13 (Thomas Dickerson)

comment:6 Changed 10 years ago by elfprince13 (Thomas Dickerson)

See attachment: it's been at a current speed of 0 for quite a while and the timer is still climbing (I'm up to 4:30 as of posting). I downloaded it in less than a second with Firefox.

comment:7 Changed 10 years ago by ryandesign (Ryan Carsten Schmidt)

Ok. I'm sorry, I don't know why that is happening.

comment:8 in reply to:  7 Changed 10 years ago by elfprince13 (Thomas Dickerson)

Replying to ryandesign@…:

Ok. I'm sorry, I don't know why that is happening.

Me either. Let me know if there is other info I can provide to assist with debugging. Having to manually download a lot of files defeats a significant part of the purpose of using a package manager.

comment:9 Changed 10 years ago by jeremyhu (Jeremy Huddleston Sequoia)

A sysdiagnose would be useful.

comment:10 Changed 10 years ago by jeremyhu (Jeremy Huddleston Sequoia)

Cc: jeremyhu@… added

Cc Me!

comment:11 Changed 10 years ago by jeremyhu (Jeremy Huddleston Sequoia)

Keywords: mavericks added

comment:12 Changed 8 years ago by mf2k (Frank Schima)

Resolution: invalid
Status: newclosed

There is nothing to fix here. Since Trac is not for tech support, follow-up on the Macports Users mailing list instead.

Note: See TracTickets for help on using tickets.