Opened 9 years ago

Closed 9 years ago

#48174 closed defect (fixed)

Packages server: No space left on device

Reported by: ryandesign (Ryan Carsten Schmidt) Owned by: admin@…
Priority: Normal Milestone:
Component: server/hosting Version:
Keywords: Cc: jmroot (Joshua Root), neverpanic (Clemens Lang), Ionic (Mihai Moldovan)
Port:

Description

The packages server (packages.macports.org) ran out of disk space while the Yosemite buildbot builder was trying to upload packages to it:

https://build.macports.org/builders/buildports-yosemite-x86_64/builds/4414/steps/deploy%20archives/logs/stdio

rsync: write failed on "/var/www/html/packages/clang-3.5/clang-3.5-3.5.2_5+analyzer+arm_runtime.darwin_14.x86_64.tbz2": No space left on device (28)

Packages accumulate over time as existing ports are updated and as new ports are added, so disk usage only increases.

Joshua wrote a script that deletes obsolete packages which should free up some space: browser:users/jmr/delete_old_archives/delete_old_archives.py

There is no automated process that runs this script regularly. Perhaps just running it manually now would help.

It would be good to proactively monitor disk usage on MacPorts servers, rather than let things grind to a halt when the disks get completely full.

Change History (4)

comment:1 in reply to:  description Changed 9 years ago by Ionic (Mihai Moldovan)

Quoting what I wrote on the mailing list regarding the script:

As far as I can tell, it needs a generated list current_versions.txt (or whatever file name you pass as the second parameter) which is falling out of this script (needs redirection to a file): browser:users/jmr/delete_old_archives/current_versions.tcl

The first argument is the archive root directory.

comment:2 Changed 9 years ago by Ionic (Mihai Moldovan)

Cc: ionic@… added

Cc Me!

comment:3 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)

It looks like the packages server has some free disk space again. Keith, could you let us know what was done to resolve the issue, and if something will be done to routinely monitor disk space from now on?

comment:4 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)

Resolution: fixed
Status: newclosed

I instructed the buildbots to revisit all ports modified between r137993 (when the disk space problem started) and r138121, so that packages would be uploaded.

The Snow Leopard buildbot remains down for a different reason (#47976).

So the immediate problem seems resolved, but I would still like to know how it was resolved and how we'll prevent it from happening again.

Note: See TracTickets for help on using tickets.