CHECKSUM failure when installing libxml2

[m.vissers@…]

When installing libxml2 there is a checksum failure in the libxml2-2.6.31.tar.gz file. the command executed is:

sudo port -d install libxml2

portfile and distfile checksums seem to differ.

i use port version 1.600 on a macbookpro with leopard OS system Version Mac OS X 10.5.2 (9C7010)

DEBUG: Found port in ​file:///opt/local/var/macports/sources/rsync.macports.org/release/ports/textproc/libxml2 DEBUG: Changing to port directory: /opt/local/var/macports/sources/rsync.macports.org/release/ports/textproc/libxml2 DEBUG: Requested variant darwin is not provided by port libxml2. DEBUG: Requested variant i386 is not provided by port libxml2. DEBUG: Requested variant macosx is not provided by port libxml2. DEBUG: Found port in ​file:///opt/local/var/macports/sources/rsync.macports.org/release/ports/textproc/libiconv DEBUG: Changing to port directory: /opt/local/var/macports/sources/rsync.macports.org/release/ports/textproc/libiconv DEBUG: Requested variant darwin is not provided by port libiconv. DEBUG: Requested variant i386 is not provided by port libiconv. DEBUG: Requested variant macosx is not provided by port libiconv. DEBUG: Searching for dependency: libiconv DEBUG: Found Dependency: receipt exists for libiconv DEBUG: Found port in ​file:///opt/local/var/macports/sources/rsync.macports.org/release/ports/archivers/zlib DEBUG: Changing to port directory: /opt/local/var/macports/sources/rsync.macports.org/release/ports/archivers/zlib DEBUG: Requested variant darwin is not provided by port zlib. DEBUG: Requested variant i386 is not provided by port zlib. DEBUG: Requested variant macosx is not provided by port zlib. DEBUG: Searching for dependency: zlib DEBUG: Found Dependency: receipt exists for zlib DEBUG: Executing org.macports.main (libxml2) ---> Fetching libxml2 DEBUG: Executing org.macports.fetch (libxml2) ---> libxml2-2.6.31.tar.gz doesn't seem to exist in /opt/local/var/macports/distfiles/libxml2 ---> Attempting to fetch libxml2-2.6.31.tar.gz from ​http://xmlsoft.org/sources/

% Total % Received % Xferd Average Speed Time Time Time Current

Dload Upload Total Spent Left Speed

100 4623k 100 4623k 0 0 303k 0 0:00:15 0:00:15 --:--:-- 319k ---> Verifying checksum(s) for libxml2 DEBUG: Executing org.macports.checksum (libxml2) ---> Checksumming libxml2-2.6.31.tar.gz Error: Checksum (md5) mismatch for libxml2-2.6.31.tar.gz Portfile checksum: libxml2-2.6.31.tar.gz md5 714b0683b1ec4bdc63bc356d729f9b18 Distfile checksum: libxml2-2.6.31.tar.gz md5 6c05a44b32c259c008746ff798a24472 Error: Checksum (sha1) mismatch for libxml2-2.6.31.tar.gz Portfile checksum: libxml2-2.6.31.tar.gz sha1 97233a210425bad96b35e52aa3e0010ac11bbcc9 Distfile checksum: libxml2-2.6.31.tar.gz sha1 68b2d90bd34a8dfeb891ae6b18715efe86efdcc5 Error: Checksum (rmd160) mismatch for libxml2-2.6.31.tar.gz Portfile checksum: libxml2-2.6.31.tar.gz rmd160 de231ec47f14ace35c29cf59d650a5611fd6128a Distfile checksum: libxml2-2.6.31.tar.gz rmd160 8d007b707a33de71cd51892edfcde52aaff399d3 Error: Target org.macports.checksum returned: Unable to verify file checksums Warning: the following items did not execute (for libxml2): org.macports.activate org.macports.extract org.macports.checksum org.macports.patch org.macports.configure org.macports.build org.macports.destroot org.macports.install Error: Status 1 encountered during processing.

[m.vissers@…]

The CHEKSUM error is gone, but now there is a new error. But this seems is a problem of the tar file:

Error: Target org.macports.extract returned: shell command " cd "/opt/local/var/macports/build/_opt_local_var_macports_sources_rsync.macports.org_release_ports_textproc_libxml2/work" && gzip -dc /opt/local/var/macports/distfiles/libxml2/libxml2-2.6.31.tar.gz | /usr/bin/gnutar --no-same-owner -xf - " returned error 2 Command output: /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header /usr/bin/gnutar: Skipping to next header

gzip: /opt/local/var/macports/distfiles/libxml2/libxml2-2.6.31.tar.gz: invalid compressed data--crc error

gzip: /opt/local/var/macports/distfiles/libxml2/libxml2-2.6.31.tar.gz: invalid compressed data--length error /usr/bin/gnutar: Read 10239 bytes from - /usr/bin/gnutar: Error exit delayed from previous errors

Error: Status 1 encountered during processing.

[raimue (Rainer Müller)]

CC'ing maintainer

[0xced (Cédric Luthi)]

Please try:

sudo port clean --all libxml2
sudo port install libxml2

[jmroot (Joshua Root)]

I found a copy of the tarball whose checksum matches, on another mirror (​ftp://gd.tuwien.ac.at/pub/libxml/). Its size is the same as the one on the xmlsoft site, but the hash is different. I'd guess that xmlsoft's copy has been corrupted somehow. This has actually happened before; see #14935, #13931, #13443.

[gweb@…]

No joy here. As of 2008/05/09 @ 4:35p PST.

Neither with the "port clean/port install" suggestion nor jmr's ​ftp://gd.tuwien.ac.at/pub/libxml/ hand-download suggestion. Why does this keep happening?

[adam@…]

Has there been any progress on this? I'm dead in the water untill I can get this resolved.

[gweb@…]

I just put an email into Cedric (the maintainer of this port). Hopefully he'll be able to provide some assistance.

[kumar.mcmillan@…]

fwiw, I edited my port file so that the first site in master_sites was ​ftp://gd.tuwien.ac.at/pub/libxml/ ... then I ran

sudo port clean --all libxml2
sudo port install libxml2

and it worked. Thanks jmr@…!

This allowed me to install the postgresql82 port, which seems to be working. However, trying to build the python lxml 2.0 module gives me these warnings:

$ export PATH=/opt/local/bin:${PATH}
$ sudo easy_install lxml-2.0.5.tgz
...
Building against libxml2/libxslt in the following directory: /opt/local/lib
ld: warning in /opt/local/lib/libxslt.dylib, file is not of required architecture
ld: warning in /opt/local/lib/libexslt.dylib, file is not of required architecture
ld: warning in /opt/local/lib/libxml2.dylib, file is not of required architecture
ld: warning in /opt/local/lib/libz.dylib, file is not of required architecture
ld: warning in /opt/local/lib/libxslt.dylib, file is not of required architecture
ld: warning in /opt/local/lib/libexslt.dylib, file is not of required architecture
ld: warning in /opt/local/lib/libxml2.dylib, file is not of required architecture
ld: warning in /opt/local/lib/libz.dylib, file is not of required architecture
ld: warning in /opt/local/lib/libxslt.dylib, file is not of required architecture
ld: warning in /opt/local/lib/libexslt.dylib, file is not of required architecture
ld: warning in /opt/local/lib/libxml2.dylib, file is not of required architecture
ld: warning in /opt/local/lib/libz.dylib, file is not of required architecture
Adding lxml 2.0.5 to easy-install.pth file

Installed /Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/lxml-2.0.5-py2.5-macosx-10.3-i386.egg
Processing dependencies for lxml==2.0.5
Finished processing dependencies for lxml==2.0.5

so .. it worked ok. But when I was on Tiger these errors resulted in the occasional Bus Error (Python segfault). Sigh. We'll see.

[kumar.mcmillan@…]

awwwww... sweet. I think this is working just fine. I had a unit test that was consistently segfaulting python on Tiger (after building lxml with these arch warnings), now the same test passes on Leopard with my new build of libxml2 + lxml. Also, file says :

$ file -L /opt/local/lib/libxslt.dylib
/opt/local/lib/libxslt.dylib: Mach-O dynamically linked shared library i386
$ file -L /opt/local/lib/libxslt.dylib
/opt/local/lib/libxslt.dylib: Mach-O dynamically linked shared library i386

cool.

[ryanfelton@…]

I am still getting the checksum errors even after preforming a clean and sync...

sudo port clean --work --dist --all libxml2 sudo port selfupdate sudo port sync

sudo port install libxml2 ---> Fetching libxml2 ---> Attempting to fetch libxml2-2.6.31.tar.gz from ​http://xmlsoft.org/sources/ ---> Verifying checksum(s) for libxml2 Error: Checksum (md5) mismatch for libxml2-2.6.31.tar.gz Error: Checksum (sha1) mismatch for libxml2-2.6.31.tar.gz Error: Checksum (rmd160) mismatch for libxml2-2.6.31.tar.gz Error: Target org.macports.checksum returned: Unable to verify file checksums Error: Status 1 encountered during processing.

[jmroot (Joshua Root)]

Replying to ryanfelton@gmail.com:

I am still getting the checksum errors even after preforming a clean and sync...

That's because the same corrupt file is just downloaded again. I'll move the xmlsoft server to the end of the mirror list as a quick fix, but it may be necessary to remove it altogether if it's going to keep being flaky. (An upcoming version of MacPorts will automatically select the fastest mirror, so then having the flaky mirror at the end of the list won't ensure it's tried last.)

[jmroot (Joshua Root)]

Mirror sites rearranged in r36663.

[bobbybshki@…]

jmr@… what do you mean "Mirror sites rearranged in r36663."? is this a fix for the problem? please explain, i'm new using darwin ports, so far it's been working well, but i've got this libxml2 problem also...

[jmroot (Joshua Root)]

Replying to bobbybshki@gmail.com:

what do you mean "Mirror sites rearranged in r36663."? is this a fix for the problem?

Read comment:11. (You can click through and view the changeset, too.) After you run sudo port sync, the file will be downloaded from a different, non-broken site. You'll probably also have to run sudo port clean --all libxml2 to get rid of the corrupt copy of the file that you've already downloaded, as Cedric suggested in comment:3.

[gweb@…]

Thanks Kumar, the workaround was fine. I was to the point where I was going to regenerate local hashes for the xmlsoft download (and not feel very good about it). Your solution is better. Curious that this did not work with a hand-download.

And thanks JMR for doing the commit that makes the server-order change permanent. But as you point out, if future versions of MacPorts choose a server at random then we'll be having this conversation again (and probably with more frustration as the problem will be less consistent). Any way to find out what the hell is going on over at xmlsoft that keeps breaking the hash?

[0xced (Cédric Luthi)]

Ticket #15261 should solve this issue for good.

[jmroot (Joshua Root)]

The libxml2 version has been incremented in r36716. The newer tarball should be OK. Feel free to reopen this ticket if the issue resurfaces.

[m.vissers@…]

It works now! Thanks. Id did the following today ( 13-5-200):

sudo port clean --all libxml2 sudo port sync sudo port install libxml2

[(none)]

Milestone Port Bugs deleted