libtasn1 @4.18.0: checksum mismatch

[jcburley (James Craig Burley)]

Getting this message repeatedly:

--->  Fetching archive for libtasn1
--->  Attempting to fetch libtasn1-4.18.0_0.darwin_20.x86_64.tbz2 from https://packages.macports.org/libtasn1
--->  Attempting to fetch libtasn1-4.18.0_0.darwin_20.x86_64.tbz2 from https://ywg.ca.packages.macports.org/mirror/macports/packages/libtasn1
--->  Attempting to fetch libtasn1-4.18.0_0.darwin_20.x86_64.tbz2 from https://ema.uk.packages.macports.org/libtasn1
--->  Verifying checksums for libtasn1
Error: Failed to checksum libtasn1: libtasn1-4.18.0.tar.gz does not exist in /opt/local/var/macports/distfiles/libtasn1
Error: See /opt/local/var/macports/logs/_opt_local_var_macports_sources_rsync.macports.org_macports_release_tarballs_ports_devel_libtasn1/libtasn1/main.log for details.

There's no _20 version of libtasn1 in one of the places I checked, but there is a _21 version. Not sure why that isn't working (even though I copied it, and the .rmd160 for it, into /opt/local/var/macports/libtasn1/.

[Schamschula (Marius Schamschula)]

I just upgraded libtasn1 on my M1 Big Sur machine to version 4.18.0. It did a clean build from source. No issue with the checksum.

[cjones051073 (Chris Jones)]

like wise, checksums and installs just fine here.

jcburley - please attach the complete log file from a clean build attempt, as I suspect the issue is something else.

[cjones051073 (Chris Jones)]

b.t.w. the '21' version refers to 'darwin_21', i.e. macOS12. That version is no use to you on darwin 20 (macOS11).

[jcburley (James Craig Burley)]

Log file showing the error.

[jcburley (James Craig Burley)]

Log file showing the new error.

[jcburley (James Craig Burley)]

Replying to cjones051073:

b.t.w. the '21' version refers to 'darwin_21', i.e. macOS12. That version is no use to you on darwin 20 (macOS11).

Ah, good to know, thanks!

[cjones051073 (Chris Jones)]

from your log

:info:checksum Portfile checksum: libtasn1-4.18.0.tar.gz size 1724441
53	:info:checksum Distfile checksum: libtasn1-4.18.0.tar.gz size 6471
54	:notice:checksum ***
55	:notice:checksum The non-matching file appears to be HTML. See this page for possible reasons
56	:notice:checksum for the checksum mismatch:
57	:notice:checksum <https://trac.macports.org/wiki/MisbehavingServers>
58	:notice:checksum ***
59	:notice:checksum The file has been moved to: /opt/local/var/macports/distfiles/libtasn1/libtasn1-4.18.0.tar.gz.html
60	:error:checksum Failed to checksum libtasn1: Unable to verify file checksums
61	:debug:checksum Error code: NONE

check the link referenced above, it lists a number of issues your end that could be causing your problems.

[jcburley (James Craig Burley)]

Hm, guess I somehow forgot to Submit my comment from a few minutes ago.

The libtasn1 install now works! The missing file is now back, with a timestamp of this morning.

Now there's a new issue, which might be unrelated:

--->  Fetching distfiles for gd2
--->  Attempting to fetch libgd-2.3.3.tar.xz from https://mse.uk.distfiles.macports.org/gd2
--->  Verifying checksums for gd2
Error: Checksum (rmd160) mismatch for libgd-2.3.3.tar.xz
Error: Checksum (sha256) mismatch for libgd-2.3.3.tar.xz
Error: Checksum (size) mismatch for libgd-2.3.3.tar.xz
***
The non-matching file appears to be HTML. See this page for possible reasons
for the checksum mismatch:
<https://trac.macports.org/wiki/MisbehavingServers>
***
The file has been moved to: /opt/local/var/macports/distfiles/gd2/libgd-2.3.3.tar.xz.html
Error: Failed to checksum gd2: Unable to verify file checksums
Error: See /opt/local/var/macports/logs/_opt_local_var_macports_sources_rsync.macports.org_macports_release_tarballs_ports_graphics_gd2/gd2/main.log for details.
Error: Follow https://guide.macports.org/#project.tickets if you believe there is a bug.
Error: Processing of port emacs-app failed
--->  Some of the ports you installed have notes:
  python39 has the following notes:
    To make this the default Python or Python 3 (i.e., the version run by the 'python' or 'python3' commands), run one or both of:

        sudo port select --set python python39
        sudo port select --set python3 python39

[cjones051073 (Chris Jones)]

Same issue. You have some sort of network issue your end. Check the track http link for possible causes.

[cjones051073 (Chris Jones)]

run

cat /opt/local/var/macports/distfiles/gd2/libgd-2.3.3.tar.xz.html

and post what you get

[jcburley (James Craig Burley)]

Replying to cjones051073:

from your log

:info:checksum Portfile checksum: libtasn1-4.18.0.tar.gz size 1724441
53	:info:checksum Distfile checksum: libtasn1-4.18.0.tar.gz size 6471
54	:notice:checksum ***
55	:notice:checksum The non-matching file appears to be HTML. See this page for possible reasons
56	:notice:checksum for the checksum mismatch:
57	:notice:checksum <https://trac.macports.org/wiki/MisbehavingServers>
58	:notice:checksum ***
59	:notice:checksum The file has been moved to: /opt/local/var/macports/distfiles/libtasn1/libtasn1-4.18.0.tar.gz.html
60	:error:checksum Failed to checksum libtasn1: Unable to verify file checksums
61	:debug:checksum Error code: NONE

check the link referenced above, it lists a number of issues your end that could be causing your problems.

That wouldn't surprise me, in that I previously had to block MacPorts from going to a mirror that is (for whatever reason) blocked by policy here at my firm, but in a way that wasn't easily detected by the installer.

The .html does show a "Site Blocked" page. So does the new one that I just ran into.

Using that saved .html, I was able to find another offending site, and added it to the block list (in macports.conf) just now; it's similar to the previous site name I added, mse.uk.distfiles.macports.org.

Guess I'm fighting some weird combination of arbitrarily blocked sites here at my firm, and somewhat-inscrutable diagnostics from MacPorts? Here's the latest:

--->  Fetching archive for gd2
--->  Attempting to fetch gd2-2.3.3_1+x11.darwin_20.x86_64.tbz2 from https://packages.macports.org/gd2
--->  Attempting to fetch gd2-2.3.3_1+x11.darwin_20.x86_64.tbz2 from https://ywg.ca.packages.macports.org/mirror/macports/packages/gd2
--->  Attempting to fetch gd2-2.3.3_1+x11.darwin_20.x86_64.tbz2 from https://ema.uk.packages.macports.org/gd2
--->  Verifying checksums for gd2
Error: Failed to checksum gd2: libgd-2.3.3.tar.xz does not exist in /opt/local/var/macports/distfiles/gd2
Error: See /opt/local/var/macports/logs/_opt_local_var_macports_sources_rsync.macports.org_macports_release_tarballs_ports_graphics_gd2/gd2/main.log for details.
Error: Follow https://guide.macports.org/#project.tickets if you believe there is a bug.
Error: Processing of port emacs-app failed

[jcburley (James Craig Burley)]

Replying to cjones051073:

run

cat /opt/local/var/macports/distfiles/gd2/libgd-2.3.3.tar.xz.html

and post what you get

I think I got past that problem (by adding another host to the blocklist); now the gd2 directory just seems to be empty on the mirror.

[jcburley (James Craig Burley)]

Replying to jcburley:

Replying to cjones051073:

run

cat /opt/local/var/macports/distfiles/gd2/libgd-2.3.3.tar.xz.html

and post what you get

I think I got past that problem (by adding another host to the blocklist); now the gd2 directory just seems to be empty on the mirror.

E.g. https://ema.uk.packages.macports.org/gd2/ appears to be empty from here (but can't see evidence it's blocked by our policies here).

[cjones051073 (Chris Jones)]

yes, that one is empty here to. Note the primary source for the binary tarballs is also empty (​https://packages.macports.org/gd2) so this just means for whatever reason this particular port is not distributing binary install tarballs, which sometimes is the case.

[cjones051073 (Chris Jones)]

note the distfiles, which is what you need, are at a different location to the binary install tarballs.

[cjones051073 (Chris Jones)]

closing this ticket, as other than the OP's network configuration there is nothing here to fix on the macports side.

[jmroot (Joshua Root)]

This is a classic case of MisbehavingServers, specifically the third bullet point about proxies. If whatever is doing the blocking gave an error, MacPorts would handle it gracefully, but it's apparently giving a HTTP 200 response, i.e. it's saying "here's the resource you requested" and then sending something completely different.

[jcburley (James Craig Burley)]

Yeah, the blocking policy here seems to be pretty obnoxious/nonstandard (returning 200 instead of a 404).

But I think I've blocked the relevant sites so MacPorts doesn't try them, and will continue to do that as they present themselves.

What do you recommend as a workaround (if any) for the missing gd2 stuff?

[cjones051073 (Chris Jones)]

only the binary tarballs are missing, and they are missing for everyone. The port will then just build from source.

[jcburley (James Craig Burley)]

Replying to cjones051073:

only the binary tarballs are missing, and they are missing for everyone. The port will then just build from source.

Is there an "Easy" button for installing (say) emacs-app, such that missing components (like gd2) are built automatically from source?

[cjones051073 (Chris Jones)]

ports are automatically built from source when binary installs are not available. You don’t need to do anything specific.

[jcburley (James Craig Burley)]

Replying to cjones051073:

ports are automatically built from source when binary installs are not available. You don’t need to do anything specific.

Sorry to keep pestering you, but I must be really dense or missing something obvious then, because I don't see anything getting built from source:

% sudo port install gd2
--->  Computing dependencies for gd2
--->  Fetching archive for gd2
--->  Attempting to fetch gd2-2.3.3_1+x11.darwin_20.x86_64.tbz2 from https://packages.macports.org/gd2
--->  Attempting to fetch gd2-2.3.3_1+x11.darwin_20.x86_64.tbz2 from https://ywg.ca.packages.macports.org/mirror/macports/packages/gd2
--->  Attempting to fetch gd2-2.3.3_1+x11.darwin_20.x86_64.tbz2 from https://ema.uk.packages.macports.org/gd2
--->  Verifying checksums for gd2
Error: Failed to checksum gd2: libgd-2.3.3.tar.xz does not exist in /opt/local/var/macports/distfiles/gd2
Error: See /opt/local/var/macports/logs/_opt_local_var_macports_sources_rsync.macports.org_macports_release_tarballs_ports_graphics_gd2/gd2/main.log for details.
Error: Follow https://guide.macports.org/#project.tickets if you believe there is a bug.
Error: Processing of port gd2 failed
%

Is there some config setting I need to tweak, or option I need to pass, to get it to build from source?

<Wanting to insert the "Please explain this to me like I'm 5 years old" meme...>

[jcburley (James Craig Burley)]

I'm now trying the -s option to port, but first I had to figure out where I could get a copy of the tarball (with an {{.xz}} suffix, interestingly enough), otherwise the port install -s gd2 command would fail as above (no file found, but no attempt to fetch it from somewhere that I could see).

Perhaps an earlier attempt to fetch the source, which failed due to the false 200 response (before I blocked the host via macports.conf), was cached somewhere, so no further attempt would be made to fetch it? All that was required was a sudo curl -O <url> into the appropriate directory to get the above port command to claim to have worked.

The {{{port install emacs-app}}, having been retried, now claims to have worked.

But I have no idea where it got installed! It's not in my $PATH. Didn't see a message saying where it went, either; /usr/local/bin/emacs still points to the (tty-only) Brew version.

[jcburley (James Craig Burley)]

Okay, this yielded some results (two, after I discovered that port install emacs-mac-app -- note the new "mac-" component -- also works):

find /Applications/MacPorts/ -name emacs

Invoking the resulting bin/emacs directly doesn't work (I might have a script for that on one of my other MacBooks), but the Apps themselves are in Applications/MacPorts/, and seem to work just fine.

Thanks for being patient!