Opened 6 months ago

Last modified 10 days ago

#71709 reopened defect

ports: migrate away from jfrog.io: boost169 boost171 boost176 boost178 boost181 boost187 py-torchaudio groovy

Reported by: barracuda156 Owned by: mascguy (Christopher Nielsen)
Priority: Normal Milestone:
Component: ports Version: 2.10.5
Keywords: Cc: MarcusCalhoun-Lopez (Marcus Calhoun-Lopez), w0met, michaelld (Michael Dickens), cooljeanius (Eric Gallager), BjarneDMat
Port: boost169 boost171 boost176 boost178 boost181 boost187 py-torchaudio groovy

Description

Sergey-Fedorovs-Mac:libtool-2.5.3 svacchanda\$ sudo port clean --all boost178
--->  Cleaning boost178
Sergey-Fedorovs-Mac:libtool-2.5.3 svacchanda\$ sudo port -v -N install boost178
--->  Computing dependencies for boost178.
--->  Fetching distfiles for boost178
--->  boost_1_78_0.tar.bz2 does not exist in /opt/local/var/macports/distfiles/boost178
--->  Attempting to fetch boost_1_78_0.tar.bz2 from https://boostorg.jfrog.io/artifactory/main/release/1.78.0/source/
2025-01-02 03:16:00.873 tclsh8.6[36707:c07] CFPreferences: user home directory at file://localhost/opt/local/var/macports/home/ is unavailable. User domains will be volatile.
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   138  100   138    0     0    167      0 --:--:-- --:--:-- --:--:--   167
100 11534  100 11534    0     0   6269      0  0:00:01  0:00:01 --:--:-- 14204
--->  Verifying checksums for boost178
--->  Checksumming boost_1_78_0.tar.bz2
Error: Checksum (rmd160) mismatch for boost_1_78_0.tar.bz2
Portfile checksum: boost_1_78_0.tar.bz2 rmd160 cdab0f7aedffdfe93c0aac268c1817bd4cb10645
Distfile checksum: boost_1_78_0.tar.bz2 rmd160 be35082fdc6fd2713959bc93f0f3cedd1779a0ce
Error: Checksum (sha256) mismatch for boost_1_78_0.tar.bz2
Portfile checksum: boost_1_78_0.tar.bz2 sha256 8681f175d4bdb26c52222665793eef08490d7758529330f98d3b29dd0735bccc
Distfile checksum: boost_1_78_0.tar.bz2 sha256 79e6d3f986444e5a80afbeccdaf2d1c1cf964baa8d766d20859d653a16c39848
Error: Checksum (size) mismatch for boost_1_78_0.tar.bz2
Portfile checksum: boost_1_78_0.tar.bz2 size 110675550
Distfile checksum: boost_1_78_0.tar.bz2 size 11534
***
The non-matching file appears to be HTML. See this page for possible reasons
for the checksum mismatch:
<https://trac.macports.org/wiki/MisbehavingServers>
***
The file has been moved to: /opt/local/var/macports/distfiles/boost178/boost_1_78_0.tar.bz2.html
Error: Failed to checksum boost178: Unable to verify file checksums
Error: See /opt/local/var/macports/logs/_opt_local_var_macports_sources_rsync.macports.org_macports_release_tarballs_ports_devel_boost178/boost178/main.log for details.
Error: Follow https://guide.macports.org/#project.tickets if you believe there
is a bug.

Change History (13)

comment:1 Changed 6 months ago by ryandesign (Ryan Carsten Schmidt)

Cc: mascguy MarcusCalhoun-Lopez added
Owner: set to michaelld
Port: boost169 boost171 boost176 boost181 boost187 py-torchaudio added
Status: newassigned
Summary: boost178: checksum mismatchboost169 boost171 boost176 boost178 boost181 boost187 py-torchaudio: checksum mismatch

If I visit the download URL in a browser I get redirected to a page that says:

Time flies when you’re having fun.

Your 14-day trial may be over, but you have options!

Need help choosing the right subscription or additional time on your trial? Just let us know and a DevOps expert will reach out to assist you.

I guess the boostorg.jfrog.io URLs should be removed from all the ports in which they appear.

comment:2 Changed 6 months ago by ryandesign (Ryan Carsten Schmidt)

Here is a discussion from one year ago when their jfrog account was suspended, then reinstated:

In the new archive, all on one page: https://lists.preview.boost.org/archives/list/boost@lists.preview.boost.org/thread/6FKCEHF5NRCXIF6S7KJTRY7R3DRDDGJO/

In the old archive, one page per message: https://lists.boost.org/Archives/boost//2024/01/255654.php


Here is the announcement from May 2024 that the boost downloads would leave the jfrog service in December 2024 and that downloads are now at archives.boost.io:

New archive: https://lists.preview.boost.org/archives/list/boost@lists.preview.boost.org/thread/OALSRZIRNKIDEMUITUAUWCJRJUXPEZID/

Old archive: https://lists.boost.org/Archives/boost//2024/05/256914.php

comment:3 Changed 5 months ago by mouse07410 (Mouse)

I have the same problem - cannot download boost187 sources, failing checksum.

$ sudo port install boost187
--->  Computing dependencies for boost187
--->  Fetching archive for boost187
--->  Attempting to fetch boost187-1.87.0_0+no_single+no_static+python312.darwin_24.arm64.tbz2 from https://packages.macports.org/boost187
--->  Attempting to fetch boost187-1.87.0_0+no_single+no_static+python312.darwin_24.arm64.tbz2 from https://nue.de.packages.macports.org/boost187
--->  Attempting to fetch boost187-1.87.0_0+no_single+no_static+python312.darwin_24.arm64.tbz2 from http://mirror.fcix.net/macports/packages/boost187
--->  Fetching distfiles for boost187
--->  Attempting to fetch boost_1_87_0.tar.bz2 from https://boostorg.jfrog.io/artifactory/main/release/1.87.0/source/
--->  Verifying checksums for boost187
Error: Checksum (rmd160) mismatch for boost_1_87_0.tar.bz2
Error: Checksum (sha256) mismatch for boost_1_87_0.tar.bz2
Error: Checksum (size) mismatch for boost_1_87_0.tar.bz2
***
The non-matching file appears to be HTML. See this page for possible reasons
for the checksum mismatch:
<https://trac.macports.org/wiki/MisbehavingServers>
***
The file has been moved to: /opt/local/var/macports/distfiles/boost187/boost_1_87_0.tar.bz2.html
Error: Failed to checksum boost187: Unable to verify file checksums
Error: See /opt/local/var/macports/logs/_opt_local_var_macports_sources_rsync.macports.org_macports_release_tarballs_ports_devel_boost187/boost187/main.log for details.
Error: Follow https://guide.macports.org/#project.tickets if you believe there is a bug.
Error: Processing of port boost187 failed
$

and the main.log has

info:archivefetch --->  boost187-1.87.0_0+no_single+no_static+python312.darwin_24.arm64.tbz2 doesn't seem to exist in /opt/local/var/macports/incoming/verified
:msg:archivefetch --->  Attempting to fetch boost187-1.87.0_0+no_single+no_static+python312.darwin_24.arm64.tbz2 from https://packages.macports.org/boost187
:debug:archivefetch Fetching archive failed: The requested URL returned error: 404
:msg:archivefetch --->  Attempting to fetch boost187-1.87.0_0+no_single+no_static+python312.darwin_24.arm64.tbz2 from https://nue.de.packages.macports.org/boost187
:debug:archivefetch Fetching archive failed: The requested URL returned error: 404
:msg:archivefetch --->  Attempting to fetch boost187-1.87.0_0+no_single+no_static+python312.darwin_24.arm64.tbz2 from http://mirror.fcix.net/macports/packages/boost187
:debug:archivefetch Fetching archive failed: The requested URL returned error: 404
:debug:archivefetch Privilege de-escalation not attempted as not running as root.
:debug:fetch fetch phase started at Tue Jan 14 20:02:56 EST 2025
:notice:fetch --->  Fetching distfiles for boost187
:debug:fetch Executing proc-pre-org.macports.fetch-fetch-0
:debug:fetch Executing proc-pre-org.macports.fetch-fetch-1
:debug:fetch mpi.enforce_variant list: 
:debug:fetch Executing org.macports.fetch (boost187)
:info:fetch --->  boost_1_87_0.tar.bz2 does not exist in /opt/local/var/macports/distfiles/boost187
:notice:fetch --->  Attempting to fetch boost_1_87_0.tar.bz2 from https://boostorg.jfrog.io/artifactory/main/release/1.87.0/source/
:debug:fetch Privilege de-escalation not attempted as not running as root.
:debug:checksum checksum phase started at Tue Jan 14 20:03:00 EST 2025
:notice:checksum --->  Verifying checksums for boost187
:debug:checksum Executing org.macports.checksum (boost187)
:info:checksum --->  Checksumming boost_1_87_0.tar.bz2
:debug:checksum Calculated (rmd160) is be35082fdc6fd2713959bc93f0f3cedd1779a0ce
:error:checksum Checksum (rmd160) mismatch for boost_1_87_0.tar.bz2
:info:checksum Portfile checksum: boost_1_87_0.tar.bz2 rmd160 f7fc065a57b0daee8cdae3befd7de0ec2799d99b
:info:checksum Distfile checksum: boost_1_87_0.tar.bz2 rmd160 be35082fdc6fd2713959bc93f0f3cedd1779a0ce
:debug:checksum Calculated (sha256) is 79e6d3f986444e5a80afbeccdaf2d1c1cf964baa8d766d20859d653a16c39848
:error:checksum Checksum (sha256) mismatch for boost_1_87_0.tar.bz2
:info:checksum Portfile checksum: boost_1_87_0.tar.bz2 sha256 af57be25cb4c4f4b413ed692fe378affb4352ea50fbe294a11ef548f4d527d89
:info:checksum Distfile checksum: boost_1_87_0.tar.bz2 sha256 79e6d3f986444e5a80afbeccdaf2d1c1cf964baa8d766d20859d653a16c39848
:debug:checksum Calculated (size) is 11534
:error:checksum Checksum (size) mismatch for boost_1_87_0.tar.bz2
:info:checksum Portfile checksum: boost_1_87_0.tar.bz2 size 131473200
:info:checksum Distfile checksum: boost_1_87_0.tar.bz2 size 11534
:notice:checksum ***
:notice:checksum The non-matching file appears to be HTML. See this page for possible reasons
:notice:checksum for the checksum mismatch:
:notice:checksum <https://trac.macports.org/wiki/MisbehavingServers>
:notice:checksum ***
:notice:checksum The file has been moved to: /opt/local/var/macports/distfiles/boost187/boost_1_87_0.tar.bz2.html
:error:checksum Failed to checksum boost187: Unable to verify file checksums
:debug:checksum Error code: NONE
:debug:checksum Backtrace: Unable to verify file checksums
:debug:checksum     while executing
:debug:checksum "$procedure $targetname"
:error:checksum See /opt/local/var/macports/logs/_opt_local_var_macports_sources_rsync.macports.org_macports_release_tarballs_ports_devel_boost187/boost187/main.log for details.

Is there any reason why Macports scripts cannot switch from jfrog, which apparently doesn't work too good anymore? And start retrieving Boost (and other packages) from the new location?

comment:4 Changed 5 months ago by barracuda156

Two weeks with broken Boost and counting...

comment:5 Changed 5 months ago by ryandesign (Ryan Carsten Schmidt)

Boost isn't broken, it's just having trouble fetching the right files. You can always fetch the right files manually; see ProblemHotlist#fetch-failures. You can also submit a pull request to fix the problem in the way described earlier in this ticket.

comment:6 in reply to:  5 Changed 5 months ago by barracuda156

Replying to ryandesign:

Boost isn't broken, it's just having trouble fetching the right files. You can always fetch the right files manually; see ProblemHotlist#fetch-failures. You can also submit a pull request to fix the problem in the way described earlier in this ticket.

Well, obviously I can (and did) solve this for myself, but this is an issue potentially affecting a lot of users, so it is a bit surprising it keeps being neglected.

comment:7 Changed 5 months ago by mouse07410 (Mouse)

Here's what I did:

  1. Downloaded https://archives.boost.io/release/1.87.0/source/boost_1_87_0.tar.bz2 and placed it into /opt/local/var/macports/distfiles/boost187
  2. Went to /opt/local/var/macports/sources/rsync.macports.org/macports/release/tarballs/ports/devel/boost187 and sudo port edit boost187 (unnecesary to change directory? Mere sudo port edit boost187 should suffice?)
  3. Changed the "size" and "sha256 checksum" to the correct values, as the existing Portfile values did not match.
  4. sudo port install boost187 now worked successfully.

comment:8 Changed 5 months ago by reneeotten (Renee Otten)

Cc: w0met added

comment:9 Changed 5 months ago by mascguy (Christopher Nielsen)

Cc: michaelld added; mascguy removed
Owner: changed from michaelld to mascguy

comment:10 Changed 5 months ago by Christopher Nielsen <mascguy@…>

Resolution: fixed
Status: assignedclosed

In fede7ffb198aec37400969476f1fc917abd824f5/macports-ports (master):

boost*: migrate to archives.boost.io

Fixes: #71709

comment:11 Changed 5 months ago by mascguy (Christopher Nielsen)

Port: groovy added
Resolution: fixed
Status: closedreopened
Summary: boost169 boost171 boost176 boost178 boost181 boost187 py-torchaudio: checksum mismatchports: migrate away from jfrog.io: boost169 boost171 boost176 boost178 boost181 boost187 py-torchaudio groovy

I'll also fix the two remaining ports, py-torchaudio and groovy

comment:12 Changed 4 weeks ago by cooljeanius (Eric Gallager)

Cc: cooljeanius added

comment:13 Changed 10 days ago by BjarneDMat

Cc: BjarneDMat added
Note: See TracTickets for help on using tickets.