python311 @3.11.0 +lto +optimizations fails to build with broken symlink in include path

[bakergilx (Dennis Baker)]

Installation of python311 on OS 13.0.1, Arm64 architecture, Xcode 14.1, generates the following configure warning:

Warning: Configuration logfiles contain indications of -Wimplicit-function-declaration; check that features were not accidentally disabled:
  dbm_open: found in Python-3.11.0/config.log,
  getrandom: found in Python-3.11.0/config.log,
  le64toh: found in Python-3.11.0/config.log

In addition, the port failed to build with the following error message:

Error: Failed to build python311: command execution failed
Error: See /opt/local/var/macports/logs/_opt_local_var_macports_sources_rsync.macports.org_macports_release_tarballs_ports_lang_python311/python311/main.log for details.
Error: Follow https://guide.macports.org/#project.tickets if you believe there is a bug.
Error: Processing of port python311 failed

config.log and build.log attached

[bakergilx (Dennis Baker)]

main.log for python311

[bakergilx (Dennis Baker)]

config.log for python311

[jmroot (Joshua Root)]

:info:build error: [Errno 2] No such file or directory: '/opt/local/include/proj_api.h'

Unfortunately there's no indication in the logs of what is trying to include this header. It would be provided by the various versions of proj, but none of those should be required by python. Would you be able to find out what is referencing this either in the python build dir or the installed files of python311's dependencies?

[kencu (Ken)]

current python311 does install on arm Ventura:

% port -v installed python311
The following ports are currently installed:
  python311 @3.11.1_0+lto+optimizations (active) requested_variants='' platform='darwin 22' archs='arm64' date='2022-12-25T21:37:07-0800'

I don't have any version of proj installed, however.

[jmroot (Joshua Root)]

Is /opt/local/include/proj_api.h a broken symlink on your system, by any chance?

[jmroot (Joshua Root)]

​https://github.com/python/cpython/issues/101778

[jmroot (Joshua Root)]

Has duplicate #66889. Deleting the broken symlinks in the include directory is an effective workaround.

[chillin-]

python310 main.log

[chillin-]

python310 was failing to build on Mountain Lion, but succeeded today. python310 still failing to build on Mojave.

[JDLH (Jim DeLaHunt)]

Has similar or duplicate report #66892. That report mentions the error I saw, which is:

:info:build error: [Errno 2] No such file or directory: '/opt/local/include/lapacke_utils.h'

The proximate problem seems to be that the python310 compilation refers to a broken symlink to a library:

% ls -l /opt/local/include/lapacke_utils.h /opt/local/include/cblas/lapacke_utils.h
ls: /opt/local/include/cblas/lapacke_utils.h: No such file or directory
lrwxr-xr-x  1 root  wheel  21  4 Feb 15:55 /opt/local/include/lapacke_utils.h -> cblas/lapacke_utils.h

It looks like the port OpenBLAS supplies the broken link:

% port installed \*blas
The following ports are currently installed:
  OpenBLAS @0.3.21_2+gcc12+lapack+native (active)
% port contents OpenBLAS | grep lapack
  /opt/local/include/lapack.h
  /opt/local/include/lapacke.h
  /opt/local/include/lapacke_config.h
  /opt/local/include/lapacke_mangling.h
  /opt/local/include/lapacke_utils.h
  /opt/local/include/openblas/lapack.h
  /opt/local/include/openblas/lapacke.h
  /opt/local/include/openblas/lapacke_config.h
  /opt/local/include/openblas/lapacke_mangling.h
  /opt/local/include/openblas/lapacke_utils.h

I see no listing for a port cblas, but there is a port clblas. I do not have it installed.

[JDLH (Jim DeLaHunt)]

The underlying cause for the lapacke symlink error may be #66881 . There is a PR for that ticket. It is awaiting review. That ticket acknowledges that the problem blocks compilation of python310 and python311 ports.

[bakergilx (Dennis Baker)]

On my system (Ventura 13.2, Apple M1 Max, Xcode 14.2, MacPorts 2.8.1) OpenBlas is installed but the Symlinks that port created (I assume) are all incorrect. For example, the link lapack.h -> cblas/lapack.h should be lapack.h -> openblas/lapack.h (and so for all the others). I manually corrected each link and now both Python310 and Python311 build successfully.

[jmroot (Joshua Root)]

Yes, those specific broken symlinks are #66881, as mentioned in comment:11.

[jmroot (Joshua Root)]

In bb5475d62360fd200b5d79cdecc9e90eb9aca30e/macports-ports (master):

python311: fix dangling symlinks breaking the build

Closes: #66242

[jmroot (Joshua Root)]

In 32fa32f26eea92dbe86afb60a41ae671f11536b4/macports-ports (master):

python310: fix dangling symlinks breaking the build

Closes: #66242