Guile-2.0.13 fails to build on Sierra

[mouse07410 (Mouse)]

MacOS Sierra. Guile-2.0.12 was installed as a dependency of autogen. Now "port upgrade outdated" fails to upgrade Guile:

. . . . .
:info:build Making all in module
:info:build make[2]: Entering directory `/opt/local/var/macports/build/_opt_local_var_macports_sources_rsync.macports.org_release_tarballs_ports_lang_guile/guile/work/guile-2.0.13/module'
:info:build GUILE_INSTALL_LOCALE=1 GUILE_AUTO_COMPILE=0 \
:info:build     ../meta/build-env                               \
:info:build     guild compile --target="x86_64-apple-darwin16" -Wunbound-variable -Warity-mismatch -Wformat     \
:info:build       -L "/opt/local/var/macports/build/_opt_local_var_macports_sources_rsync.macports.org_release_tarballs_ports_lang_guile/guile/work/guile-2.0.13/module" -L "/opt/local/var/macports/build/_opt_local_var_macports_sources_rsync.macports.org_release_tarballs_ports_lang_guile/guile/work/guile-2.0.13/module"         \
:info:build       -L "/opt/local/var/macports/build/_opt_local_var_macports_sources_rsync.macports.org_release_tarballs_ports_lang_guile/guile/work/guile-2.0.13/guile-readline"                        \
:info:build       -o "ice-9/eval.go" "ice-9/eval.scm"
:info:build Backtrace:
:info:build In unknown file:
:info:build    ?: 3 [apply-smob/1 #<boot-closure 11011fb00 (_ _ _)> #t ...]
:info:build    ?: 2 [apply-smob/1 #<catch-closure 1102b3680>]
:info:build    ?: 1 [primitive-eval ((@ # %) (begin # # #))]
:info:build    ?: 0 [mkstemp! "ice-9/eval.go.XXXXXX" "wb"]
:info:build 
:info:build ERROR: make[2]: *** [ice-9/eval.go] Error 1
:info:build make[2]: Leaving directory `/opt/local/var/macports/build/_opt_local_var_macports_sources_rsync.macports.org_release_tarballs_ports_lang_guile/guile/work/guile-2.0.13/module'
. . . . .

[mouse07410 (Mouse)]

Complete build log

[Schamschula (Marius Schamschula)]

Cc Me!

[howarth.at.macports@…]

A related issue to watch out for is that even on 10.11, when the test commands from Ticket #52556 are added, the resulting build fails three additional tests not seen in 2.0.12 on darwin...

ERROR: 00-repl-server.test: repl-server: simple expression - arguments: ((system-error "fport_fill_input" "~A" ("Socket is not connected") (57)))
ERROR: 00-repl-server.test: repl-server: HTTP inter-protocol attack - arguments: ((system-error "fport_fill_input" "~A" ("Socket is not connected") (57)))
FAIL: check-grille

Note that passing ac_cv_have_thread_storage_class=no to configure when building guile 2.0.12 produces clean test suite results.

[todmorrison (Tod Morrison)]

Cc Me!

[mwette]

Cc Me!

[MarcusCalhoun-Lopez (Marcus Calhoun-Lopez)]

Cc Me!

[mouse07410 (Mouse)]

I have a request to make. The current guile-2.0.13 is broken, both the Macports port and the upstream (on Sierra at least).

Can you please, pretty-please make port of guile-2.0.12 available (again)? That one works, and seems fine (at least for me) on both Sierra and El Capitan. That would allow me to install and use other ports that depend on guile, while you're working on this problem.

Thanks!

[ken-cunningham-webuse]

You can do this for any port you like, whenever you like.

wiki:howto/InstallingOlderPort

first find it

$ port info guile
guile @2.0.13 (lang)

then go to the svn repo

browser:trunk/dports/lang/guile

click on 'revision log' (top right )

select any revision you want ( goes back 14 years)

note the revision number, e.g. 151758

and check it out

$ svn checkout -r 151758 https://svn.macports.org/repository/macports/trunk/dports/lang/guile

go into the directory where you downloaded that info

and build it

sudo port install

you are done.

add it to your own local rep and it'll never ask to be updated again.

[ken-cunningham-webuse]

no doubt these instructions will change someday for git, but this works for ports from the past 14 years.

[mouse07410 (Mouse)]

Thank you for the recipe - I'll write it down (useful for this and other ports as well).

The main/only reason I need guile is because I need autogen port, and it depends on guile.

Since guile-2.0.13 is broken (on Sierra for sure), and the fix does not seem to be forthcoming - could you possibly retract 2.0.13 and revert the "standard" current port to 2.0.12 (which, as I said, works fine on El Capitan and Sierra)?

It is a small inconvenience to be unable to say sudo port upgrade outdated, and having to manually upgrade every (working) port because guile sticks new the top and breaks the automatic process. But it is an inconvenience nonetheless.

I can't imagine anybody needing 2.0.13 because it simply does not work. 2.0.12 does - why not stay at that version until you figure out how to fix 2.0.13 (probably having upstream people involved)?

[mwette]

I found that Guile will not build with /usr/bin/clang on El Capitan by downloading the guile-2.0.13 tarball from gnu.org and sucessfully building with /opt/local/bin/gcc-mp-4 and failing with /usr/bin/clang.

I then got guile-2.0.13 to build under macports by

1. creating my own ports directory /path/to/ports
2. adding ​file:///path/to/ports before the rsync line in /opt/local/etc/macports/source.conf
3. grabbing Portfile and files/sierra.patch from github.com
4. adding CC="${prefix}/bin/gcc-mp-4" to configargs entry
5. running portindex in /path/to/ports
6. port clean --all guile
7. port upgrade guile

Now trying on Sierra at home.

[Schamschula (Marius Schamschula)]

FYI: I did report this issue upstream:

​https://debbugs.gnu.org/cgi/bugreport.cgi?bug=24862

[mwette]

Not working on Sierra. Dies trying to build ice-9/eval.go. I will look into it later.

[mouse07410 (Mouse)]

Yes, the above matched my experience 100%.

[mwette]

I am building guile-2.0.13 standalone using --prefix=/opt/local. It fails as in the macports build. I can recreate the fail with traceback from mkstemp!. Also, have to use /usr/bin/lldb as using /opt/local/bin/ggdb on Sierra is going to be very non-straightforward.

[mwette]

I am still testing but I think I have found a fix. Here is a patch:

*** libguile/filesys.c-orig     2016-11-05 07:49:09.000000000 -0700
--- libguile/filesys.c  2016-11-10 05:38:53.000000000 -0800
***************
*** 1486,1491 ****
--- 1486,1494 ----
        mode_bits = scm_i_mode_bits (mode);
      }
  
+ #ifdef __APPLE__
+   open_flags &= O_APPEND|O_SHLOCK|O_EXLOCK|O_CLOEXEC;
+ #endif
    SCM_SYSCALL (rv = mkostemp (c_tmpl, open_flags));
    if (rv == -1)
      SCM_SYSERROR;

[mouse07410 (Mouse)]

Your patch makes things much better, and the build can progress much farther with it - but it doesn't resolve all the problems: build still aborts with an error. See the attached guile-build-log.txt that shows what happens with your patch (and sierra.patch).

[mwette]

Could you try with compiler that is not /usr/bin/clang? I had issues on another machine (El Capitan?) with /usr/bin/clang and was able to get guile to build with /opt/local/bin/gcc-mp-6. $ CC=/opt/local/bin/gcc-mp-5 ./configure ...

[mouse07410 (Mouse)]

I tried with /usr/bin/clang, and with /opt/local/bin/clang...

Will try gcc6 and report.

[mouse07410 (Mouse)]

First build (with Xcode clang) was from scratch, on the freshly untarred dir. Second one with Macports clang-3.9 - I confess I did not do distclean...

Will make sure I'll make distclean before trying Macports gcc6.

[mwette]

I verified for myself that 2.0.13 will build with /usr/bin/clang on Sierra, with the two patches.

I also named the above patch to mksfifo.patch, added it to the files/ subdir of my guile port, updated the Portfile by adding mksfifo.patch to the patchfiles command, and saw "port upgrade outdated" complete perform a successful guile of guile-2.0.13 on Sierra.

mwette$ diff ,old/Portfile-2.0.13 Portfile 
62c62
< patchfiles          sierra.patch
---
> patchfiles          sierra.patch mksfifo.patch

[mwette]

I have attached proposed files/mksfifo.patch and a patch for the Portfile.

[mf2k (Frank Schima)]

Thanks. ​Per the guidelines, please instead attach the patches as unified diffs.

[mwette]

files/mksfifo.patch

[mwette]

Portfile.patch

[mwette]

Portfile.patch

[mwette]

Uploaded "diff -u" version of mksfifo.patch and Portfile.patch (also Portfile.diff, oops).

[fhgwright (Fred Wright)]

FYI - it's been broken for a while on Mavericks as well. The last version successfully installed was 2.0.11_3. Assuming it's the same problem, it's not worth attaching another logfile.

[favadi (Diep Pham)]

I confirm that the problem still happens with macports 2.3.5 on macOS Sierra. Should we merged @mwette's patches? Or those patches should be recreated as a Github PR?

[ryandesign (Ryan Carsten Schmidt)]

Ideally, the developers of guile would fix their software and release a new version of it, then MacPorts will update to that version. Perhaps someone could ask the developers of guile how close they are to doing that.

[eddieh (Eddie Hillenbrand)]

Replying to ken-cunningham-webuse:

You can do this for any port you like, whenever you like.

wiki:howto/InstallingOlderPort

first find it

$ port info guile
guile @2.0.13 (lang)

then go to the svn repo

browser:trunk/dports/lang/guile

click on 'revision log' (top right )

select any revision you want ( goes back 14 years)

note the revision number, e.g. 151758

and check it out

$ svn checkout -r 151758 https://svn.macports.org/repository/macports/trunk/dports/lang/guile

go into the directory where you downloaded that info

and build it

sudo port install

you are done.

add it to your own local rep and it'll never ask to be updated again.

Unfortunately, this failed to build as well. On 10.12.1 (16B2657).

[neverpanic (Clemens Lang)]

The problem with mkostemp failing on Sierra happens because Sierra introduces a mkostemp(3) function in unistd.h. This causes libguile to prefer this implementation over its GNUlib implementation, which is has previously shipped.

mkostemp(3) does not accept flags other than O_APPEND, O_SHLOCK, O_EXLOCK and O_CLOEXEC, according to the mktemp(3) manpage. libguile's ​libguile/filesys.c, however, passes O_WRONLY | O_CREAT | O_TRUNC to it.

These flags are passed because in libguile/filesys.c, in s_scm_i_mkstemp, SCM_UNBNDP (mode) is false and the block that converts the given string argument of "wb" into the corresponding flags using scm_i_mode_to_open_flags() as defined in libguile/fports.c returns O_WRONLY | O_CREAT | O_TRUNC. Opening a file with a random name in read-only mode is pretty pointless, of course, so I'm not sure why that's even an option (and GNUlib's implementation of mkostemp ignores O_WRONLY and adds O_RDWR).

The patch posted in the upstream ticket is correct. I'm committing a fix soon.

[neverpanic (Clemens Lang)]

In 8b7f401/macports-ports:

guile: Fix build on Sierra

macOS Sierra introduces a mkostemp(3) function which is used when
present. Contrary to the GNUlib version of mkostemp(3) that was used
previously, this version fails with 'invalid argument' when flags other
than from a specified set are passed. From mktemp(3):

| The mkostemp() function is like mkstemp() but allows specifying
| additional open(2) flags (defined in <fcntl.h>). The permitted flags
| are O_APPEND, O_SHLOCK, O_EXLOCK and O_CLOEXEC.

Apply a patch that avoids unsupported flags to fix this problem.

Closes: #52613

[neverpanic (Clemens Lang)]

In 8b7f401/macports-ports:

guile: Fix build on Sierra

macOS Sierra introduces a mkostemp(3) function which is used when
present. Contrary to the GNUlib version of mkostemp(3) that was used
previously, this version fails with 'invalid argument' when flags other
than from a specified set are passed. From mktemp(3):

| The mkostemp() function is like mkstemp() but allows specifying
| additional open(2) flags (defined in <fcntl.h>). The permitted flags
| are O_APPEND, O_SHLOCK, O_EXLOCK and O_CLOEXEC.

Apply a patch that avoids unsupported flags to fix this problem.

Closes: #52613