Opened 18 months ago

Last modified 17 months ago

#66225 assigned defect

libzzip @0.13.67: Downloads things at build time which takes a long time

Reported by: ballapete (Peter "Pete" Dyballa) Owned by: mojca (Mojca Miklavec)
Priority: Normal Milestone:
Component: ports Version: 2.8.0
Keywords: leopard ppc Cc:
Port: libzzip

Description

It seems to be this test (?) step that takes hours:

make[2]: Entering directory `/opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build'
[ 76%] Creating directories for 'zziptestdownloads'
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test && /opt/local/bin/cmake -Dcfgdir= -P /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/tmp/zziptestdownloads-mkdirs.cmake
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test && /opt/local/bin/cmake -E touch /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/zziptestdownloads-stamp/zziptestdownloads-mkdir
[ 78%] Performing download step for 'zziptestdownloads'
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src && /opt/local/bin/python3.9 /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/zziplib-0.13.72/test/zziptests.py --downloadonly -vv
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Fasarubbo%2Fpoc%2Fblob%2Fmaster/00150-zziplib-heapoverflow-__zzip_get32
INFO:test:curl https://github.com/asarubbo/poc/raw/master/00150-zziplib-heapoverflow-__zzip_get32
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Fasarubbo%2Fpoc%2Fblob%2Fmaster/00151-zziplib-heapoverflow-__zzip_get64
INFO:test:curl https://github.com/asarubbo/poc/raw/master/00151-zziplib-heapoverflow-__zzip_get64
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Fasarubbo%2Fpoc%2Fblob%2Fmaster/00152-zziplib-heapoverflow-zzip_mem_entry_extra_block
INFO:test:curl https://github.com/asarubbo/poc/raw/master/00152-zziplib-heapoverflow-zzip_mem_entry_extra_block
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Fasarubbo%2Fpoc%2Fblob%2Fmaster/00153-zziplib-invalidread-zzip_mem_entry_extra_block
INFO:test:curl https://github.com/asarubbo/poc/raw/master/00153-zziplib-invalidread-zzip_mem_entry_extra_block
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Fasarubbo%2Fpoc%2Fblob%2Fmaster/00156-zziplib-oobread-zzip_mem_entry_new
INFO:test:curl https://github.com/asarubbo/poc/raw/master/00156-zziplib-oobread-zzip_mem_entry_new
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Fasarubbo%2Fpoc%2Fblob%2Fmaster/00157-zziplib-nullptr-prescan_entry
INFO:test:curl https://github.com/asarubbo/poc/raw/master/00157-zziplib-nullptr-prescan_entry
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Fasarubbo%2Fpoc%2Fblob%2Fmaster/00154-zziplib-nullptr-zzip_mem_entry_new
INFO:test:curl https://github.com/asarubbo/poc/raw/master/00154-zziplib-nullptr-zzip_mem_entry_new
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Fasarubbo%2Fpoc%2Fblob%2Fmaster/00161-zziplib-assertionfailure-seeko_C
INFO:test:curl https://github.com/asarubbo/poc/raw/master/00161-zziplib-assertionfailure-seeko_C
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2FProbeFuzzer%2Fpoc%2Fblob%2Fmaster%2Fzziplib/zziplib_0-13-67_zzdir_invalid-memory-access_main.zip
INFO:test:curl https://github.com/ProbeFuzzer/poc/raw/master/zziplib/zziplib_0-13-67_zzdir_invalid-memory-access_main.zip
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2FProbeFuzzer%2Fpoc%2Fblob%2Fmaster%2Fzziplib/zziplib_0-13-67_unzzip_infinite-loop_unzzip_cat_file.zip
INFO:test:curl https://github.com/ProbeFuzzer/poc/raw/master/zziplib/zziplib_0-13-67_unzzip_infinite-loop_unzzip_cat_file.zip
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2FProbeFuzzer%2Fpoc%2Fblob%2Fmaster%2Fzziplib/zziplib_0-13-67_unzip-mem_buffer-access-with-incorrect-length-value_zzip_disk_fread.zip
INFO:test:curl https://github.com/ProbeFuzzer/poc/raw/master/zziplib/zziplib_0-13-67_unzip-mem_buffer-access-with-incorrect-length-value_zzip_disk_fread.zip
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2FProbeFuzzer%2Fpoc%2Fblob%2Fmaster%2Fzziplib/zziplib_0-13-67_zzdir_memory-alignment-errors___zzip_fetch_disk_trailer.zip
INFO:test:curl https://github.com/ProbeFuzzer/poc/raw/master/zziplib/zziplib_0-13-67_zzdir_memory-alignment-errors___zzip_fetch_disk_trailer.zip
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2FProbeFuzzer%2Fpoc%2Fblob%2Fmaster%2Fzziplib/zziplib_0-13-67_unzip-mem_memory-alignment-errors_zzip_disk_findfirst.zip
INFO:test:curl https://github.com/ProbeFuzzer/poc/raw/master/zziplib/zziplib_0-13-67_unzip-mem_memory-alignment-errors_zzip_disk_findfirst.zip
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2FProbeFuzzer%2Fpoc%2Fblob%2Fmaster%2Fzziplib/zziplib_0-13-67_unzzip_memory-aligment-errors___zzip_fetch_disk_trailer.zip
INFO:test:curl https://github.com/ProbeFuzzer/poc/raw/master/zziplib/zziplib_0-13-67_unzzip_memory-aligment-errors___zzip_fetch_disk_trailer.zip
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2FProbeFuzzer%2Fpoc%2Fblob%2Fmaster%2Fzziplib/zziplib_0-13-67_unzip-mem_memory-alignment-errors_zzip_disk_findfirst_64.zip
INFO:test:curl https://github.com/ProbeFuzzer/poc/raw/master/zziplib/zziplib_0-13-67_unzip-mem_memory-alignment-errors_zzip_disk_findfirst_64.zip
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Fgdraheim%2Fzziplib%2Ffiles%2F2415382/evil.zip
INFO:test:curl https://github.com/gdraheim/zziplib/files/2415382/evil.zip
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Fret2libc%2F---provided-by-email---/poc_bypass_fix2.zip
INFO:test:curl https://github.com/ret2libc/---provided-by-email---/poc_bypass_fix2.zip
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Ffantasy7082%2Fimage_test%2Fblob%2Fmaster/003-unknow-def-zip
INFO:test:curl https://github.com/fantasy7082/image_test/raw/master/003-unknow-def-zip
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Ffantasy7082%2Fimage_test%2Fblob%2Fmaster/002-mem-leaks-zip
INFO:test:curl https://github.com/fantasy7082/image_test/raw/master/002-mem-leaks-zip
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Ffantasy7082%2Fimage_test%2Fblob%2Fmaster/c005-bus-zzip_parse_root_directory
INFO:test:curl https://github.com/fantasy7082/image_test/raw/master/c005-bus-zzip_parse_root_directory
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Ffantasy7082%2Fimage_test%2Fblob%2Fmaster/c006-unknown-add-main
INFO:test:curl https://github.com/fantasy7082/image_test/raw/master/c006-unknown-add-main
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Ffantasy7082%2Fimage_test%2Fblob%2Fmaster/c008-main-unknown-de
INFO:test:curl https://github.com/fantasy7082/image_test/raw/master/c008-main-unknown-de
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Fgdraheim%2Fzziplib%2Ffiles%2F3001317/zip_poc.zip
INFO:test:curl https://github.com/gdraheim/zziplib/files/3001317/zip_poc.zip
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Fgdraheim%2Fzziplib%2Ffiles%2F3006594/POC.zip
INFO:test:curl https://github.com/gdraheim/zziplib/files/3006594/POC.zip
INFO:test:need tmp.download/https%3A%2F%2Fgithub.com%2Fgdraheim%2Fzziplib%2Ffiles%2F5340201/2020_10_OutagesPUReasons.zip
INFO:test:curl https://github.com/gdraheim/zziplib/files/5340201/2020_10_OutagesPUReasons.zip
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src && /opt/local/bin/cmake -E touch /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/zziptestdownloads-stamp/zziptestdownloads-download
[ 79%] No update step for 'zziptestdownloads'
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test && /opt/local/bin/cmake -E echo_append
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test && /opt/local/bin/cmake -E touch /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/zziptestdownloads-stamp/zziptestdownloads-update
[ 81%] No patch step for 'zziptestdownloads'
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test && /opt/local/bin/cmake -E echo_append
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test && /opt/local/bin/cmake -E touch /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/zziptestdownloads-stamp/zziptestdownloads-patch
[ 82%] No configure step for 'zziptestdownloads'
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/zziptestdownloads-build && /opt/local/bin/cmake -E echo_append
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/zziptestdownloads-build && /opt/local/bin/cmake -E touch /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/zziptestdownloads-stamp/zziptestdownloads-configure
[ 84%] Performing build step for 'zziptestdownloads'
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/zziptestdownloads-build && /opt/local/bin/cmake -E create_symlink /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/tmp.download /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/tmp.download
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/zziptestdownloads-build && /opt/local/bin/cmake -E touch /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/zziptestdownloads-stamp/zziptestdownloads-build
[ 85%] No install step for 'zziptestdownloads'
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/zziptestdownloads-build && /opt/local/bin/cmake -E echo_append
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/zziptestdownloads-build && /opt/local/bin/cmake -E touch /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/zziptestdownloads-stamp/zziptestdownloads-install
[ 86%] Completed 'zziptestdownloads'
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test && /opt/local/bin/cmake -E make_directory /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/CMakeFiles
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test && /opt/local/bin/cmake -E touch /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/CMakeFiles/zziptestdownloads-complete
cd /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test && /opt/local/bin/cmake -E touch /opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build/test/zziptestdownloads-prefix/src/zziptestdownloads-stamp/zziptestdownloads-done
make[2]: Leaving directory `/opt/local/var/macports/build/_opt_local_var_macports_sources_nue.de.rsync.macports.org_macports_release_tarballs_ports_archivers_libzzip/libzzip/work/build'
[ 86%] Built target zziptestdownloads

The build process started before 15:00 h and finished after 16:30 h.

Change History (5)

comment:1 Changed 18 months ago by ballapete (Peter "Pete" Dyballa)

On macOS Monterey, Version 12.6, building libzzip takes one minute, and the above mentioned steps finished fast.

comment:2 Changed 18 months ago by ballapete (Peter "Pete" Dyballa)

On PPC Tiger, Mac OS X 10.4.11, rebuilding with Python 3.10 takes even longer. The files are downloaded with Python at a speed of mB/sec or µB/sec…

Is it possible to switch off those scrappy tests? At least on Leopard and Tiger? It's only texlive that needs this port – and since it does not download things from the Internet, why is this download test performing longer than the climate change?

comment:3 Changed 18 months ago by ballapete (Peter "Pete" Dyballa)

Killing the original build process in GNU Emacs after two or more hours and changing line #24 in file gdraheim-zziplib-6b6242e/CMakeLists.txt from

option(ZZIPTEST "Build test/zzipself (self-extract example)" ON)

to

option(ZZIPTEST "Build test/zzipself (self-extract example)" OFF)

helped to finish within minutes.

comment:4 Changed 17 months ago by ballapete (Peter "Pete" Dyballa)

The tests still take some eternities…

comment:5 Changed 17 months ago by ryandesign (Ryan Carsten Schmidt)

Cc: mojca@… removed
Owner: set to mojca
Status: newassigned
Summary: Building libzzip takes an eternity on PPC Mac OS X 10.5.8, Leopardlibzzip @0.13.67: Downloads things at build time which takes a long time
Note: See TracTickets for help on using tickets.