MacPorts Meeting 2018: Buildbot

Outstanding issues:

• Buildbot 1.0
  • Can we switch to the new version?
    • #56044: We should prototype builds on Buildbot 1.x and fix the UI rather than working around 0.8's limitations.
  • Would offer GitHub authentication

• Deploying www/guide/portindex jobs
  • Has to be deployed by Ryan

• Pull requests
  • Can we test them on our own infrastructure?
  • Requires spinning up clean VMs

• Fixing email notifications
  • No access to logs, Ryan needs to look into it: #56045

• Do not attempt to build ports on platforms they are known to fail on: #15712
  • Use 'platforms' option from Portfiles

Most important and might want to start on this meeting:

• Building variants
  • Ticket: #52742
  • Make mpbb support building with variants
  • Which set of variants should be build by the buildbot?
    • +quartz
    • +universal

• History of builds for each port
  • How to find build of a specific port
  • Need to write some kind of index
  • History of builds
  • Display build status on GitHub for each commmit
    • ​https://developer.github.com/v3/repos/statuses/

• Reorganization
  • Use one build job per port
  • Add another level of hierarchy
  • Have a single portwatcher jobs that triggers mirroring and distributes jobs to OS-specific builds afterwards

• Port dependencies build order
  • Ticket: #52766
  • Dependencies need to be built first
  • Sort list of ports to topological order

Issues

​https://trac.macports.org/query?status=!closed&component=buildbot/mpbb

#35897

Add a buildbot with +universal for all packages

#49759

fetch.type {git,bzr} hits buildbot timeout after 20 minutes without output

#51995

buildbot improvements

#51996

Buildbot: create a new factory to aid with new MacPort releases

#52455

Buildbot: use GitHub authentication

#52742

buildbot: add support for building ports with variants

#52810

Enhance buildbot email to include links to failing builds instead of just all builds

#52921

buildbot: don't say "failed to calculate dependencies" when dependencies are in fact missing

#52949

buildbot: list the failed dependencies in DescriptionDone

#52953

buildbot: implement filters of stdio, one for installation, one for dependencies

#52957

buildbot notification mails have wrong To: with non-ASCII encoding

#52983

buildbot: builds with linking errors are not handled properly

#52989

buildbot: allow building 'pseudoports'

#53056

buildbot: multiple failed dependencies reported as multiple broken builds in email report

#53174

buildbot: better handle removal of ports in mpbb

#53250

buildbot: weird handling of conflicting dependencies

#53587

buildbot: portwatcher should not run if portbuilder is still running

#53976

buildbot: provide a way to (force)build just the main port and not its other subports

#53977

buildbot: add a checkbox to add an additional step that runs the test suite

#53978

buildbot: provide a way to rebuild all ports between two commits

#53979

buildbot: merge portwatcher jobs

#55078

buildbot: exit early in portbuilder if port already built

#55978

buildbot new view implementations

#56017

Buildbot: Replace WithProperties with Interpolate

#56028

Buildbot: Save port version, variants and commit that the port being built belongs to

#56044

Switch to buildbot 2.x

#56045

Buildbot: some members receive no email notifications

#56048

Evaluate replacing getopt with pure-getopt in mpbb to avoid getopt dependency in Travis CI

#56061

Add a lint job

#56273

buildbot: Prioritize builders

#56314

wine*: The 10.6 i386 builder incorrectly skips building these ports

#57343

mpbb mirror-distfiles repeatedly downloads distfiles with checksum mismatches

#57464

Buildbot: Don't keep huge ports installed

#57564

Builds are not always in the right order

#57568

Could mpbb-install-dependencies exit early if the port is already installed?

#57865

mpbb fails parsing command line options if disk is full

#57869

Don't let the disk fill up

#58284

mpbb mirror-distfiles should print progress information so that slow downloads don't time out

#58800

Buildbot should wait until the clock catches up to the Portfiles

#59286

Mirror distfiles immediately after a commit

#59287

Include the portwatcher build number in the portbuilder priority

#60628

Reduce disk writes

#60632

Reduce disk writes by extracting distfiles directly from fileserver

#60878

Let ports opt in to being built for different deployment targets on buildbot

#60934

sort-with-subports.tcl shouldn't check public server for nondistributable ports

#60995

port_binary_distributable.tcl: Clarify reason for nondistributability

#61019

mpbb: Remove failcache entry if port is already installed

#61768

buildbot/mpbb can upload a nondistributable archive to the public server

#61862

buildbot jobs: remove MaxCDN zone purge