[Git][reproducible-builds/reproducible-website][master] 3 commits: 2020-07: Initial draft
Chris Lamb
gitlab at salsa.debian.org
Wed Aug 5 11:33:05 UTC 2020
Chris Lamb pushed to branch master at Reproducible Builds / reproducible-website
Commits:
d39b6986 by Chris Lamb at 2020-08-05T12:30:34+01:00
2020-07: Initial draft
- - - - -
316da4dd by Chris Lamb at 2020-08-05T12:32:10+01:00
2020-06: Add a missing image to the right directory.
- - - - -
8a333b16 by Chris Lamb at 2020-08-05T12:32:53+01:00
/docs/source-date-epoch/ Move a "is a" suffix out of the link target.
- - - - -
4 changed files:
- _docs/source-date-epoch.md
- _reports/2020-06.md
- _reports/2020-07.md
- + images/reports/2020-06/testframework.png
Changes:
=====================================
_docs/source-date-epoch.md
=====================================
@@ -4,7 +4,7 @@ layout: docs
permalink: /docs/source-date-epoch/
---
-`SOURCE_DATE_EPOCH` [is a standardised environment variable](https://reproducible-builds.org/specs/source-date-epoch/) that distributions can set centrally and have build tools consume this in order to produce reproducible output.
+`SOURCE_DATE_EPOCH` is a [standardised environment variable](https://reproducible-builds.org/specs/source-date-epoch/) that distributions can set centrally and have build tools consume this in order to produce reproducible output.
Before implementing this, you should scan through [our checklist](https://wiki.debian.org/ReproducibleBuilds/StandardEnvironmentVariables#Checklist) to see if you can avoid implementing it.
=====================================
_reports/2020-06.md
=====================================
@@ -217,7 +217,7 @@ Lastly, Daniel Fullmer fixed the [Coreboot](https://doc.coreboot.org/) filesyste
#### Testing framework
-[![]({{ "/images/reports/2020-05/testframework.png#right" | relative_url }})](https://tests.reproducible-builds.org/)
+[![]({{ "/images/reports/2020-06/testframework.png#right" | relative_url }})](https://tests.reproducible-builds.org/)
We operate a large and many-featured [Jenkins](https://jenkins.io/)-based testing framework that powers [`tests.reproducible-builds.org`](https://tests.reproducible-builds.org). Amongst many other tasks, this tracks the status of our reproducibility efforts across many distributions as well as identifies any regressions that have been introduced. This month, Holger Levsen made the following changes:
=====================================
_reports/2020-07.md
=====================================
@@ -6,24 +6,116 @@ title: "Reproducible Builds in July 2020"
draft: true
---
+**Welcome to the July 2020 report from the [Reproducible Builds](https://reproducible-builds.org) project!**
+{: .lead}
+
+[![]({{ "/images/reports/2020-07/reproducible-builds.png#right" | relative_url }})](https://reproducible-builds.org/)
+
+
+In these reports we outline the most important things that we have been up to over the past month. As a quick recap, whilst anyone may inspect the source code of free software for malicious flaws, almost all software is distributed to end users as pre-compiled binaries.
+
+The motivation behind the reproducible builds effort is to ensure no flaws have been introduced during this compilation process by promising identical results are always generated from a given source, thus allowing multiple third-parties to come to a consensus on whether a build was compromised.
+
+In this month's report, we cover:
+
+* **Media coverage** — *FIXME, etc.*
+* **Upstream news** — *FIXME, etc.*
+* **Distribution work** — *FIXME, etc.*
+* **Software development** — *FIXME, etc.*
+* **Misc news** — *From our mailing list, etc.*
+* **Getting in touch** — *How to contribute, etc*
+
+If you are interested in contributing to the project, please visit our [*Contribute*]({{ "/contribute/" | relative_url }}) page on our website.
+{: .small}
+
+
+---
+
+# fixme
+
upstream work:
* [FIXME](https://github.com/sodiumoxide/sodiumoxide/pull/418#issuecomment-653692194)
-* [FIXME](https://github.com/Maratyszcza/PeachPy/pull/108)
-
* [FIXME](https://github.com/meilisearch/MeiliSearch/issues/837)
* Vagrant Cascadian:
* [Regression in u-boot reproducibility for the mx6cuboxi target](https://lists.denx.de/pipermail/u-boot/2020-July/420595.html).
* [guile-ssh: non-deterministic segfaults in test suite](https://github.com/artyom-poptsov/guile-ssh/issues/22)
+* [FIXME: Paul Spooren sent two versions of a patch for OpenWrt for adding the buildsystem revision to the packages manifest, so that al external feeds can be rebuild and verified.](http://lists.openwrt.org/pipermail/openwrt-devel/2020-July/030325.html) and [patch 1](http://lists.openwrt.org/pipermail/openwrt-devel/2020-July/030171.html)
+
+##
+openSUSE work:
+
+https://lists.opensuse.org/opensuse-factory/2020-07/msg00417.html monthly report
+https://lists.opensuse.org/opensuse-factory/2020-07/msg00388.html 15.2 verification results
+
+https://github.com/openSUSE/build-compare/pull/36 build-compare bug made it report different packages as identical - third such bug demonstrates once again why bit-identical results are the best.
+https://github.com/openSUSE/build-compare/pull/37 fix unit tests
+https://github.com/openSUSE/build-compare/pull/38 reproducible output
+
+## archlinux work:
+
+* Mass rebuild of old [community] packages in an attempt to make them reproducible as building with a previous pacman release could cause file ordering and size calculation issues on btrfs.
+* Implemented a system for packagers to get notifications when their package becomes unreproducible and packagers now have access to a dashboard where they can see their unreproducible packages. [Update mail](https://lists.archlinux.org/pipermail/arch-dev-public/2020-July/030029.html)
+
+
+## fixme
+
+* [FIXME](https://github.com/zephyrproject-rtos/zephyr/pull/17494#issuecomment-656780205)
+
+
+* [FIXME](https://bugs.debian.org/962474#60)
+
+* [FIXME](http://blog.cmpxchg8b.com/2020/07/you-dont-need-reproducible-builds.html) + [reply](https://twitter.com/bmwiedemann/status/1289193729387974656)
+
+
+
+## Media coverage
+
+* FIXME
+
+---
+
+## Upstream news
+
+* FIXME
+
+---
+
+### Distribution work
+
+
+[![]({{ "/images/reports/2020-07/opensuse.png#right" | relative_url }})](https://www.opensuse.org/)
+
+[![]({{ "/images/reports/2020-07/debian.png#center" | relative_url }})](https://debian.org/)
+
+
+In Debian:
+
+* 34 reviews of Debian packages were added, 14 were updated and 20 were removed this month adding to [our knowledge about identified issues](https://tests.reproducible-builds.org/debian/index_issues.html). FIXME issue types have been updated: [Add patch for nondeterministic\_order\_of\_debhelper\_snippets\_added\_by\_dh\_fortran\_mod toolchain issue](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/b2be46c8), [Add new nondeterministic\_order\_of\_debhelper\_snippets\_added\_by\_dh\_fortran\_mod toolchain issue](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/e67f706e), [Add patch for gem2deb\_install\_mkmf\_log toolchain issue](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/008b3d55), [Add new gem2deb\_install\_mkmf\_log toolchain issue](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/c5cd0e73),
+
+* debrebuild bugs filed:
+ * [FIXME: #964722](https://bugs.debian.org/964722)
+ * [FIXME: #964733](https://bugs.debian.org/964733)
+
+* [FIXME](https://bugs.debian.org/964772)
+* [FIXME](https://bugs.debian.org/857454)
+
+
+---
+
+## Software development
+
+#### Upstream patches
+
+The Reproducible Builds project detects, dissects and attempts to fix as many currently-unreproducible packages as possible. We endeavour to send all of our patches upstream where appropriate. This month, we wrote a large number of such patches, including:
+
* Bernhard M. Wiedemann:
- * [`apache-sshd`](https://issues.apache.org/jira/browse/SSHD-1026) (report copyright year/date)
* [`yast2-sound`](https://github.com/yast/yast-sound/pull/50) (uname -r)
* [`kismet`](https://github.com/kismetwireless/kismet/pull/282) (date)
* [`python-PyNaCl`](https://github.com/pyca/pynacl/pull/609) (sort python glob/readdir)
- * [`mono`](https://github.com/mono/mono/issues/20172) (report unknown nondeterminism)
* [`xfce4-panel-profiles`](https://git.xfce.org/apps/xfce4-panel-profiles/about/) (tar paxheaders, patch sent via email)
* [`paperjam`](https://mj.ucw.cz/sw/paperjam/) (date patch emailed to author)
* [`unknown-horizons`](https://github.com/unknown-horizons/unknown-horizons/pull/2943) (filesystem: sort readdir)
@@ -31,18 +123,11 @@ upstream work:
* [`graphviz`](https://gitlab.com/graphviz/graphviz/-/merge_requests/1454) (timezone, forwarded from Debian)
* [`afl`](https://github.com/AFLplusplus/AFLplusplus/pull/441) (bug, misbuilt man page varied from kernel boot options)
* [`multus`](https://github.com/intel/multus-cni/pull/534) (date)
+ report
+ * [`apache-sshd`](https://issues.apache.org/jira/browse/SSHD-1026) (report copyright year/date)
+ * [`mono`](https://github.com/mono/mono/issues/20172) (report unknown nondeterminism)
-openSUSE work:
-
-https://lists.opensuse.org/opensuse-factory/2020-07/msg00417.html monthly report
-
-https://lists.opensuse.org/opensuse-factory/2020-07/msg00388.html 15.2 verification results
-
-https://github.com/openSUSE/build-compare/pull/36 build-compare bug made it report different packages as identical - third such bug demonstrates once again why bit-identical results are the best.
-https://github.com/openSUSE/build-compare/pull/37 fix unit tests
-https://github.com/openSUSE/build-compare/pull/38 reproducible output
-
-* Bernhard M. Wiedemann:
+* Bernhard M. Wiedemann (opensuse?)
* [`brp-check-suse`](https://github.com/openSUSE/brp-check-suse/pull/32) (toolchain, sort)
* [`insighttoolkit`](https://build.opensuse.org/request/show/823615) (CPU-detection ; also [filed upstream](https://github.com/InsightSoftwareConsortium/ITK/issues/1939)
* [`sac`](https://build.opensuse.org/request/show/822681) (omit ctime from zip)
@@ -58,31 +143,236 @@ https://github.com/openSUSE/build-compare/pull/38 reproducible output
* [`pspp`](https://build.opensuse.org/request/show/821090) (scrub unreproducible testsuite.log)
* [`dnscrypt-proxy`](https://build.opensuse.org/request/show/822151) (sort find output)
-debian work:
+* Chris Lamb:
-* debrebuild bugs filed:
- * [FIXME: #964722](https://bugs.debian.org/964722)
- * [FIXME: #964733](https://bugs.debian.org/964733)
+ * [#964186](https://bugs.debian.org/964186) filed against [`python-peachpy`](https://tracker.debian.org/pkg/python-peachpy) ([forwarded upstream](https://github.com/Maratyszcza/PeachPy/pull/108)).
+ * [#964369](https://bugs.debian.org/964369) filed against [`nmap`](https://tracker.debian.org/pkg/nmap).
+ * [#964440](https://bugs.debian.org/964440) filed against [`flit`](https://tracker.debian.org/pkg/flit).
+ * [#964721](https://bugs.debian.org/964721) filed against [`weather-util`](https://tracker.debian.org/pkg/weather-util).
+ * [#964768](https://bugs.debian.org/964768) filed against [`libtpms`](https://tracker.debian.org/pkg/libtpms).
+ * [#964772](https://bugs.debian.org/964772) filed against [`gem2deb`](https://tracker.debian.org/pkg/gem2deb).
+ * [#964958](https://bugs.debian.org/964958) filed against [`pyerfa`](https://tracker.debian.org/pkg/pyerfa) ([forwarded upstream](https://github.com/liberfa/pyerfa/pull/45)).
+ * [#964960](https://bugs.debian.org/964960) filed against [`gmap`](https://tracker.debian.org/pkg/gmap).
+ * [#965255](https://bugs.debian.org/965255) filed against [`dh-fortran-mod`](https://tracker.debian.org/pkg/dh-fortran-mod).
+ * [#965256](https://bugs.debian.org/965256) filed against [`logilab-common`](https://tracker.debian.org/pkg/logilab-common) ([forwarded upstream](https://www.logilab.org/ticket/10251578)).
+ * [#965319](https://bugs.debian.org/965319) filed against [`mrbayes`](https://tracker.debian.org/pkg/mrbayes).
+ * [#965361](https://bugs.debian.org/965361) filed against [`python-cooler`](https://tracker.debian.org/pkg/python-cooler).
+ * [#965362](https://bugs.debian.org/965362) filed against [`numpydoc`](https://tracker.debian.org/pkg/numpydoc).
+ * [#966179](https://bugs.debian.org/966179) filed against [`jskeus`](https://tracker.debian.org/pkg/jskeus).
+ * [#966495](https://bugs.debian.org/966495) filed against [`python-pyxs`](https://tracker.debian.org/pkg/python-pyxs).
+ * [#966531](https://bugs.debian.org/966531) filed against [`sratom`](https://tracker.debian.org/pkg/sratom).
-archlinux work:
-* Mass rebuild of old [community] packages in an attempt to make them reproducible as building with a previous pacman release could cause file ordering and size calculation issues on btrfs.
-* Implemented a system for packagers to get notifications when their package becomes unreproducible and packagers now have access to a dashboard where they can see their unreproducible packages. [Update mail](https://lists.archlinux.org/pipermail/arch-dev-public/2020-July/030029.html)
+### diffoscope
-* [FIXME](https://bugs.debian.org/964772)
+[![]({{ "/images/reports/2020-07/diffoscope.svg#right" | relative_url }})](https://diffoscope.org)
-* [FIXME](https://github.com/zephyrproject-rtos/zephyr/pull/17494#issuecomment-656780205)
+[diffoscope](https://diffoscope.org/) is our in-depth 'diff-on-steroids' utility which helps us diagnose reproducibility issues in packages. It does not define reproducibility, but rather provides a helpful and human-readable guidance for packages that are not reproducible, rather than relying essentially-useless binary diffs.
-* [FIXME](https://bugs.debian.org/857454)
-* [964958 forwarded](https://github.com/liberfa/pyerfa/pull/45)
+Elsewhere in our tooling, Chris Lamb made the following changes to [diffoscope](https://diffoscope.org), including preparing and uploading versions `150`, `151`, `152`, `153` & `154` to Debian:
-* [965256 forwarded](https://www.logilab.org/ticket/10251578)
+* New features:
-* [FIXME](https://bugs.debian.org/962474#60)
+ * Add support for flash-optimised [F2FS](https://en.wikipedia.org/wiki/F2FS) filesystems. ([#207](https://salsa.debian.org/reproducible-builds/diffoscope/issues/207))
+ * Don't require `zipnote(1)` to determine differences in a `.zip` file as we can use `libarchive`. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/a8c9d69)]
+ * Allow `--profile` as a synonym for `--profile=-`. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/ea8d111)]
+ * Increase the minimum length of the output of `strings(1)` to eight characters to avoid unnecessary diff noise. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/572fc28)]
+ * Drop some legacy argument styles: `--exclude-directory-metadata` and `--no-exclude-directory-metadata` have been replaced with `--exclude-directory-metadata={yes,no}`. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/aa4a109)]
-* [FIXME](http://blog.cmpxchg8b.com/2020/07/you-dont-need-reproducible-builds.html) + [reply](https://twitter.com/bmwiedemann/status/1289193729387974656)
+* Bug fixes:
-* [FIXME: Paul Spooren sent two versions of a patch for OpenWrt for adding the buildsystem revision to the packages manifest, so that al external feeds can be rebuild and verified.](http://lists.openwrt.org/pipermail/openwrt-devel/2020-July/030325.html) and [patch 1](http://lists.openwrt.org/pipermail/openwrt-devel/2020-July/030171.html)
+ * Pass the absolute path when extracting members from [SquashFS](https://en.wikipedia.org/wiki/SquashFS) images as we run the command with working directory in a temporary directory. ([#189](https://salsa.debian.org/reproducible-builds/diffoscope/commit/d226cf8))
+ * Correct adding a comment when we cannot extract a filesystem due to missing [libguestfs](http://libguestfs.org/) module. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/0dada5a)]
+ * Don't crash when listing entries in archives if they don't have a listed size such as hardlinks in ISO images. ([#188](https://salsa.debian.org/reproducible-builds/diffoscope/issues/188))
+
+* Output improvements:
+
+ * Strip off the file offset prefix from `xxd(1)` and show bytes in groups of 4. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/795f7ca)]
+ * Don't emit `javap not found in path` if it is available in the path but it did not result in an actual difference. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/d9ff65b)]
+ * Fix `... not available in path` messages when looking for Java decompilers that used the Python class name instead of the command. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/eb79175)]
+
+* Logging improvements:
+
+ * Add a bit more debugging info when launching [libguestfs](http://libguestfs.org/). [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/69c0d4b)]
+ * Reduce the `--debug` log noise by truncating the `has_some_content` messages. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/a45f01c)]
+ * Fix the `compare_files` log message when the file does not have a literal name. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/9dee945)]
+
+* Codebase improvements:
+
+ * Rewrite and rename `exit_if_paths_do_not_exist` to not check files multiple times. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/4d89836)][[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/d43d580)]
+ * Add an `add_comment` helper method; don't mess with our internal list directly. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/d5ed790)]
+ * Replace some simple usages of `str.format` with Python 'f-strings' [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/5f41afe)] and make it easier to navigate to the `main.py` entry point [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/aee4f73)].
+ * In the [RData](https://www.r-project.org/) comparator, always explicitly return `None` in the failure case as we return a non-`None` value in the success one. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/cd9e526)]
+ * Tidy some imports [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/065a7e4)][[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/e01f3df)][[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/3641688)] and don't alias a variable when don't end up it and use `_` instead. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/e349860)]
+ * Clarify the use of a separate `NullChanges` quasi-file to represent missing data in the Debian package comparator [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/a76b0f1)] and clarify use of a 'null' diff in order to remember an exit code. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/1dbc0d6)]
+
+* Misc:
+
+ * Profile the launch of [libguestfs](http://libguestfs.org/) filesystems. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/7e3bc6d)]
+ * Clarify and correct our contributing info. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/4caa2f0)][[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/c359bc8)][[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/c66a7f6)][[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/6437888)][[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/42afe44)][[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/7b3a34f)]
+
+
+Also: Jean-Romain Garnier: FIXME
+ * Improve output of side-by-side diffs, detecting added lines better. (MR: reproducible-builds/diffoscope!64). [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/65696a9)]
+ * Rename Difference.from\_command to Difference.from\_operation. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/0b278dc)]
+ * Make Command subclass of new generic Operation class. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/206ef26)]
+ * Allow passing file with list of arguments to ArgumentParser (eg. "diffoscope @args.txt"). (MR: reproducible-builds/diffoscope!62). [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/b2799af)]
+ * Remove offsets before instructions in objdump. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/3e72c1c)]
+ * Remove raw instructions from ELF tests. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/e9e2904)]
+ * Add --no-show-raw-insn to objdump commands. [[...](https://salsa.debian.org/reproducible-builds/diffoscope/commit/cbcb41e)]
+
+
+
+#### diffoscope-website
+
+Chris Lamb also updated the [main Reproducible Builds website and documentation](https://reproducible-builds.org/) to drop a number of unused Javascript files [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/3b71cb0)][[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/222b306)][[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/539eb99)] and added unminified versions of [Bootstrap](https://getbootstrap.com/) and [jQuery](https://jquery.com/) [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/fb57181)] and fixed a number of broken URLs [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/02be515)][[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/bf9e8ee)].
+
+also
+
+* Gonzalo Bulnes Guilpain:
+ * Fix minor grammar issue, reword sentence. [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/81ee324)]
+ * Reword example for clarity. [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/3685ff3)]
+ * Reword sentence for clarity. [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/9aa3796)]
+ * Reword sentence for clarity. [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/9cb4ffa)]
+ * Fix dangling pronoun. [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/dfdde38)]
+ * Fix product name case. [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/b06b9d1)]
+ * Remove trailing whitespaces. [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/1b86b33)]
+ * Fix misspellings. [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/04e943e)]
+* Holger Levsen:
+ * README: update requirements for running this side on buster. [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/c097558)]
+ * mark Alpine citests as disabled. [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/70b6ac5)]
+ * link reproducible.archlinux.org from /who#archlinux. [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/3f143dd)]
+
+#### Other tools
+
+[*strip-nondeterminism*](https://tracker.debian.org/pkg/strip-nondeterminism) is our tool to remove specific non-deterministic results from a completed build. This month, Marc Herbert added a `--verbose`-level statement when the [`Archive::Cpio`](https://metacpan.org/pod/Archive::Cpio) Perl module was missing [[...](https://salsa.debian.org/reproducible-builds/strip-nondeterminism/-/merge_requests/6)] and Chris Lamb ensured that we did not install the internal handler documentation generated from [Perl POD documents](https://perldoc.perl.org/perlpod.html) [[...](https://salsa.debian.org/reproducible-builds/strip-nondeterminism/commit/b9b8428)] and fixed a trivial typo [[...](https://salsa.debian.org/reproducible-builds/strip-nondeterminism/commit/3398261)].
+
+[*reprotest*](https://tracker.debian.org/pkg/reprotest) is our end-user tool to build same source code twice in widely different environments and then checks the binaries produced by each build for any differences. In July, Vagrant Cascadian updated the default arguments passed to [diffoscope](https://diffoscope.org) to support [*diffoscope* versions greater than 153](https://diffoscope.org/news/diffoscope-153-released/) ([#966256](https://bugs.debian.org/966256)) and updated the versioned dependencies to match [[...](https://salsa.debian.org/reproducible-builds/reprotest/commit/c23fc5a)].
+
+#### Testing framework
+
+[![]({{ "/images/reports/2020-05/testframework.png#right" | relative_url }})](https://tests.reproducible-builds.org/)
+
+We operate a large and many-featured [Jenkins](https://jenkins.io/)-based testing framework that powers [`tests.reproducible-builds.org`](https://tests.reproducible-builds.org). Amongst many other tasks, this tracks the status of our reproducibility efforts across many distributions as well as identifies any regressions that have been introduced. This month, Holger Levsen made the following changes:
+
+* Alpine-related changes:
+
+ * disable all jobs until they are / alpine is fixed. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/ce107fb3)]
+
+* [Debian](https://www.debian.org/)-related changes:
+
+ * (amd64): reschedule unstable a bit more. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/afd0f5cb)]
+ * (amd64/arm64/armhf): reschedule unstable and bullseye (armhf only) a bit more often, buster a bit less. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/0af6eeb4)]
+ * rebuilder prototype: correctly process sbuild exit code. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/cfa2ba45)]
+ * rebuilder prototype: mention #964722. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/19ce0560)]
+ * sudoers: allow systemctl reset-failed with arguments for node health job. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/135c33a4)]
+ * add php-horde packages back to pkg-php-pear pkg set for bullseye. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/e9a7296f)]
+ * configure static IP addresses for OSUOSL nodes as their dhcp gets confused when switching dates between today and the future. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/2051e9d4)]
+ * correct number of armhf boards at vagrant's. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/9f52d61a)]
+ * fix links for 404- and not\_nor\_us-icons. Closes: #959363. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/669046fc)]
+ * update to version from src:devscripts.git/scripts/debrebuild.pl (2.20.5 / fixing #964733). [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/2a2dd31d)]
+
+* reproducible trbo system health check:
+
+ * add generic ssh failure notice. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/967342cb)]
+ * add notes explaining the issues hosts are experiencing. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/9e5ed290)]
+ * also notice logrotate failures. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/37ffd60f)]
+ * also notice pbuilder failures. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/700d2775)]
+ * also notice some kinds of netbsd build failures. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/282b8ee3)]
+ * deal with zipped job logfiles, fix logic. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/55277100)]
+ * deal with zipped job logfiles. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/ced06afd)]
+ * detect another causes for job failures. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/98a4f0a6)]
+ * detect failure to delete schroot( session)s. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/485097f5)]
+ * detect two more causes for job failures. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/607716b8)]
+ * detect unkillable unwanted processes. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/45d7925e)]
+ * do not use links for dealing with logs. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/d61964ea)]
+ * don't tread osuosl167 as special anymore. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/505b973c)]
+ * fix grammar. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/1cd265d4)]
+ * ignore more jobs if certain nodes are down. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/be118a1d)]
+ * improve language. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/a9e0a53b)]
+ * improve naming of one identified cause. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/7c504518)]
+ * improve notices appearance. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/2ce70499)]
+ * include job status icons for relevant jobs with issues. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/612bc046)]
+ * more notices about nodes becoming unresponsive. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/b2113fdf)]
+ * notice nodes becoming unresponsive. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/0f424acb)]
+ * notice proxy connection failures. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/88987726)]
+ * notice too many installed kernels too. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/199ea187)]
+ * refactor, make some output conditional. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/eb395650)]
+ * refactor, renameing. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/82f6632b)]
+ * refactoring. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/2edf5937)]
+ * relax regex to ignore more jobs if node is down. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/6e01c2d7)]
+ * seperate nodes which have been automatically marked as down. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/283a5697)]
+
+* Misc:
+ * install squid on all OSUOSL nodes. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/798efad2)]
+ * janitor: only send mails to jelmer. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/48932bc7)]
+ * move deploy\_kgb.py to (/srv/jenkins/)bin/. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/e67051de)]
+ * part 2: switch OSUOSL nodes to use osuosl168 as proxy. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/5bb9c570)]
+ * reproducible node health check: automatically fix some failed systemd units. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/052153a5)]
+ * reproducible node health: add some debugging output. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/6dd3dfeb)]
+ * reproducible node health: make more robust and drop debugging output. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/33b1de94)]
+ * reproducible node health: more debugging output. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/2b8f9424)]
+ * reproducible node health: more sophisticated cleanup of failed services and units. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/99c771e6)]
+ * reproducible: all OSUOSL nodes now use a local http proxy. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/d022f52c)]
+ * reproducible: detect odxu4c and opi2b related jobs as zombies (as the nodes were removed, but the jobs were not). [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/0e8063fd)]
+ * reproducible: drop retired nodes here as the jobs are gone now. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/5bee8a9b)]
+ * reproducible: tidying. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/a915b30f)]
+ * slightly improve wording. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/27d67051)]
+ * switch OSUOSL nodes to use osuosl168 as proxy. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/1e2601ac)]
+
+In addition, Mattia Rizzolo updated the `init_node` script to use [sudo](https://www.sudo.ws/) instead of explicit logout and log ins, etc. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/99bdf68c)]
+ * init\_node: shellcheck. [[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/cf70ea0a)]
+
+
+### build node maintenance
+
+Lastly, the usual build node maintenance was performed by
+
+Holger Levsen
+[[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/25282617)]
+[[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/a32123c5)]
+[[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/cbf6c3a8)]
+[[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/3549875d)]
+[[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/6cf7a07b)]
+
+Mattia Rizzolo
+[[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/87cb7391)]
+[[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/308d3cab)]
+
+Vagrant Cascadian
+[[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/89b77776)]
+[[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/4e100a5e)]
+[[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/f2171a0d)]
+[[...](https://salsa.debian.org/qa/jenkins.debian.net/commit/0fd99b71)]
+
+.
+
+<br>
+
+---
+
+## Misc news
+
+On [our mailing list](https://lists.reproducible-builds.org/listinfo/rb-general/) this month:
+
+Debian Developer Graham Inggs asked why the [openorienteering-mapper package was failing to build on the Reproducible Builds
+testing infrastructure](https://lists.reproducible-builds.org/pipermail/rb-general/2020-July/001980.html). There were a number of replies pointing out some curiosities with the build (eg. Chris Lamb spotting a [potentially missing build-dependency](https://lists.reproducible-builds.org/pipermail/rb-general/2020-July/001984.html)) Although it has not been confirmed yet, Niko Tyni appeared to have diagnosed it as being [due to the use a combination of `__FILE__` and GCC's `-ffile-prefix-map`](https://lists.reproducible-builds.org/pipermail/rb-general/2020-July/001988.html).
+
+[David Kleuker](https://davidak.de/) asked a question about using [`SOURCE_DATE_EPOCH`](https://reproducible-builds.org/docs/source-date-epoch/) with the `install(1)` tool that ships with [GNU coreutils](https://www.gnu.org/software/coreutils/) as he was seeing differing file 'birth' times of files. However, Chris Lamb identified that the issue was that [David was using an older version of diffoscope](https://lists.reproducible-builds.org/pipermail/rb-general/2020-July/001995.html).
+
+In another thread, John Scott asked for help in adding JavaScript metadata for the [reproducible-builds.org](https://reproducible-builds.org/) website for the [LibreJS](https://www.gnu.org/software/librejs/) browser extension, which blocks non-free nontrivial Javascript while allowing JavaScript that is free and/or trivial. Chris Lamb investigated the issue and found that a number of the Javascript files could be simply removed and replaced the minified versions with their corresponding, unminified, versions instead in the source tree [[...](https://salsa.debian.org/reproducible-builds/reproducible-website/commit/fb57181)].
+
+---
+
+If you are interested in contributing to the Reproducible Builds project, please visit our [*Contribute*](https://reproducible-builds.org/contribute/) page on our website. However, you can get in touch with us via:
+
+ * IRC: `#reproducible-builds` on `irc.oftc.net`.
+
+ * Twitter: [@ReproBuilds](https://twitter.com/ReproBuilds)
+
+ * Mastodon: [@reproducible_builds at fosstodon.org](https://fosstodon.org/@reproducible_builds)
+ * Reddit: [/r/ReproducibleBuilds](https://reddit.com/r/reproduciblebuilds)
+ * Mailing list: [`rb-general at lists.reproducible-builds.org`](https://lists.reproducible-builds.org/listinfo/rb-general)
=====================================
images/reports/2020-06/testframework.png
=====================================
Binary files /dev/null and b/images/reports/2020-06/testframework.png differ
View it on GitLab: https://salsa.debian.org/reproducible-builds/reproducible-website/-/compare/eee44a7539cb3e977f71fb5ee9c189cb348b1d40...8a333b1661182953a141fb5b0d5bd511002f82bc
--
View it on GitLab: https://salsa.debian.org/reproducible-builds/reproducible-website/-/compare/eee44a7539cb3e977f71fb5ee9c189cb348b1d40...8a333b1661182953a141fb5b0d5bd511002f82bc
You're receiving this email because of your account on salsa.debian.org.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.reproducible-builds.org/pipermail/rb-commits/attachments/20200805/2c6c293a/attachment.htm>
More information about the rb-commits
mailing list