[rb-general] debian-installer: Ensure build is reproducible regardless of the user's umask(2)

[Cyril Brulebois]

Hi,

Vagrant Cascadian <vagrant at debian.org> (2019-02-21):
> On 2019-02-21, Chris Lamb wrote:
> > Chris Lamb wrote:
> >> > #920631 debian-installer: Ensure build is reproducible regardless
> >> > of the user's umask(2)
> >> [..]
> >> > #920676: debian-installer: Ensure build is reproducible
> >> > regardless of the underlying filesystem ordering
> >> 
> >> Thank you for developing and maintainer the Debian Installer. I
> >> was wondering what might be needed on my end to ensure that these
> >> patches end up in the next alpha/beta release?
> >
> > Sorry to bug you again folks but I haven't done any d-i development
> > for almost 10 years now so I may not be aware of the most
> > productive, helpful and — above everything else! — friendly way of
> > getting things merged, particularly in time for buster. Can you
> > help? :-)
> 
> I went ahead and merged them into git.

This seems to have broken all daily builds.

Example on amdahl for arm64, even if that doesn't appear to be
arch-specific at all.

[ last lines of /home/d-i/di/logs/di-autobuild_daily-arm64-20190222-0200 ]

    # Ensure build results have reproducible mtimes
    chmod: changing permissions of './tmp/netboot/tree/sbin/modprobe': Operation not permitted
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/vconfig'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/syslogd'
    chmod: changing permissions of './tmp/netboot/tree/sbin/modinfo': Operation not permitted
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/mkswap'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/swapon'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/blockdev'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/fstrim'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/swapoff'
    chmod: changing permissions of './tmp/netboot/tree/sbin/insmod': Operation not permitted
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/udhcpc'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/poweroff'
    chmod: changing permissions of './tmp/netboot/tree/sbin/rmmod': Operation not permitted
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/freeramdisk'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/klogd'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/switch_root'
    chmod: changing permissions of './tmp/netboot/tree/sbin/depmod': Operation not permitted
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/reboot'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/ip'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/route'
    chmod: changing permissions of './tmp/netboot/tree/sbin/lsmod': Operation not permitted
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/halt'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/hwclock'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/sbin/pivot_root'
    chmod: changing permissions of './tmp/netboot/tree/usr/lib/ssl/certs': Operation not permitted
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/sbin/chroot'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/sbin/arping'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/['
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/test'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/printf'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/wc'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/bzcat'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/dirname'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/sort'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/[['
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/nc'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/env'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/tftp'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/tail'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/xzcat'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/realpath'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/groups'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/tr'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/head'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/free'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/find'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/unxz'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/basename'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/cut'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/sha1sum'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/uniq'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/ar'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/sha512sum'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/tty'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/seq'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/id'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/expr'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/blkdiscard'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/cmp'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/md5sum'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/lsscsi'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/logger'
    chmod: cannot operate on dangling symlink './tmp/netboot/tree/usr/bin/sha256sum'
    chmod: changing permissions of './tmp/netboot/tree/etc/mtab': Operation not permitted
    chmod: changing permissions of './tmp/cdrom_grub/tree/sbin/modprobe': Operation not permitted
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/vconfig'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/syslogd'
    chmod: changing permissions of './tmp/cdrom_grub/tree/sbin/modinfo': Operation not permitted
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/mkswap'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/swapon'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/blockdev'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/fstrim'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/swapoff'
    chmod: changing permissions of './tmp/cdrom_grub/tree/sbin/insmod': Operation not permitted
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/udhcpc'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/poweroff'
    chmod: changing permissions of './tmp/cdrom_grub/tree/sbin/rmmod': Operation not permitted
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/freeramdisk'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/klogd'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/switch_root'
    chmod: changing permissions of './tmp/cdrom_grub/tree/sbin/depmod': Operation not permitted
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/reboot'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/ip'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/route'
    chmod: changing permissions of './tmp/cdrom_grub/tree/sbin/lsmod': Operation not permitted
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/halt'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/hwclock'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/sbin/pivot_root'
    chmod: changing permissions of './tmp/cdrom_grub/tree/usr/lib/ssl/certs': Operation not permitted
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/sbin/chroot'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/sbin/arping'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/['
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/test'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/printf'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/wc'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/bzcat'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/dirname'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/sort'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/[['
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/nc'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/env'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/tftp'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/tail'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/xzcat'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/realpath'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/groups'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/tr'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/head'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/free'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/find'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/unxz'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/basename'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/cut'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/sha1sum'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/uniq'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/ar'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/sha512sum'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/tty'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/seq'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/id'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/expr'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/blkdiscard'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/cmp'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/md5sum'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/lsscsi'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/logger'
    chmod: cannot operate on dangling symlink './tmp/cdrom_grub/tree/usr/bin/sha256sum'
    chmod: changing permissions of './tmp/cdrom_grub/tree/etc/mtab': Operation not permitted
    make: *** [Makefile:319: release] Error 123
    INFO: cleanup schroot ...
    INFO: cleanup installer build directory ...
    INFO: Exiting now ...


Cheers,
-- 
Cyril Brulebois (kibi at debian.org)            <https://debamax.com/>
D-I release manager -- Release team member -- Freelance Consultant
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: not available
URL: <http://lists.reproducible-builds.org/pipermail/rb-general/attachments/20190222/4258726a/attachment.sig>