grml-live.git
2 weeks agoSW: drop slurm from GRML_FULL master
Michael Prokop [Wed, 13 Oct 2021 15:40:35 +0000 (17:40 +0200)]
SW: drop slurm from GRML_FULL

slurm got removed from Debian/testing on 2021-10-08 due to
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=993874.

Given that this prevents builds of grml-testing in our daily
ISOs, let's remove the package, at least for now.

3 weeks agoSW: add f2fs-tools to GRML_SMALL + GRML_FULL
Michael Prokop [Tue, 5 Oct 2021 07:48:43 +0000 (09:48 +0200)]
SW: add f2fs-tools to GRML_SMALL + GRML_FULL

Thanks: Arun for the suggestion
Closes: https://github.com/grml/grml/issues/180

4 weeks agoSW: drop ifenslave from GRML_SMALL and GRML_FULL
Michael Prokop [Mon, 27 Sep 2021 09:41:46 +0000 (11:41 +0200)]
SW: drop ifenslave from GRML_SMALL and GRML_FULL

Quoting /usr/share/doc/ifenslave/NEWS.Debian.gz:

| ifenslave (2.10) unstable; urgency=medium
|
|   This version of the ifenslave package no longer provides /sbin/ifenslave. The
|   /sbin/ip command from the iproute2 package supports creating bonding masters
|   and enslaving other interfaces to it.
|
|  -- Guus Sliepen <guus@debian.org>  Tue, 08 May 2018 22:47:07 +0200

ifenslave is no longer in Debian/testing since 2021-09-14 due to RC
bugs, and therefore we don't have any recent Debian/testing based daily
ISOs anymore. Given that iproute2 supports network bonding, let's drop
ifenslave from our package list.

Related to https://github.com/grml/grml/issues/148

4 weeks agoRelease new version 0.39.1 v0.39.1
Michael Prokop [Mon, 27 Sep 2021 08:55:11 +0000 (10:55 +0200)]
Release new version 0.39.1

4 weeks agoisolinux: fix toram=... variable usage within isolinux configs
Michael Prokop [Mon, 27 Sep 2021 08:35:16 +0000 (10:35 +0200)]
isolinux: fix toram=... variable usage within isolinux configs

Fixup for commit 9453222c0, where we introduced usage of
$fixed_squashfs_name.  This variable was set up only *after*
adjust_boot_files function got invoked for the isolinux configuration
files. As a result the isolinux configuration files ended up with their
template placeholder settings included ("toram=%SQUASHFS_NAME%").

Fix ordering, but also warn in adjust_boot_files() if the the
$fixed_squashfs_name + $fixed_release_info variables are unset.

Thanks: Chris Hofstaedtler for the bug report
Closes: https://github.com/grml/grml/issues/179

2 months agoGRMLBASE/15-initsetup: provide workaround for failing rsyslog
Michael Prokop [Tue, 24 Aug 2021 08:14:21 +0000 (10:14 +0200)]
GRMLBASE/15-initsetup: provide workaround for failing rsyslog

Previous versions of the rsyslog package provided its rsyslog systemd
unit file as /lib/systemd/system/rsyslog.service. Starting with rsyslog
v8.2108.0-1, the file is provided as
/usr/lib/systemd/system/rsyslog.service though. This change is related
to the "dh_installsystemd: Prefer /usr/lib/systemd/ to /lib/systemd"
change from debhelper v13.4, which furthermore seems to be related to
the usrmerge situation.

Now executing `systemctl preset-all` fails though:

| # systemctl preset-all
| [...]
| Failed to preset unit, file /etc/systemd/system/syslog.service already exists and is a symlink to /lib/systemd/system/rsyslog.service.

By manually removing the /etc/systemd/system/syslog.service symlink, the
appropriate symlink (from /etc/systemd/system/syslog.service towards
/usr/lib/systemd/system/rsyslog.service) gets set up as expected again.

Reported towards Debian as #992847, but until it's fixed in the upstream
packaging, we need a workaround in our build tools.

2 months agoUpdate DEBIAN_STABLE's apt sources.list configuration for bullseye
Michael Prokop [Mon, 23 Aug 2021 09:27:32 +0000 (11:27 +0200)]
Update DEBIAN_STABLE's apt sources.list configuration for bullseye

Related fix for commit 07181b4c86f. Now that bullseye is the new Debian
stable release, also adjust the backports entry accordingly.

FTR, when using "stable-backports" instead of "bullseye-backports",
apt warns about:

| W: Conflicting distribution: http://ftp.debian.org/debian stable-backports InRelease (expected stable-backports but got bullseye-backports)

We might not worry about this, but it might be confusing for users,
so until we've a better approach for this, let's keep it as-is.

Thanks: d630 for the bug report
Closes: https://github.com/grml/grml-live/issues/105

3 months agoRelease new version 0.39.0 v0.39.0
Michael Prokop [Sun, 25 Jul 2021 15:25:24 +0000 (17:25 +0200)]
Release new version 0.39.0

3 months agoImmediately bail out on errors when generating the ISO fails
Michael Prokop [Fri, 16 Jul 2021 16:21:13 +0000 (18:21 +0200)]
Immediately bail out on errors when generating the ISO fails

For example when the file system is (close to) full and trying to
generate the ISO, the $MKISOFS command line fails with exit code 32, but
we continue to operate on the ISO filename with the isohybrid related
actions and might overwrite the ISO by resetting it.

3 months agoProvide information how ISO was generated in file conf/buildinfo.json
Michael Prokop [Wed, 14 Jul 2021 01:09:25 +0000 (03:09 +0200)]
Provide information how ISO was generated in file conf/buildinfo.json

Relevant changes:

* Depend on "jo" tool, used for generating the json output in
  conf/buildinfo.json

* Do not rewrite $SQUASHFS_NAME content, instead handle its fixed output
  format via $fixed_squashfs_name

* Same for $RELEASE_INFO content, handled via $fixed_squashfs_name now

* Always set $SQUASHFS_BINARY if unset, to be able to log
  a proper command line, even if mksquashfs stage gets skipped

FTR: the generated file is accessible on the live system under
/run/live/medium/conf/buildinfo.json

Closes: https://github.com/grml/grml-live/issues/44

3 months agoRelease new version 0.38.5 v0.38.5
Michael Prokop [Tue, 13 Jul 2021 14:03:27 +0000 (16:03 +0200)]
Release new version 0.38.5

3 months agonetboot creation: no longer compress the tarball + only generate sha256 checksum...
Michael Prokop [Tue, 13 Jul 2021 13:44:46 +0000 (15:44 +0200)]
netboot creation: no longer compress the tarball + only generate sha256 checksum file

Compressing the tarball takes several seconds, while there's usually
no change in file size, as pretty much all its files are already
compressed. By no longer compressing the tarball we reduce build time.

Also no longer generated sha1 and sha512 checksum files, we agreed
to only rely on sha256 checksum files nowadays.

Related to https://github.com/grml/grml/issues/120

3 months agoNo longer produce md5, sha1 + sha512 checksums, but only sha256
Michael Prokop [Tue, 13 Jul 2021 13:43:36 +0000 (15:43 +0200)]
No longer produce md5, sha1 + sha512 checksums, but only sha256

We no longer rely on those checksum files and it increases build
time. It should be enough to generate just the sha256 checksum file.

Related to https://github.com/grml/grml/issues/120

3 months agoGRMLBASE/98-clean-chroot: also nuke *.xz files
Michael Prokop [Tue, 13 Jul 2021 13:42:43 +0000 (15:42 +0200)]
GRMLBASE/98-clean-chroot: also nuke *.xz files

Files like /var/log/apt/eipp.log.xz are present nowadays

3 months agoRelease new version 0.38.4 v0.38.4
Michael Prokop [Mon, 12 Jul 2021 07:49:08 +0000 (09:49 +0200)]
Release new version 0.38.4

3 months agoSW: add speedtest-cli to GRML_FULL
Michael Prokop [Mon, 12 Jul 2021 06:38:56 +0000 (08:38 +0200)]
SW: add speedtest-cli to GRML_FULL

FTR: requires only 106 kB of additional disk space

Thanks: Darshaka Pathirana for the suggestion

3 months agoSW: add inxi to GRML_FULL
Michael Prokop [Mon, 12 Jul 2021 06:37:14 +0000 (08:37 +0200)]
SW: add inxi to GRML_FULL

Thanks: Darshaka Pathirana for the suggestion

3 months agoetc/grml/fai/config/files/etc/hosts/GRMLBASE: sync IPv6 entries with Debian
Michael Prokop [Fri, 9 Jul 2021 13:52:45 +0000 (15:52 +0200)]
etc/grml/fai/config/files/etc/hosts/GRMLBASE: sync IPv6 entries with Debian

Quoting from Debian netbase's changelog (see
https://metadata.ftp-master.debian.org/changelogs/main/n/netbase/netbase_6.3_changelog):

| netbase (5.1) unstable; urgency=low
| [...]
| * Removed ip6-localnet and ip6-mcastprefix from the default /etc/hosts
|   created by postinst because they have no purpose. (Closes: #688090)
| [...]
|
| netbase (4.30) unstable; urgency=low
|
|   * On new installs add localhost as an alias for ::1. (Closes: #427067)
| [...]
|
| netbase (4.35) unstable; urgency=low
|
|   * Do not add ff02::3 to /etc/hosts because it is not actually assigned.
|     (Closes: #499800)

FTR: netbase 5.1 pre-dates Debian/jessie AKA oldoldstable (which shipped
netbase 5.3)

Development time sponsored by Sipwise GmbH

3 months agoSW: drop rng-tools from GRMLBASE
Michael Prokop [Fri, 9 Jul 2021 12:20:34 +0000 (14:20 +0200)]
SW: drop rng-tools from GRMLBASE

This was noticed via a dependency on mksh (rng-tools, being a
transitional dummy package nowadays, actually Pre-Depends on mksh).
This saves us ~1,671 kB and we already ship haveged. If we really want
to provide such a feature (to feature an entropy gathering daemon to
support hardware randon number generators), then we should probably look
into rng-tools5 instead.

3 months agoRelease new version 0.38.3 v0.38.3
Michael Prokop [Fri, 9 Jul 2021 07:15:25 +0000 (09:15 +0200)]
Release new version 0.38.3

3 months agoSW: add wireless-regdb to GRML_FULL
Michael Prokop [Fri, 9 Jul 2021 05:31:44 +0000 (07:31 +0200)]
SW: add wireless-regdb to GRML_FULL

Seems to be relevant for certain wireless network devices,
start with shipping it for GRML_FULL (whether it's relevant
for GRML_SMALL to be determined yet).

3 months agoSW: add jq to GRML_FULL
Michael Prokop [Thu, 8 Jul 2021 15:16:31 +0000 (17:16 +0200)]
SW: add jq to GRML_FULL

This is certainly a useful tool that we should include by default

4 months agoRelease new version 0.38.2 v0.38.2
Michael Prokop [Mon, 7 Jun 2021 08:44:34 +0000 (10:44 +0200)]
Release new version 0.38.2

4 months agoSW: drop comgt from GRML_FULL
Michael Prokop [Fri, 4 Jun 2021 10:55:47 +0000 (12:55 +0200)]
SW: drop comgt from GRML_FULL

The comgt package was orphaned in 2021 (see
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=983867) and its last
upload dates back to 2016. It shouldn't really matter in 2021 anymore,
but if it really does then let's find out.

4 months agoSW: drop wvdial from GRML_FULL
Michael Prokop [Fri, 4 Jun 2021 10:43:41 +0000 (12:43 +0200)]
SW: drop wvdial from GRML_FULL

The wvdial package was orphaned in 2018 (see
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=901879) and my
assumption is that Point-to-Point protocols aren't really relevant for
Grml users anymore nowadays. It was requested in 2012 (see commit
9c06220097) for GRML_FULL, but if someone really cares about this in
2021 as well it's time to find out (and then we should discuss whether
it's also relevant for GRML_SMALL?).

Removing wvdial package and its dependencies frees ~2.710 kB of disk space.

4 months agoSW: add firmware-ath9k-htc to GRMLBASE
Michael Prokop [Mon, 31 May 2021 05:30:10 +0000 (07:30 +0200)]
SW: add firmware-ath9k-htc to GRMLBASE

Only ~168kB of additional disk space and required for USB wireless adapters,
and licensed under GPL-2(+)

5 months agoRelease new version 0.38.1 v0.38.1
Michael Prokop [Fri, 7 May 2021 15:49:10 +0000 (17:49 +0200)]
Release new version 0.38.1

5 months agoRefresh lintian overrides to reflect current state
Michael Prokop [Fri, 7 May 2021 15:41:24 +0000 (17:41 +0200)]
Refresh lintian overrides to reflect current state

5 months agoBump Standards-Version to 4.5.1
Michael Prokop [Fri, 7 May 2021 15:36:48 +0000 (17:36 +0200)]
Bump Standards-Version to 4.5.1

6 months agoRevert "grml-live: clean up MIRROR_DIRECTORY if provided."
Michael Prokop [Sat, 24 Apr 2021 21:34:41 +0000 (23:34 +0200)]
Revert "grml-live: clean up MIRROR_DIRECTORY if provided."

This reverts commit c78f58bfee79af61276e3e91457a1b0faa55bbf5.

While deleting the bind-mount destination of mirror directories is fine
in theory, we end up deleting empty base directories as well, which
is unexpected and unwanted behavior.

See https://github.com/grml/grml-live/pull/104 for the related
discussion, this issue needs further attention yet before we can
include this in a new release of grml-live.

6 months agoSW: add ntfs-3g to GRML_SMALL
Michael Prokop [Sat, 24 Apr 2021 10:49:37 +0000 (12:49 +0200)]
SW: add ntfs-3g to GRML_SMALL

FTR: this adds 3,162 kB of additional disk space (mainly due to libfuse2
libgnutls30 dependencies).

Acked-by: Chris Hofstaedtler
Thanks: Evgeni Golov for the suggestion

7 months agoMerge remote-tracking branch 'origin/github/pr/103'
Michael Prokop [Wed, 24 Mar 2021 12:53:44 +0000 (13:53 +0100)]
Merge remote-tracking branch 'origin/github/pr/103'

7 months agogrml-live: clean up MIRROR_DIRECTORY if provided.
Mihai Moldovan [Wed, 24 Mar 2021 11:44:14 +0000 (12:44 +0100)]
grml-live: clean up MIRROR_DIRECTORY if provided.

Be like a ninja.

7 months agoMerge remote-tracking branch 'origin/github/pr/102'
Michael Prokop [Mon, 22 Mar 2021 23:11:11 +0000 (00:11 +0100)]
Merge remote-tracking branch 'origin/github/pr/102'

7 months agogrml-live: fix typo in (e)error command.
Mihai Moldovan [Mon, 22 Mar 2021 22:12:08 +0000 (23:12 +0100)]
grml-live: fix typo in (e)error command.

7 months agoRelease new version 0.38.0 v0.38.0
Michael Prokop [Wed, 10 Mar 2021 16:32:50 +0000 (17:32 +0100)]
Release new version 0.38.0

7 months agoGRMLBASE/01-packages: also detect and report unknown package names
Michael Prokop [Wed, 10 Mar 2021 13:59:50 +0000 (14:59 +0100)]
GRMLBASE/01-packages: also detect and report unknown package names

If FAI doesn't know package names during its dirinstall run, it reports:

| WARNING: These unknown packages are removed from the installation list

... in fai.log and software.log. This happens e.g. if a package was
removed from a Debian repository and is no longer known therefore. What
FAI reports through its install_packages.list are only packages that
were asked for installation *and* exist as such (so not a "unknown
package package"), but failed to install - so this sadly doesn't help
us.

One option would be to set FAI_DISABLE_PACKAGE_NAME_CHECK=1 (which
corresponds to FAI install_packages's -N cmdline option), but then the
installation fails hard with unknown packages, which isn't what we want
as default behavior. But provide this disabled(!) configuration option
in GRMLBASE.var, just in case someone is looking for it.

As a solution for our use case, let's handle this via our existing
GRMLBASE/01-packages script, which checks for missing packages already.
Now we also check FAI's software.log for the 'These unknown packages'
error message and report them via package_errors.log.

This work was funded by Grml-Forensic.

7 months agoGRUB templates: provide menu entry for UEFI Firmware Settings
Michael Prokop [Wed, 10 Mar 2021 13:58:41 +0000 (14:58 +0100)]
GRUB templates: provide menu entry for UEFI Firmware Settings

When running in EFI mode, it's as simple as executing "fwsetup".

Closes: https://github.com/grml/grml-live/issues/101

7 months agoGRUB templates: do not set root/chainloader but just exit for boot from next device
Michael Prokop [Wed, 10 Mar 2021 13:55:23 +0000 (14:55 +0100)]
GRUB templates: do not set root/chainloader but just exit for boot from next device

This pretty much never works for me, while exiting GRUB
switches to the next device in the boot order, so let's
just "exit" GRUB and name the menu entries accordingly.

Closes: https://github.com/grml/grml-live/issues/100

7 months agoUse 1m as new default squashfs block size
Michael Prokop [Wed, 10 Mar 2021 08:29:41 +0000 (09:29 +0100)]
Use 1m as new default squashfs block size

The default block size of mksquashfs is 128k, while we used 256k since 2009.
When increasing the block size further, we increase build time, but also
decrease the file size (and therefore the resulting ISO).

Nowadays rotating media (CD/DVD) aren't so much in usage anymore, while
(USB) flash drives and direct ISO boot (both from disk as well as via
OOB management) are way more common. Latency maybe is no longer so
relevant as it used to be, so let's see if this turns out to be a
problem. On the other side smaller ISOs decrease download times as well
as disk usage (esp. when used as /boot/grml via grml-rescueboot).
Overall it is a trade off that's worth consideration, let's give it a try.

Some non-scientific benchmarks give the following build times:

* block size 256k: 2min 19sec, 383MB
* block size 1m:   3min 30sec, 363MB

Buffer/cache memory usage of the booted ISO slightly increases (91MB
used and 170MB buff/cache with block size 1m, vs. 94MB used and 143MB
buff/cache with block size 256kb), but might be neglectable. (And once
again, this was another non-scientific benchmark.)

Further options that might be worth consideration are 1) -Xdict-size
(while -Xdict-size 100% is the default already, so noting really to do
for us here), and 2) `-Xbcj x86`, which further increases compression
time, but also has a bit of savings.

FTR, Jonathan Carter did some benchmarks related to squashfs in 2015, see
https://jonathancarter.org/2015/04/06/squashfs-performance-testing/.
And Fedora is considering usage of `-b 1M -Xdict-size 1M -no-recovery`
(which would be identical to what we have, note that -no-recovery
doesn't seem to influence file size), see
https://fedoraproject.org/wiki/Changes/OptimizeSquashFS

Thanks: Mihai Moldovan <ionic@ionic.de>

7 months agoGRMLBASE/16-depmod: no longer rely on /boot/System.map-* file
Michael Prokop [Tue, 9 Mar 2021 17:54:09 +0000 (18:54 +0100)]
GRMLBASE/16-depmod: no longer rely on /boot/System.map-* file

The System.map content was moved into Debian's debug package with kernel
5.8.10-1 and newer, see https://salsa.debian.org/kernel-team/linux.git:

| commit 26a6ecc287bdbe56ae5dd4fbbd32c76b57b9e690 (origin/waldi/update-5.8)
| Author: Bastian Blank <bastian.blank@credativ.de>
| Date:   Tue Aug 4 17:19:42 2020 +0200
|
|     Move System.map into debug package

Now it only contains a place holder:

| # cat /boot/System.map-5.10.0-4-amd64
ffffffffffffffff B The real System.map is in the linux-image-<version>-dbg package

Due to this, we get >134k entries like:

| depmod: WARNING: /lib/modules/5.10.0-4-amd64/kernel/arch/x86/events/rapl.ko needs unknown symbol x86_match_cpu

… resulting in a ~16MB log file (FAI's shell.log).

To avoid this, let's skip usage of depmod's `-e -F /boot/System.map-*'.

Note: It's probably not worth checking for 'The real System.map is in
the' inside the /boot/System.map-* file and only if it's not present
then consider using it, given that this string might change over time.

FTR: We usually also don't have the Module.symvers available for usage
with depmod's `-E` option, as the Module.symvers is part of the kernel
source package.

Closes: https://github.com/grml/grml-live/issues/99

7 months agoMerge remote-tracking branch 'origin/github/pr/98'
Michael Prokop [Tue, 9 Mar 2021 17:08:24 +0000 (18:08 +0100)]
Merge remote-tracking branch 'origin/github/pr/98'

7 months agoMerge remote-tracking branch 'origin/github/pr/97'
Michael Prokop [Tue, 9 Mar 2021 17:05:32 +0000 (18:05 +0100)]
Merge remote-tracking branch 'origin/github/pr/97'

7 months agogrml-cheatcodes.txt: reflow, no actual change.
Mihai Moldovan [Mon, 8 Mar 2021 20:24:03 +0000 (21:24 +0100)]
grml-cheatcodes.txt: reflow, no actual change.

7 months agogrml-cheatcodes.txt: update fromiso doc.
Mihai Moldovan [Mon, 8 Mar 2021 20:20:54 +0000 (21:20 +0100)]
grml-cheatcodes.txt: update fromiso doc.

This adds support for file system overrides and makes clear that the
device path prefix is actually optional.

7 months agodocs/grml-live.txt: fix markdown issue, escape *.
Mihai Moldovan [Mon, 8 Mar 2021 17:37:56 +0000 (18:37 +0100)]
docs/grml-live.txt: fix markdown issue, escape *.

Otherwise, the two consecutive asterisks are treated as a
<strong>...</strong> segment, which is not what we mean here.

7 months agogrml-live: isohybrid is the default, reflect that.
Mihai Moldovan [Mon, 8 Mar 2021 14:59:21 +0000 (15:59 +0100)]
grml-live: isohybrid is the default, reflect that.

While isolinux's "manifold" mode was used by default a long time ago,
Grml switched to the isohybrid method in late 2011, mostly due to manifold
being incompatible with UEFI systems.

Documentation and configuration files weren't updated at that time,
though.

Do it now.

7 months agoProvide apt sources.list file to support 'bullseye' as Debian suite
Michael Prokop [Mon, 8 Mar 2021 08:05:06 +0000 (09:05 +0100)]
Provide apt sources.list file to support 'bullseye' as Debian suite

Requires new security.debian.org repository layout quoting from
https://lists.debian.org/debian-devel-announce/2019/07/msg00004.html:

| over the last years we had people getting confused over <suite>-updates
| (recommended updates) and <suite>/updates (security updates).  Starting
| with Debian 11 "bullseye" we have therefore renamed the suite including
| the security updates to <suite>-security.
|
| An entry in sources.list should look like
|
|   deb http://security.debian.org/debian-security bullseye-security main
|
| For previous releases the name will not change.

7 months agoMerge remote-tracking branch 'origin/github/pr/95'
Michael Prokop [Mon, 8 Mar 2021 07:19:33 +0000 (08:19 +0100)]
Merge remote-tracking branch 'origin/github/pr/95'

7 months agoGRUB: drop loopback usage for balder10/FreeDOS.
Mihai Moldovan [Sat, 6 Mar 2021 20:06:00 +0000 (21:06 +0100)]
GRUB: drop loopback usage for balder10/FreeDOS.

Looks like a relic from the bad, old days.

It's certainly not needed any longer, since the initrd16 command can
load the file just fine and newer grub versions are not able to load
compressed files in such a manner, since the length (+2880) refers to
the uncompressed size. Grub will see that the file is smaller than that
and error out. If we were to give it the compressed size, decompression
would fail due to the buffer being too small.

9 months agogrml-cheatcodes.txt: drop trailing whitespace char
Michael Prokop [Fri, 22 Jan 2021 13:13:47 +0000 (14:13 +0100)]
grml-cheatcodes.txt: drop trailing whitespace char

Git-Dch: ignore

9 months agogrml-cheatcodes.txt: fix URL for initramfs-tools manpage
Michael Prokop [Fri, 22 Jan 2021 13:10:29 +0000 (14:10 +0100)]
grml-cheatcodes.txt: fix URL for initramfs-tools manpage

The tool switched section and the URL lead to 404

9 months agogrml-cheatcodes.txt: remove several unsupported boot options
Michael Prokop [Fri, 22 Jan 2021 13:07:00 +0000 (14:07 +0100)]
grml-cheatcodes.txt: remove several unsupported boot options

E.g. in grml-autoconfig commit 0fb27baed a bunch of features
were finally deprecated, so let's remove those here as well
and while it, get rid of some very outdated ones or that
are part of upstream kernel docs anyways.

Also drop the deprecated mem=... docs, with this configuration
we can't even boot nowadays.

9 months agogrml-cheatcodes.txt: document getfile.retries boot option
Michael Prokop [Fri, 22 Jan 2021 13:00:56 +0000 (14:00 +0100)]
grml-cheatcodes.txt: document getfile.retries boot option

This is useful, when the netscript boot option was specified but
times out before network is available.

9 months agoRelease new version 0.37.2 v0.37.2
Michael Prokop [Fri, 22 Jan 2021 11:01:25 +0000 (12:01 +0100)]
Release new version 0.37.2

9 months agoMerge remote-tracking branch 'origin/github/pr/94'
Michael Prokop [Fri, 22 Jan 2021 10:43:16 +0000 (11:43 +0100)]
Merge remote-tracking branch 'origin/github/pr/94'

9 months agoinitramfs-tools: use upstream's xz handling to support multithreading
Michael Prokop [Fri, 22 Jan 2021 09:59:28 +0000 (10:59 +0100)]
initramfs-tools: use upstream's xz handling to support multithreading

initramfs-tools versions >=0.136 support multithreading in
xz compression usage (see upstream commit 41d9ceb3).

While at it fix header comment, to refer to the actual
script (which was renamed in commit 6e778099).

FTR: we're still using xz (and not using e.g. zstd) because
it still seems to be the combination of small file size
*and* decompression speed now that we have multithreading
support (though zstd might be an interesting option in the future),
also see https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=976054

10 months agoGRUB: remove erroneous quotes around kernelopts
Michael Lass [Sun, 27 Dec 2020 17:20:27 +0000 (18:20 +0100)]
GRUB: remove erroneous quotes around kernelopts

kernelopts are used by grml-rescueboot to communicate kernel arguments
from the host's grub to the grub within the grml ISO. E.g., the host
grub boot entry will contains something like:

    kernelopts=" arg1 arg2 blacklist=foo etc "
    export kernelopts

Currently, grub within the grml ISO will pass this entire string as one
single argument to the kernel. Remove the quotes such that the arguments
are interpreted as intended.

Fixes https://github.com/grml/grml-rescueboot/issues/5

14 months agoRelease new version 0.37.1 v0.37.1
Michael Prokop [Tue, 25 Aug 2020 09:49:56 +0000 (11:49 +0200)]
Release new version 0.37.1

14 months agoUpdate lintian-overrides for new EFI boot files
Michael Prokop [Tue, 25 Aug 2020 09:48:32 +0000 (11:48 +0200)]
Update lintian-overrides for new EFI boot files

Fixup for commit 518eb395d865 where templates/EFI/BOOT/ was
split into templates/EFI/debian/BOOT/ + templates/EFI/ubuntu/BOOT/

14 months agoAdd bsdmainutils to DEBORPHAN whitelist
Michael Prokop [Wed, 12 Aug 2020 21:44:15 +0000 (23:44 +0200)]
Add bsdmainutils to DEBORPHAN whitelist

Fixes Jenkins issue:

| Package bsdmainutils is missing

14 months agoSecure Boot: update grubx64.efi.signed to fix BootHole issue
Michael Prokop [Wed, 12 Aug 2020 15:24:08 +0000 (17:24 +0200)]
Secure Boot: update grubx64.efi.signed to fix BootHole issue

Fixes the BootHole, see https://www.debian.org/security/2020/dsa-4735 +
https://www.openwall.com/lists/oss-security/2020/07/29/3 +
https://eclypsium.com/2020/07/29/theres-a-hole-in-the-boot/

14 months agoSW: add mmdebstrap to GRML_FULL + GRML_SMALL
Michael Prokop [Sun, 2 Aug 2020 11:07:32 +0000 (13:07 +0200)]
SW: add mmdebstrap to GRML_FULL + GRML_SMALL

It requires only ~250kB of disk space and it's much faster
than debootstrap and we plan to use it as default within
grml-debootstrap anyway.

Thanks: Helmut Grohne for the suggestion

15 months agoRelease new version 0.37.0 v0.37.0
Michael Prokop [Sat, 18 Jul 2020 20:12:00 +0000 (22:12 +0200)]
Release new version 0.37.0

15 months ago/e/n/i: move sourcing of /etc/network/interfaces.d/ to begin of file
Michael Prokop [Sat, 18 Jul 2020 14:03:58 +0000 (16:03 +0200)]
/e/n/i: move sourcing of /etc/network/interfaces.d/ to begin of file

netcardconfig doesn't properly handle this section and it disappears
when configuring network devices then.

Rewriting netcardconfig is on our agenda (see
https://github.com/grml/grml-network/issues/11), until we get there
let's make sure the status quo works as good as possible.

Take over wording based on what ifupdown's postinst script uses.

15 months agoSW: add grub-efi-amd64-signed + shim-signed to GRML_FULL (AMD64 only)
Michael Prokop [Sat, 18 Jul 2020 11:05:23 +0000 (13:05 +0200)]
SW: add grub-efi-amd64-signed + shim-signed to GRML_FULL (AMD64 only)

This adds support for EFI PXE boot support via grml-terminalserver.

While they are part of the depends in grml-terminalserver, they aren't
strictly needed (alternative depends), so ensure we have those packages
available OOTB for EFI based PXE boot with grml-terminalserver.

15 months agoProvide setup files for EFI boot in netboot package
Michael Prokop [Fri, 17 Jul 2020 22:19:12 +0000 (00:19 +0200)]
Provide setup files for EFI boot in netboot package

The shim + grubnetx64 files need to be available via tftp,
using for example a dhcpd configuration which includes:

| # UEFI boot with DHCPv4
| option architecture-type code 93 = unsigned integer 16;
|
| subnet 10.42.42.0 netmask 255.255.255.0 {
|   next-server 10.42.42.2;
|   range 10.42.42.100 10.42.42.200;
|
|   class "pxeclients" {
|     match if substring (option vendor-class-identifier, 0 ,9) = "PXEClient";
|     if option architecture-type = 00:07 {
|       filename "shim.efi";
|     } else {
|       filename "pxelinux.0";
|     }
|   }
| }

... or a dnsmasq configuration which includes:

| domain-needed
| bogus-priv
| expand-hosts
| domain=foobar.example.org
| dhcp-range=10.42.42.100,10.42.42.200,6h
| dhcp-option=1,255.255.255.0  # subnet mask
| dhcp-option=3,10.42.42.1     # default gateway
| dhcp-option=6,10.42.42.2     # domain name server
| dhcp-option=28,10.42.42.255  # broadcast address
| dhcp-option=42,10.42.1.3     # timeserver preference
| dhcp-option=252,"\n"         # proxy config
| dhcp-match=BIOS,option:client-arch,0
| dhcp-boot=tag:BIOS,pxelinux.0
| dhcp-match=UEFI,option:client-arch,7
| dhcp-match=UEFI,option:client-arch,9
| dhcp-boot=tag:UEFI,shim.efi
| dhcp-leasefile=/var/lib/misc/dnsmasq.leases
| dhcp-authoritative

or quoting from  https://wiki.ubuntu.com/UEFI/SecureBoot/PXE-IPv6:

| dhcp-boot=pxelinux.0
| dhcp-match=set:efi-x86_64,option:client-arch,7
| dhcp-boot=tag:efi-x86_64,bootx64.efi

Then EFI boot via PXE with GRUB is supposed to work fine,
while pxelinux provides PXE boot for BIOS based systems.

This is related to the EFI boot support within grml-terminalserver,
see commit 3154dc (`Support UEFI PXE boot with DHCPv4`).

This work was funded by Grml-Forensic.

15 months agoGRUB: don't display BIOS only addons when running in EFI mode
Michael Prokop [Fri, 17 Jul 2020 20:03:41 +0000 (22:03 +0200)]
GRUB: don't display BIOS only addons when running in EFI mode

There's no point in displaying the BIOS only addons when
running in EFI mode.

This work was funded by Grml-Forensic.

Closes: https://github.com/grml/grml/issues/113

15 months agoSupport EFI capable ipxe.efi boot addon
Michael Prokop [Fri, 17 Jul 2020 20:02:22 +0000 (22:02 +0200)]
Support EFI capable ipxe.efi boot addon

15 months agoBe more verbose about boot addons installation
Michael Prokop [Fri, 17 Jul 2020 20:01:46 +0000 (22:01 +0200)]
Be more verbose about boot addons installation

Otherwise it's a bit unclear whether the boot addons get installed

15 months agoSupport usage of boot/addons via symlink to corresponding git repository
Michael Prokop [Fri, 17 Jul 2020 19:57:46 +0000 (21:57 +0200)]
Support usage of boot/addons via symlink to corresponding git repository

It's annoying when you are running grml-live from the git repository,
as the installed grml-live-addons package doesn't matter then,
because the templates are pointing to the git repository.
This can be handled via a symlink, support its usage and mention
it in the docs.

15 months agoStore logfiles also when FAI's dirinstall fails
Michael Prokop [Fri, 10 Jul 2020 11:31:45 +0000 (13:31 +0200)]
Store logfiles also when FAI's dirinstall fails

With the ongoing bsdmainutils transition grml32-small_sid failed
to build and we don't have any log files for debugging in our jenkins
builds. Ensure to store logfiles also when the fai dirinstall run
failed.

15 months agoscripts/GRMLBASE/52-mdadm: unconditionally clear 64-md-raid-assembly.rules
Michael Prokop [Fri, 10 Jul 2020 09:14:57 +0000 (11:14 +0200)]
scripts/GRMLBASE/52-mdadm: unconditionally clear 64-md-raid-assembly.rules

Similar to what we did in commit 31cd53a8b for LVM,
if /lib/udev/rules.d/64-md-raid-assembly.rules was removed by a
prior run of the unpatched script,
the patched script will fail to create the placeholder file.

This work was funded by Grml-Forensic.

16 months agoRelease new version 0.36.0 v0.36.0
Michael Prokop [Wed, 24 Jun 2020 09:35:13 +0000 (11:35 +0200)]
Release new version 0.36.0

16 months agoRefresh Secure Boot support, supporting new 'debian' method
Michael Prokop [Fri, 19 Jun 2020 13:10:56 +0000 (15:10 +0200)]
Refresh Secure Boot support, supporting new 'debian' method

Secure Boot mode wasn't reliably working, e.g. failing to boot in EFI
mode with disabled Secure Boot, but also hard to debug.

Now with our move from our own Grml kernel packages to the official
Debian kernel ones (which are signed and intended for usage with enabled
Secure Boot) it makes sense to support a proper Secure Boot chain
without hacks like we used to do (like relying on and old GRUB binary
from Ubuntu which supported booting unsigned kernels).

We do NOT enable Secure Boot support by default *yet* though, since we
need to get more testing of this and right now we're in the middle of an
RC version (2020.06-rc1) and the upcoming new stable version of Grml.

Relevant changes:

* minimize templates/secureboot/grub.cfg: while it's certainly nice
  to display only entries that are actually working under Secure Boot,
  it's annoying to have to maintain yet another place of boot menus.

  Also if something fails with detection of Secure Boot then it's annoying
  to have to debug this, instead let's display an error message, inform
  the user about it and ask for debugging information.

  Instead introduce a new GRUB theme (/boot/grub/grml-theme/sb-theme.txt)
  which displays a message that we're running in Secure Boot mode.
  While at it, unify indention in existing /boot/grub/grml-theme/theme.txt.

* move templates/EFI/BOOT towards templates/EFI/ubuntu/BOOT/ to be able
  to support debian and ubuntu methods at the same time

* ship GRUB binaries in templates/EFI/debian/, similar to the ones in
  templates/EFI/ubuntu

* switch Ubuntu's grubx64.efi.signed from grubx64.efi.signed to gcdx64.efi.signed;
  they differ in what GRUB's $prefix variable is set to:
  * gcdx64.efi.signed uses boot/grub/
  * grubx64.efi.signed uses EFI/ubuntu/
  -> the code in grml-live itself was adjusted accordingly and this also
  enables us to generalize the Secure Boot methods debian + ubuntu to
  use the same code path

* drop templates/boot/grub/grmlenv.cfg: everything what's relevant
  can be taken care of from inside templates/secureboot/grub.cfg,
  so let's avoid another indirection.

  We also moved the detection of Secure Boot into templates/secureboot/grub.cfg
  and reworked it: while Ubuntu's patches have a C function grub_efi_secure_boot(),
  there's no ready-to-use way to detect Secure Boot. But the wrmsr
  command is amongst the list of GRUB's disabled_mods and we can
  distingiush between exit code 18 (wrong invocation/argument usage) and 30 (Secure Boot forbits loading module).

* mention secure boot method in execution prompt/summary to be aware of
  its (non) presence ahead of execution

* update etc/grml/grml-live.conf to properly reflect current state of
  Secure Boot support

Thanks: Jordan Uggla for feedback

This work was funded by Grml-Forensic.

16 months agoSW: add qrencode to GRML_SMALL and GRML_FULL
Michael Prokop [Mon, 15 Jun 2020 18:28:45 +0000 (20:28 +0200)]
SW: add qrencode to GRML_SMALL and GRML_FULL

It adds only 166 kB of additional disk space and it's certainly
useful to use `echo ... | qrencode -t ANSI` also on the plain
console (that's why I went for the "shell" section in GRML_FULL).

16 months agoSW: add tmate to GRML_SMALL + GRML_FULL
Michael Prokop [Mon, 15 Jun 2020 18:23:27 +0000 (20:23 +0200)]
SW: add tmate to GRML_SMALL + GRML_FULL

Adds 1,293 kB of additional disk space.

16 months agoDo not depend on /proc for calculating runtime
Michael Prokop [Fri, 5 Jun 2020 15:44:41 +0000 (17:44 +0200)]
Do not depend on /proc for calculating runtime

For example when running grml-live inside a docker
environment, /proc doesn't necessarily exist.
Instead use seconds since the epoch as base for calculating runtime.

Development time sponsored by Sipwise GmbH

16 months agoRelease new version 0.35.4 v0.35.4
Michael Prokop [Fri, 5 Jun 2020 11:34:09 +0000 (13:34 +0200)]
Release new version 0.35.4

16 months agoAdjust layout of "Predictable Network Interface Names" boot option
Michael Prokop [Fri, 5 Jun 2020 11:30:59 +0000 (13:30 +0200)]
Adjust layout of "Predictable Network Interface Names" boot option

* We use lowercase naming in GRUB
* The help text inside syslinux shouldn't be too long to fit
  on the screen

16 months agoMerge remote-tracking branch 'origin/github/pr/88'
Michael Prokop [Fri, 5 Jun 2020 11:28:27 +0000 (13:28 +0200)]
Merge remote-tracking branch 'origin/github/pr/88'

16 months agoAdd boot option pnet (Predictable Network Interface Names)
Darshaka Pathirana [Wed, 3 Jun 2020 16:13:16 +0000 (18:13 +0200)]
Add boot option pnet (Predictable Network Interface Names)

We plan to use Predictable Network Interface Names by default.

To make that switch easier we added a new boot option "pnet".

The kernel command line option "net.ifnames=0" is currently in every
boot option (except "pnet") but should be removed when Predictable
Network Interface Names works for us.

See: grml/grml#127

16 months agoRelease new version 0.35.3 v0.35.3
Michael Prokop [Wed, 3 Jun 2020 14:48:09 +0000 (16:48 +0200)]
Release new version 0.35.3

16 months agoNo longer refer to sources.grml.org
Michael Prokop [Wed, 3 Jun 2020 14:30:07 +0000 (16:30 +0200)]
No longer refer to sources.grml.org

sources.grml.org was relevant until we switched to building
the source archives directly from within grml-live (around 2012).

While at it fix some styling issues in the LICENSE file.

16 months agoUse debootstrap with --no-merged-usr by default
Michael Prokop [Wed, 3 Jun 2020 14:14:39 +0000 (16:14 +0200)]
Use debootstrap with --no-merged-usr by default

By default debootstrap creates systems with /usr being merged, leading
to issues like the xfsdump issue we saw in
https://github.com/grml/grml-live/issues/85, also dpkg -S ... and
further commands break with /usr being merged.

It's possible to generate custom basefiles with debootstrap, but by
default we should invoke debootstrap with the --no-merged-usr option,
otherwise we might have different ISO layouts, depending on whether we
use appropriate basefiles (as on our offical build host) vs. locally.

Closes: grml/grml-live#86

17 months agoGRMLBASE/98-clean-chroot: avoid warning messages with resolvconf <1.80
Michael Prokop [Fri, 29 May 2020 12:57:56 +0000 (14:57 +0200)]
GRMLBASE/98-clean-chroot: avoid warning messages with resolvconf <1.80

In commit acf12d4123bd68f we got rid of /etc/resolvconf/run, and while
resolvconf >=1.80 no longer uses /etc/resolvconf/run, older
versions of resolvconf still use it in their libc update hook script. :-/

So while it really works e.g. on Debian/buster (as documented in
commit acf12d4123bd68f) with resolvconf v1.79, there's an ugly:

| /etc/resolvconf/update.d/libc: Warning: /etc/resolv.conf is not a symbolic link to /etc/resolvconf/run/resolv.conf" for resolvconf versions

message when invoking "dhclient". Try to avoid this.

Related to https://github.com/grml/grml/issues/142

17 months agoSW: add wireguard to GRML_FULL
Michael Prokop [Thu, 28 May 2020 15:50:50 +0000 (17:50 +0200)]
SW: add wireguard to GRML_FULL

Since we no longer ship ipsec-tools + racoon, it might be nice to include wireguard instead.

Current state in Debian:

wireguard  | 1.0.20200513-1~bpo10+1 | buster-backports       | source, all
wireguard  | 1.0.20200513-1~bpo10+1 | buster-backports-debug | source
wireguard  | 1.0.20200513-1         | testing                | source, all
wireguard  | 1.0.20200513-1         | unstable               | source, all
wireguard  | 1.0.20200513-1         | unstable-debug         | source

17 months agoRelease new version 0.35.2 v0.35.2
Michael Prokop [Thu, 28 May 2020 15:34:49 +0000 (17:34 +0200)]
Release new version 0.35.2

17 months agoetc/network/interfaces/GRMLBASE: support /etc/network/interfaces.d/* in /e/n/i
Michael Prokop [Thu, 28 May 2020 12:30:00 +0000 (14:30 +0200)]
etc/network/interfaces/GRMLBASE: support /etc/network/interfaces.d/* in /e/n/i

For example cloud-init writes its network configuration file to
/etc/network/interfaces.d/50-cloud-init, so the file needs
to be sourced.

Related to https://github.com/grml/grml/issues/124

17 months agoSW: add avahi-utils to GRML_FULL
Michael Prokop [Tue, 26 May 2020 15:27:10 +0000 (17:27 +0200)]
SW: add avahi-utils to GRML_FULL

Useful to have e.g. avahi-browse available, adds only a few
KB of additional disk space on grml-full, while on grml-small
it would pull in 8,500 kB of additional disk space.

17 months agoRelease new version 0.35.1 v0.35.1
Michael Prokop [Wed, 20 May 2020 15:14:57 +0000 (17:14 +0200)]
Release new version 0.35.1

17 months agoDEBORPHAN/10-whitelist: rework fix for broken keep file handling of deborphan
Michael Prokop [Wed, 20 May 2020 14:10:29 +0000 (16:10 +0200)]
DEBORPHAN/10-whitelist: rework fix for broken keep file handling of deborphan

An empty file doesn't help either, so we need at least a file
with a newline. Given that we're already touching the file
based on its hard-coded filename, let's just append the package
in question and avoid invoking deborphan at all. Especially
as deborphan returns with failure when a package is already
listed:

| deborphan: dnsutils: duplicate entry.

We need to handle this anyway, if grml-live is re-executed on
an existing system (which isn't unusual).

17 months agoDEBORPHAN/10-whitelist: provide workaround for Debian bug #929273
Michael Prokop [Wed, 20 May 2020 13:25:25 +0000 (15:25 +0200)]
DEBORPHAN/10-whitelist: provide workaround for Debian bug #929273

If deborphan's keep file doesn't exist yet, it fails with:

| fseek on /var/lib/deborphan/keep: Invalid argument

While at it, no longer ignore failing deborphan execution
but error out on failure.

17 months agoDEBORPHAN/10-whitelist: highlight when dnsutils gets added to whitelist
Michael Prokop [Wed, 20 May 2020 12:59:32 +0000 (14:59 +0200)]
DEBORPHAN/10-whitelist: highlight when dnsutils gets added to whitelist

Otherwise it's hard to see whether anything was executed at all

17 months agoSW: add fdisk to GRMLBASE
Michael Prokop [Wed, 20 May 2020 12:55:20 +0000 (14:55 +0200)]
SW: add fdisk to GRMLBASE

See Debian #960815 + #947134, it's no longer "Important: yes" and
util-linux >=2.35.1-2 no longer depends on it. To ensure we have
it on all Grml(-based) ISOs, let's add it to GRMLBASE.

17 months agodocs: update ISO sizes and disk requirements, we no longer provide support for file-rc
Michael Prokop [Wed, 20 May 2020 12:40:52 +0000 (14:40 +0200)]
docs: update ISO sizes and disk requirements, we no longer provide support for file-rc

file-rc support is still present, but we won't provide any support
for it and it will be dropped rather soonish, so announce it
accordingly.

17 months agoMove scripts/GRMLBASE/40-deborphan towards DEBORPHAN class as file 10-whitelist
Michael Prokop [Wed, 20 May 2020 12:29:31 +0000 (14:29 +0200)]
Move scripts/GRMLBASE/40-deborphan towards DEBORPHAN class as file 10-whitelist

If the DEBORPHAN class is used before the GRMLBASE class when invoking
grml-live, then any whitelisting executed via
scripts/GRMLBASE/40-deborphan will happen too late, which is not obvious
and surprising. Instead let's move scripts/GRMLBASE/40-deborphan towards
the DEBORPHAN class and name it as "10-whitelist".

17 months agodeborphan: drop deprecated packages
Michael Prokop [Wed, 20 May 2020 11:45:47 +0000 (13:45 +0200)]
deborphan: drop deprecated packages

We don't ship shadowfs + bsdtar since ~2011, libewf1 and
libstdc++2.10-glibc2.2 no longer exist in any supported release,
so let's do some housekeeping.

17 months agodeborphan: add workaround for transitional package dnsutils
Michael Prokop [Wed, 20 May 2020 10:13:09 +0000 (12:13 +0200)]
deborphan: add workaround for transitional package dnsutils

dnsutils became a transitional package with version 1:9.16.2-3 (as
present in current testing (bullseye) and unstable):

| % rmadison dnsutils
| dnsutils   | 1:9.9.5.dfsg-9+deb8u15       | oldoldstable      | amd64, armel, armhf, i386
| dnsutils   | 1:9.10.3.dfsg.P4-12.3+deb9u5 | oldstable         | amd64, arm64, armel, armhf, i386, mips, mips64el, mipsel, ppc64el, s390x
| dnsutils   | 1:9.10.3.dfsg.P4-12.3+deb9u6 | oldstable-new     | amd64, arm64, armel, armhf, i386, mips, mips64el, mipsel, ppc64el, s390x
| dnsutils   | 1:9.11.5.P4+dfsg-5~bpo9+1    | stretch-backports | amd64, arm64, armel, armhf, i386, mips, mips64el, mipsel, ppc64el, s390x
| dnsutils   | 1:9.11.5.P4+dfsg-5.1         | stable            | amd64, arm64, armel, armhf, i386, mips, mips64el, mipsel, ppc64el, s390x
| dnsutils   | 1:9.11.5.P4+dfsg-5.1+deb10u1 | stable-new        | amd64, arm64, armel, armhf, i386, mips, mips64el, mipsel, ppc64el, s390x
| dnsutils   | 1:9.16.2-3                   | testing           | all
| dnsutils   | 1:9.16.2-3                   | unstable          | all

It depends on bind9-dnsutils, which is available only in current testing
(bullseye) and unstable:

| % rmadison bind9-dnsutils
| bind9-dnsutils | 1:9.16.2-3    | testing    | amd64, arm64, armel, armhf, i386, mips64el, mipsel, ppc64el, s390x
| bind9-dnsutils | 1:9.16.2-3    | unstable   | amd64, arm64, armel, armhf, i386, mips64el, mipsel, ppc64el, s390x

If we switch our GRML_FULL package list from dnsutils to
bind9-dnsutils, then we would only support testing (bullseye) and
unstable but not any older release. To avoid this, mark dnsutils
as "keep" in deborphan, so it does not end up in the not_installable
list (and mark failing tests in Jenkins/CI).

17 months agoRelease new version 0.35.0 v0.35.0
Michael Prokop [Tue, 12 May 2020 14:37:03 +0000 (16:37 +0200)]
Release new version 0.35.0