Run code for --remove-configs before unmounting chroot