Opened 3 months ago

Last modified 7 weeks ago

#1008 assigned defect

BCCD v3.4.0-build_ng hangs on boot

Reported by: skylar Owned by: skylar
Priority: major Milestone: 3.4.0-build_ng
Component: Both Version: 3.4.0
Keywords: Cc:
Blocked By: Blocking:
Estimated Hours: 2 Total Hours: 1

Description

systemd issue? hangs at "Regenerate SSH host keys"

Change History (37)

comment:1 Changed 3 months ago by skylar

  • Status changed from new to assigned

try disabling custom BCCD systemd units

comment:2 Changed 3 months ago by skylar

removing BCCD systemd units gets to a different point, or maybe the same point w/o text on the screen

comment:3 Changed 3 months ago by skylar

trying disabling auto-login in /etc/lightdm/lightdm.conf.d/bccd.conf

comment:4 Changed 3 months ago by skylar

trying disabling this line in /etc/inittab:

gdm:5:once:/bin/su bccd -l -c "/bin/bash --login -c startx > /tmp/bccd_x.log 2>&1"

comment:5 Changed 3 months ago by skylar

removing /etc/pam.d/lightdm-autologin

comment:6 Changed 3 months ago by skylar

removing /etc/inittab

comment:7 Changed 3 months ago by skylar

trying booting off simple debootstrap (pre-bccd)

comment:8 Changed 3 months ago by skylar

In 6042//cluster/svnroot:

potential auto-login sources re #1008

comment:9 Changed 3 months ago by skylar

trying to remove /etc/default/rcS

comment:10 Changed 3 months ago by skylar

In 6045//cluster/svnroot:

remove systemd units re #1008

comment:12 Changed 2 months ago by skylar

try w/o bccd package

comment:13 Changed 2 months ago by skylar

In 6046//cluster/svnroot:

test NO_BCCD to disable bccd deb install re #1008

comment:14 Changed 2 months ago by skylar

In 6047//cluster/svnroot:

need to point at different debootstrap tar balls depending on NO_BCCD setting re #1008

comment:15 Changed 2 months ago by skylar

In 6048//cluster/svnroot:

nobccd makefile targets re #1008

comment:16 Changed 2 months ago by skylar

In 6049//cluster/svnroot:

re-add bccd.amd64.iso.md5 target re #1008

comment:17 Changed 2 months ago by skylar

In 6050//cluster/svnroot:

install non-bccd packages re #1008

comment:18 Changed 2 months ago by skylar

In 6051//cluster/svnroot:

only install BCCD_PACKAGES if NO_BCCD is not set re #1008, #1009

comment:19 Changed 2 months ago by skylar

still failing even w/o bccd package installed, so it must be one of the other packages that is being installed...

comment:20 Changed 2 months ago by skylar

going to try to get some kind of login working to examine ssh and xorg error logs

comment:21 Changed 2 months ago by skylar

rebuild in progress: sudo rm -f /var/tmp/bccd.amd64.6045.iso/live/filesystem.squashfs && sudo nice mksquashfs /var/tmp/bccd.amd64.6045.squash/squashfs-root /var/tmp/bccd.amd64.6045.iso/live/filesystem.squashfs && /usr/bin/genisoimage -pad -l -r -J -v -V "BCCDv3-6045-regen" -no-emul-boot -boot-load-size 4 -boot-info-table -b boot/isolinux/isolinux.bin -c boot/isolinux/boot.cat -hide-rr-moved -o /cluster/bccd-ng/testing/skylar/bccd.amd64.6045.regen.iso /var/tmp/bccd.amd64.6045.iso

comment:22 Changed 2 months ago by skylar

things required for booting:

  1. Enter chroot to make valid root account
    1. passwd root
    2. passwd -u root
  2. Rebuild ISO: sudo ~skylar/svnroot/bccd-ng/branches/skylar/bccd-3.4.0-build_ng/bin/regen_iso -i /mnt/disk0/tmp/nobccd.amd64.6051.iso -s /mnt/disk0/tmp/nobccd.amd64.6051.squash/squashfs-root -o /cluster/bccd-ng/testing/skylar/nobccd.amd64.6051.iso -n BCCDv3-340-r6051
  3. Boot into single user mode: /live/vmlinuz 1
    1. Start networking: dhclient eth0
    2. Create sshd user (why is this not already made by openssh-server package?): useradd sshd
    3. Enable root logins in /etc/ssh/sshd_config: PermitRootLogins yes

comment:23 Changed 2 months ago by skylar

in /var/log/daemon.log:

Jul 13 03:20:11 bigfe systemd[1]: getty@tty3.service: Service has no hold-off time, scheduling restart.
Jul 13 03:20:11 bigfe systemd[1]: getty@tty3.service: Scheduled restart job, restart counter is at 5.
Jul 13 03:20:11 bigfe systemd[1]: Stopped Getty on tty3.
Jul 13 03:20:11 bigfe systemd[1]: getty@tty3.service: Start request repeated too quickly.
Jul 13 03:20:11 bigfe systemd[1]: getty@tty3.service: Failed with result 'start-limit-hit'.
Jul 13 03:20:11 bigfe systemd[1]: Failed to start Getty on tty3.
Jul 13 03:20:12 bigfe systemd[1]: getty@tty2.service: Start request repeated too quickly.
Jul 13 03:20:12 bigfe systemd[1]: getty@tty2.service: Failed with result 'start-limit-hit'.
Jul 13 03:20:12 bigfe systemd[1]: Failed to start Getty on tty2.

comment:24 Changed 2 months ago by skylar

lots of complaints about missing user "user" - what if we provide it?

also will set PermitRootLogins and create sshd user

Last edited 2 months ago by skylar (previous) (diff)

comment:25 Changed 2 months ago by skylar

trying BCCD r6045 ISO w/ modifications from above

comment:26 Changed 2 months ago by skylar

In 6053//cluster/svnroot:

only create accounts if they do not already exist re #1008

comment:27 Changed 2 months ago by skylar

are the SSH host keys being generated properly? might need to run dpkg-reconfigure openssh-server

comment:28 Changed 2 months ago by skylar

ssh works in single-user mode, but not after going to multi-user target

going to try providing my own public keys to avoid PAM

comment:29 Changed 2 months ago by skylar

In 6054//cluster/svnroot:

remove bccd key re #1008

comment:30 Changed 2 months ago by skylar

process:

  1. dhclient eth0
  2. dpkg-reconfigure ssh
  3. rm /usr/sbin/policy-rc.d Need to figure out why this is file is present
  4. invoke-rc.d ssh start
Last edited 2 months ago by skylar (previous) (diff)

comment:31 Changed 2 months ago by skylar

going to try removing nvidia package

comment:32 Changed 2 months ago by skylar

In 6055//cluster/svnroot:

remove policy-rc.d after build is complete re #924, #1008

comment:33 Changed 2 months ago by skylar

somehow autologin-user is getting set in /etc/lightdm/lightdm.conf after the live CD boots. The only place where this appears to be possible is in /lib/live/config/0100-lightdm - maybe we can control it by setting live-config.username?

comment:34 Changed 2 months ago by skylar

success! apparently lightdm somehow influences getty in some non-documented way

comment:35 Changed 2 months ago by skylar

In 6056//cluster/svnroot:

setting autologin user to bccd on kernel boot line re #1008

comment:36 Changed 8 weeks ago by skylar

r6056 confirmed to boot, auto-login for bccd at terminal (not X11)

comment:37 Changed 7 weeks ago by skylar

Note: See TracTickets for help on using tickets.