Opened 11 years ago

Closed 10 years ago

#427 closed enhancement (fixed)

Look into 64-bit distribution

Reported by: skylar Owned by: skylar
Priority: minor Milestone:
Component: Both Version:
Keywords: Cc:
Blocked By: Blocking:
Estimated Hours: 0 Total Hours: 64.92

Description

request from class

Attachments (1)

bccd.pkgs.bz2 (43.4 KB) - added by skylar 11 years ago.
List of BCCD apt packages

Download all attachments as: .zip

Change History (90)

Changed 11 years ago by skylar

List of BCCD apt packages

comment:1 Changed 11 years ago by skylar

  • Owner changed from somebody to skylar
  • Status changed from new to assigned

making backup copy of apt-mirror to bs0-new to test reducing size of 32-bit repo to make room for 64-bit repo

comment:2 Changed 11 years ago by skylar

apt-move is looking promising, restoring from backup

comment:3 Changed 11 years ago by skylar

Ran into Debian bug 462165 on bigfe, manually upgraded dpkg and then applying the rest of the updates

comment:4 Changed 11 years ago by skylar

trying to revive bigfe

comment:5 Changed 11 years ago by skylar

finished reviving, copying over apt-spool from edu-grid for testing

comment:6 Changed 11 years ago by skylar

trying to get package list to delete

comment:7 Changed 11 years ago by skylar

I might just use Paul's suggestion to get a list:

For bccd packages, rather than gleening things from the web hits, try

"dpkg --get-selections > installed-packages"

Then, on the 64-bit platform, do a base install (or debian-bootstrap) then issue:

dpkg --set-selections < installed-packages apt-get dselect-upgrade

comment:8 Changed 11 years ago by skylar

looks like it might work, but need bigfe on BCCD VLAN

comment:9 Changed 11 years ago by skylar

trying to fetch testing distro using "apt-move mirror"

comment:11 Changed 11 years ago by skylar

posting to LOPSA for hints

comment:12 Changed 11 years ago by skylar

looking into reprepro

comment:13 Changed 11 years ago by skylar

testing reprepro on bigfe:

  • Imported debian-archive-keyring
  • Dumped keys with "gpg --with-colons --list-keys" and took the Lenny key and FTP Master keys for VerifyRelease?
  • reprepro -b /var/spool/reprepro update lenny

comment:14 Changed 11 years ago by skylar

switching to debian.osuosl.org from indiana.edu due to 503 errors

comment:15 Changed 11 years ago by skylar

testing build on bigfe with reprepro repo

comment:16 Changed 11 years ago by skylar

still missing deb files (e.g. nfs-common, binutils)

comment:17 Changed 11 years ago by skylar

made new branch

still need to figure out reprepro

comment:18 Changed 11 years ago by skylar

some tweaking has gotten us pretty close, need to make sure /sys is mounted for fuse

comment:19 Changed 11 years ago by skylar

test ISO built, now have to setup VirtualBox on bigfe

comment:20 Changed 11 years ago by skylar

bigfe vbox working

comment:21 Changed 11 years ago by skylar

no amd-v on bigfe so no 64-bit guests in virtualbox

comment:22 Changed 11 years ago by skylar

running into trouble with unknown-block device errors with 64-bit ISO, and not all the init scripts are available on the 32-bit ISO

comment:23 Changed 11 years ago by skylar

architecture mismatch in both 32- and 64-bit branches

comment:24 Changed 11 years ago by skylar

rebuilt 32- and 64-bit kernels taking care that the modules don't mix

next up: figure out why the init scripts are messed up

comment:25 Changed 11 years ago by skylar

fixing branch

comment:26 Changed 11 years ago by skylar

trying to figure out why bccd-nics isn't getting run during boot, putting debugging code in

comment:27 Changed 11 years ago by skylar

something up with bccd-nic-setup; it never runs the dialog

comment:28 Changed 11 years ago by skylar

it looks like this might be a problem with bccd-nic-probe not loading the right drivers

comment:29 Changed 11 years ago by skylar

modules.dep was not giving the right paths, fixed in r2271

comment:30 Changed 11 years ago by skylar

64-bit distro still doesn't work, lots of errors in boot-up

comment:31 Changed 11 years ago by skylar

adding busybox to 64-bit initrd for debugging

comment:32 Changed 11 years ago by skylar

looks like there's ELF issues, using strace to try to pin them down

comment:33 Changed 11 years ago by skylar

somehow the wrong branch info got merged in again

comment:34 Changed 11 years ago by skylar

still looking at exec format errors, no progress so far

comment:35 Changed 11 years ago by skylar

seeing if disabling selinux helps

comment:36 Changed 11 years ago by skylar

  • Component set to Both

selinux isn't the culprit

comment:37 Changed 11 years ago by skylar

going to try to install libc-i386 for a 32-bit /lib/ld-linux.so interpreter

comment:38 Changed 11 years ago by skylar

finally figured out that we need /emul linked in minirt, which at least gets us pointed at the 32-bit ld.so

trying to get 64-bit ld.so available

comment:39 Changed 11 years ago by skylar

playing around with DYNLOADER, need to make sure uname is available via busybox

comment:40 Changed 11 years ago by skylar

fixing up PATH, making sure all paths are relative and including /bbin

comment:41 Changed 11 years ago by skylar

still some linker and module problems, but can get to a login prompt

comment:42 Changed 11 years ago by skylar

adding fixes in r2335, building new ISO

comment:43 Changed 11 years ago by skylar

still can't load kernel modules, appears to be a path problem with modprobe

comment:44 Changed 11 years ago by skylar

networking fixed in r2340, now need to merge long list of bug fixes

comment:45 Changed 11 years ago by skylar

setting up architecture-specific trees for modules

comment:46 Changed 10 years ago by skylar

now need to merge 32- and 64-bit branches

comment:47 Changed 10 years ago by skylar

starting to merge, need to figure out build_livecd

comment:48 Changed 10 years ago by skylar

added arch-specific code to build_livecd

comment:49 Changed 10 years ago by skylar

final touchups in r2410 and r2411

comment:50 Changed 10 years ago by skylar

might be stuff in build_livecd.pl that needs to be merged

comment:51 Changed 10 years ago by skylar

need to figure out linker problems again

comment:52 Changed 10 years ago by skylar

need to make cloop.ko and probably minirt managed through trees/arch

comment:53 Changed 10 years ago by skylar

got cloop working, now have to get linuxrc working

comment:54 Changed 10 years ago by skylar

adding 64-bit modules and automation to minirt in r2434

comment:55 Changed 10 years ago by skylar

minirt needs symlinks for bbin as svn does not support hard links

comment:56 Changed 10 years ago by skylar

for some reason the modules needed for minirt are not in /lib/modules, investigating

comment:57 Changed 10 years ago by skylar

64-bit auto build boots properly in r2453

comment:58 Changed 10 years ago by skylar

merging in update-rc.d changes in r2458

comment:59 Changed 10 years ago by skylar

need to figure out why bccd-nic-probe isn't setting up nics

comment:60 Changed 10 years ago by skylar

need to fix paths in modules.dep and modules.order - now just have a few module unknown symbol errors a total clean and rebuild should solve

comment:61 Changed 10 years ago by skylar

fixing 64-bit kernel in r2465

comment:62 Changed 10 years ago by skylar

apparently newer debians have depmods that don't create the absolute paths that modprobe in the BCCD requires

we'll have to build on BCCD systems for now

trying to figure out why 64-bit liberation does not work

comment:63 Changed 10 years ago by skylar

It appears that the new Debians have a different initramfs script structure than the BCCD. Namely LVM support is not included. Remedying

mke2fs needed fixing

comment:64 Changed 10 years ago by skylar

udev command changes:

udevsettle -> udevadm settle udevtrigger -> udevadm trigger

comment:65 Changed 10 years ago by skylar

rebuilding kernel, manual intervention needed

comment:66 Changed 10 years ago by skylar

fixed blkid again - running 32-bit build and then the 64-bit build

comment:67 Changed 10 years ago by skylar

64-bit pxe nodes see unfiltered fstab - investigate what's different from 32-bit

comment:68 Changed 10 years ago by skylar

figured out reverse ssh forwarding for t-voc vbox consoles

comment:69 Changed 10 years ago by skylar

everything seems to be working now, will test some more and generate ISOs for public consumption later

comment:70 Changed 10 years ago by skylar

openmpi is incompatible - seeing if there's a libc compat library

comment:71 Changed 10 years ago by skylar

bccd@node000:~/Life$ make mpicc -I/bccd/software/mpe-1.9.1/include/ -I/bccd/software/intelcc-11.0.074/include/ -I/bccd/software/openmpi-1.4.0/include/ -I/bccd/software/fftw-3.1.2/include/ -I/bccd/software/cuda-2.3/include/ -c -o Life.o Life.c mpicc -o Life Life.c -L/usr/X11R6/lib -lX11 -lm /usr/bin/ld: skipping incompatible /bccd/software/openmpi-1.4.0/lib/libmpi.so when searching for -lmpi /usr/bin/ld: cannot find -lmpi collect2: ld returned 1 exit status make: * [Life] Error 1

comment:72 Changed 10 years ago by skylar

adding libc6-dev-i386 and ia32-libs for 64-bit compatibility

comment:73 Changed 10 years ago by skylar

adding support for modules in X

seeing why Life no longer works

comment:74 Changed 10 years ago by skylar

0.7 hours logged for skylar: still trying to get mpich2 to work

comment:75 Changed 10 years ago by skylar

0.5 hours logged for skylar: tested both 32-bit and 64-bit builds and they work fine

comment:76 Changed 10 years ago by skylar

Life works fine in 32-bit mode, test liberation tomorrow

comment:77 Changed 10 years ago by skylar

0.5 hours logged for skylar: life tests fine

comment:78 Changed 10 years ago by skylar

1.0 hours logged for skylar: cloop module not in test ISOs - investigate once bigfe is back online

comment:79 Changed 10 years ago by skylar

0.8 hours logged for skylar: making sure USB stuff works

comment:80 Changed 10 years ago by skylar

0.5 hours logged for skylar: fixed module typo and regenerated isos

comment:81 Changed 10 years ago by skylar

can't replicate Life errors w/o bccd-syncdir - trying it w/ bccd-syncdir now

comment:82 Changed 10 years ago by skylar

1.0 hours logged for skylar: done with latest round of testing - see emails

comment:83 Changed 10 years ago by skylar

1.0 hours logged for skylar: need fitz's auto-mpd code from r2157

comment:84 Changed 10 years ago by skylar

0.3 hours logged for skylar: is this good now?

comment:85 Changed 10 years ago by skylar

1.0 hours logged for skylar: need to update subversion, which requires updates to httpd and trac

comment:86 Changed 10 years ago by skylar

2.0 hours logged for skylar: big merge done, still doing clean up, need to figure out why linux kernel doesn't end up in KNOPPIX

comment:87 Changed 10 years ago by skylar

1.3 hours logged for skylar: merging in other tickets this one depends on (#389, #338, #504)

comment:88 Changed 10 years ago by skylar

3.0 hours logged for skylar: getting close, just have to fix up some typos in iptables

comment:89 Changed 10 years ago by skylar

  • Resolution set to fixed
  • Status changed from assigned to closed
Note: See TracTickets for help on using tickets.