John Klos | 1 Nov 2002 01:54

Distributing bulk package building (was mac68k Packages for 1.6)

Hi,

> How about it:  Another distributed computing project, kindof a
> bin-builds <at> home...
>
> How tough a programming job would it be, to write a perl script/ daemon
> that would let a central server assign compilation tasks, and collect
> the results when done?  Those of us who are not too concerned about
> security, could let our boxes join the project.

This is something that I've talked about with a number of other people
about. Some framework for this is already in place, but it'd have a number
of requirements on the client end.

Namely, we imagined that it'd have to be secure, so it couldn't just be
anonymous. Therefore, ssh keys would need to be exchanged between the
server and clients. The clients would have to be responsible for
contacting the server when they are available for more work, as many
machines might be behind IP NAT or on non-static connections.

Disk space would be necessary, as doing bulk builds requires a
specifically set up environment which would make a typical machine not
very useful. Therefore, a chrooted environment would be recommended on any
machine that is not going to be dedicated to only doing bulk builds.

The work on the client end is pretty much done; there's very little logic
there. The client, when run, contacts the server, is told what package to
build, auto-fetches any binary packages on which the package is dependent,
builds the package, uses scp to copy back the finished binary package,
then asks for another package. If the server doesn't have anything, the
(Continue reading)

Bryan Vyhmeister | 1 Nov 2002 02:52

SE/30 Kernel Problems

After spending all that time compiling my kernel, the SE/30 just  
freezes after the "So I sez to him..." quote. I am attaching my kernel  
config and dmesg. Any ideas what could be wrong? I would experiment and  
try more things but it takes so long to compile I figured I would ask  
here first.

Bryan

#	$NetBSD: GENERICSBC,v 1.17.4.1 2002/08/01 04:24:41 lukem Exp $
#
# SE30SBC

include	"arch/mac68k/conf/std.mac68k"

options 	INCLUDE_CONFIG_FILE	# embed config file in kernel binary

ident 		SE30SBC

maxusers	16		# estimated number of users

# CPU support.  At least one is REQUIRED.
#options 	M68040
options 	M68030
#options 	M68020		# Note:  must have 68851 PMMU

# CPU-related options.
options 	FPSP
#options 	FPU_EMULATE

# Standard system options
(Continue reading)

Frederick Bruckman | 1 Nov 2002 04:10

Re: SE/30 Kernel Problems

On Thu, 31 Oct 2002, Bryan Vyhmeister wrote:

> After spending all that time compiling my kernel, the SE/30 just
> freezes after the "So I sez to him..." quote. I am attaching my kernel
> config and dmesg. Any ideas what could be wrong? I would experiment and
> try more things but it takes so long to compile I figured I would ask
> here first.

> # CPU-related options.
> options 	FPSP
> #options 	FPU_EMULATE

NO! Don't use FPSP on a 68030. FPSP is written in assembler that only
runs on a 68040 (a.k.a. 68040X instructions). At best, it's dead
weight; at worst, any practical floating point arithmetic will
eventually lead an overflow, underflow, or NaN result..., and send
you off into lala land.

> options 	COMPAT_43	# and 4.3BSD

Dead weight.

> options 	COMPAT_M68K4K	# compatibility with NetBSD/m68k4k binaries

Really dead weight.

You could also save a lot of compile time, and some memory, by cutting
out the file systems you don't use.

> # XXX - use only one of ncrscsi or sbc
(Continue reading)

Allen Briggs | 1 Nov 2002 04:18

Re: mac68k Packages for 1.6

On Thu, Oct 31, 2002 at 10:11:30PM +0100, Riccardo Mottola wrote:
> - quadra 900/950  (besides, those would be fast macs and useful to
> build&compile, especially as regards of scsi controller) which would help my
> IIfx too

The Q950 works right now, headless.  I'm running one.  The SCSI is using
regular 'esp,' and the serial ports are in compatible mode.  The IOP
code does need some love and attention, though, if anyone's interested
in working on it.  I'd really like to, but I really can't find the time.
:-(

> - a better color X support? i wasn't able to build it under 1.5
> - faster SCSI support (DMA) on quadra840

Hey, mrz!  What's up with this?

> IIRC floppy disk isn't working on any mac, but that's a minor priority!

I think it was working for the IWM.  At least a little.  Am I wrong?
Floppies are a pain, anyway...  :-)

-allen

--

-- 
 Allen Briggs                     briggs <at> wasabisystems.com
 http://www.wasabisystems.com/    Quality NetBSD CDs, Sales, Support, Service
NetBSD development for Alpha, ARM, M68K, MIPS, PowerPC, SuperH, XScale, etc...

Bryan Vyhmeister | 1 Nov 2002 03:56

Re: SE/30 Kernel Problems

Right after I sent the original message I noticed the SMALLRAM config.  
Using that I changed my SE30SBC config. Here is the updated SE30SBC  
config and dmesg. Any ideas would be appreciated. I will start  
compiling this about 9:00 PM pacific time if no one answers before  
then. Thanks for all your help.

Bryan

On Thursday, Oct 31, 2002, at 17:52 US/Pacific, Bryan Vyhmeister wrote:

> After spending all that time compiling my kernel, the SE/30 just  
> freezes after the "So I sez to him..." quote. I am attaching my kernel  
> config and dmesg. Any ideas what could be wrong? I would experiment  
> and try more things but it takes so long to compile I figured I would  
> ask here first.
>
> Bryan
>

== SE30SBC config start ==

#	$NetBSD: GENERICSBC,v 1.17.4.1 2002/08/01 04:24:41 lukem Exp $
#
# GENERICSBC

include	"arch/mac68k/conf/std.mac68k"

options 	INCLUDE_CONFIG_FILE	# embed config file in kernel binary

ident 		SE30SBC
(Continue reading)

Bryan Vyhmeister | 1 Nov 2002 03:54

Re: SE/30 Kernel Problems

Right after I sent the original message I noticed the SMALLRAM config.  
Using that I changed my SE30SBC config. Here is the updated SE30SBC  
config and dmesg. Any ideas would be appreciated. I will start  
compiling this about 9:00 PM pacific time if no one answers before  
then. Thanks for all your help.

Bryan

On Thursday, Oct 31, 2002, at 17:52 US/Pacific, Bryan Vyhmeister wrote:

> After spending all that time compiling my kernel, the SE/30 just  
> freezes after the "So I sez to him..." quote. I am attaching my kernel  
> config and dmesg. Any ideas what could be wrong? I would experiment  
> and try more things but it takes so long to compile I figured I would  
> ask here first.
>
> Bryan
>

== SE30SBC config start ==

#	$NetBSD: GENERICSBC,v 1.17.4.1 2002/08/01 04:24:41 lukem Exp $
#
# GENERICSBC

include	"arch/mac68k/conf/std.mac68k"

options 	INCLUDE_CONFIG_FILE	# embed config file in kernel binary

ident 		SE30SBC
(Continue reading)

Frederick Bruckman | 1 Nov 2002 04:36

Re: SE/30 Kernel Problems

On Thu, 31 Oct 2002, Bryan Vyhmeister wrote:

> # Networking options
> #options 	GATEWAY		# packet forwarding
> options 	INET		# IP + ICMP + TCP + UDP
> #options 	INET6		# IPV6

There was a report a while back that kernels wouldn't build without
INET6. I don't know if that's still the case.

Frederick

Frederick Bruckman | 1 Nov 2002 05:00

Re: SE/30 Kernel Problems

On Thu, 31 Oct 2002, Frederick Bruckman wrote:

> On Thu, 31 Oct 2002, Bryan Vyhmeister wrote:
>
> > # Networking options
> > #options 	GATEWAY		# packet forwarding
> > options 	INET		# IP + ICMP + TCP + UDP
> > #options 	INET6		# IPV6
>
> There was a report a while back that kernels wouldn't build without
> INET6. I don't know if that's still the case.

Oh, never mind I said that. INET6 is commented out of the SMALLRAM
kernel that I built.

Frederick

John Klos | 1 Nov 2002 06:16

Re: SE/30 Kernel Problems

Hello,

> After spending all that time compiling my kernel, the SE/30 just
> freezes after the "So I sez to him..." quote. I am attaching my kernel
> config and dmesg. Any ideas what could be wrong? I would experiment and
> try more things but it takes so long to compile I figured I would ask
> here first.

> # Diagnostic/debugging support options
> #options 	DIAGNOSTIC	# cheap kernel consistency checks
> #options 	DEBUG		# expensive debugging checks/support
> options 	KMEMSTATS	# kernel memory statistics (vmstat -m)
> #options 	DDB			# in-kernel debugger
> #options 	DDB_HISTORY_SIZE=100	# enable history editing in DDB

Yes; the booter will not boot a kernel if the debugger is not compiled in.
This is a known bug, and there are already a couple of PRs (14744 and
11267).

Even though it takes up memory, you'll have to put the debugger back...

John Klos
Sixgirls Computing Labs

Bryan Vyhmeister | 1 Nov 2002 08:47

Re: SE/30 Kernel Problems

Thanks so much for all your help. I enabled DDB and disabled FPSP and a 
bunch of filesystems and so forth. The compile is working now and will 
hopefully be done tomorrow morning. Thank you for your time.

Bryan


Gmane