Jim Lux | 1 Sep 2007 02:29
Picon
Picon
Favicon

Re: [tt] World's most powerful supercomputer goes online

At 02:21 PM 8/31/2007, Peter St. John wrote:
>I'm imaging this system as a computer, and the headaches of it's 
>operator (the guy who scripted the worm, maybe) whose million nodes 
>are infested by a million hostile users (the refeverse of a users 
>desktop infested by a worm, is a worm's virutual supercomputer 
>infested by users).

I'm sure that the architect sees the value of the Beowulf mailing 
list for such things. After all, we all like a challenge, right? 
Heterogenous hardware configurations, non-deterministic latency 
interconnects with an ever changing topology, configuration 
management issues galore.  By the time we're done, rgb will have to 
add another chapter to his book on building Beowulfs.

 >>So besides preferring to call it a "Virtual Special-purpose 
(mail-bombing) Supercomputer" instead of a "(General purpose) 
Supercomputer" I'd also be skeptical of all performance metrics. If 
you can't measure the number of nodes within an order of magnitude 
then other metrics are perforce dubious.

Well, there IS that, but then, it's more a matter of scale of 
dubiousness rather than whether any sort of single cluster metric is "truth".

>And I'm pretty sure that Deep Blue could beat it at chess, if 
>someone managed to MPI a chess program on Storm Bot. But I"m sure I 
>can't prove it.

Come on.. someone needs to throw down the guantlet. Challenge the 
botnet to a smackdown duel. race for pinks* or something.

(Continue reading)

Douglas Eadline | 1 Sep 2007 04:42

Re: a "microwulf" posted


You may also find the write on ClusterMonkey informative.

http://www.clustermonkey.net//content/view/211/33/

It should be viewable now as we have been experiencing a
2nd degree slashdoting today -- probably hit 15,000 unique
views before the day is over. (the Microwulf press release link on
slashdot has a link to the CM article.)

BTW, the article is pretty much a recipe for building
your own system.

 --
 Doug

> I saw at wiki http://en.wikipedia.org/wiki/Beowulf_%28computing%29 that
> someone posted a link to http://www.calvin.edu/~adams/research/microwulf/,
> a
> nice description of a "microwulf" at Calvin College. It has brief but
> useful
> descriptions of it's design, cost broken down by parts in the Manifest,
> and
> price/performance specs.
> If LLNL is an Epic maybe this is only a limmerick, but it's a witty
> limmerick.
> Peter
>
>
> !DSPAM:46d8450d89171409419350!
(Continue reading)

Chris Samuel | 1 Sep 2007 08:46
Favicon

Re: [AMD64] Gentoo or Fedora

On Sat, 1 Sep 2007, Ed Hill wrote:

> Yet we don't see folks building distros using, say, the PGI or
> Intel or PathScale compilers.  If someone is actually doing that
> (and it works), then please speak up...

http://www.intel.com/pressroom/archive/releases/20040803net.htm

# SAN FRANCISCO, Aug. 3, 2004 - Intel Corporation and Red Flag
# Software Co., Ltd, today announced that Red Flag is the first
# company to use the Intel® C++ Compiler 8.0 for Linux* to compile a
# commercial version of its Linux operating system.  Red Flag used
# Intel's tools to optimize its Red Flag Server 4.1 series products. 

I have no idea if they're still doing it, but given that the Red Flag 
site hasn't had any new news since 2005, I doubt it..

> I have a theory.  Call me a cynical BOFH,

You're a cynical BOFH!

Sorry, couldn't resist..

cheers,
Chris
--

-- 
Christopher Samuel - (03) 9925 4751 - Systems Manager
 The Victorian Partnership for Advanced Computing
 P.O. Box 201, Carlton South, VIC 3053, Australia
VPAC is a not-for-profit Registered Research Agency
(Continue reading)

Chris Samuel | 1 Sep 2007 08:59
Favicon

Re: [tt] World's most powerful supercomputer goes online

On Sat, 1 Sep 2007, Jim Lux wrote:

> The wikipedia didn't say if the P45 is pink, though.

Nope, they seem to be a blueish colour. I'm not up to digging through 
my records for the one I got when I left the UK civil service before 
migrating to Australia, so here's one someone else prepared earlier:

http://www.hmrc.gov.uk/employers/e13-p20(p45).pdf

cheers,
Chris
--

-- 
Christopher Samuel - (03) 9925 4751 - Systems Manager
 The Victorian Partnership for Advanced Computing
 P.O. Box 201, Carlton South, VIC 3053, Australia
VPAC is a not-for-profit Registered Research Agency
Mikhail Kuzminsky | 1 Sep 2007 15:16
Favicon

Re: Reading raw binary files in Fortran (Intel compiler)?

In message from Mark Hahn <hahn <at> mcmaster.ca> (Fri, 31 Aug 2007 
13:29:56 -0400 (EDT)):
>> guessing that my raw binary read trick does not work on Intel 
>>Fortran? Is there
>> another option I need to pass (e.g. perhaps form='binary')?
>
>I haven't looked closely, but have heard that different compilers 
>store array dimensions differently in such cases.

I worked some years ago w/"binary" but *sequential* files - using 
Visual Fortran and ifc (some years ago they was just different ;-)). 
And for successful reading a list of variables (in Linux w/ifc) from 
created in Windows w/cvf "binary" file, as I remember, it was 
necessary to perform some tricks like insertion of dummy variables in 
the list.

Now ifort and cvf are the same compiler, but I don't know how they 
realized 'binary' format :-(

Yours
Mikhail

it was necessary    

>_______________________________________________
>Beowulf mailing list, Beowulf <at> beowulf.org
>To change your subscription (digest mode or unsubscribe) visit 
>http://www.beowulf.org/mailman/listinfo/beowulf

(Continue reading)

Robert G. Brown | 1 Sep 2007 15:23
Gravatar

Re: [tt] World's most powerful supercomputer goes online

On Fri, 31 Aug 2007, Jim Lux wrote:

> At 02:21 PM 8/31/2007, Peter St. John wrote:
>> I'm imaging this system as a computer, and the headaches of it's operator 
>> (the guy who scripted the worm, maybe) whose million nodes are infested by 
>> a million hostile users (the refeverse of a users desktop infested by a 
>> worm, is a worm's virutual supercomputer infested by users).
>
> I'm sure that the architect sees the value of the Beowulf mailing list for 
> such things. After all, we all like a challenge, right? Heterogenous hardware 
> configurations, non-deterministic latency interconnects with an ever changing 
> topology, configuration management issues galore.  By the time we're done, 
> rgb will have to add another chapter to his book on building Beowulfs.

I'm already planning it.  The probable chapter title is "Cluster Wars"
since of course this is a >>terror weapon<<.  Remember, the internet is
the basis of much commerce.  There are any number of tasks one could
assign such a viral bot-cloud cluster for good or evil, but evil (given
the second law of thermodynamics:-) is a lot easier...

Let's see.  RSA and DES and MD5 are considered "probably uncrackable" by
anyone with less than NSA-class resources, but of course this bot-cloud
is several orders of magnitude more powerful than NSA's probable setup.
If we go with the gaudy end of the estimate and give it 10^7
node/members, MDA is done -- one can pretty much crack anything one
could have cracked with the old crypt library, even if one can only test
1 password per second per node -- nearly 10^12 passwords a day.

Similarly lots of other problems become tractible to a brute force
search algorithm when you can displose of order of 20 petaclocks worth
(Continue reading)

Chris Samuel | 1 Sep 2007 15:38
Favicon

Re: Node not answering...

On Fri, 31 Aug 2007, Nestor Waldyd Alvarez Villa wrote:

> mpirun: cannot start a.out on n1: No such file or directory

NFS (or other network/distributed fs) mountpoint not mounted ?

--

-- 
Christopher Samuel - (03) 9925 4751 - Systems Manager
 The Victorian Partnership for Advanced Computing
 P.O. Box 201, Carlton South, VIC 3053, Australia
VPAC is a not-for-profit Registered Research Agency
Jim Lux | 1 Sep 2007 16:38
Picon
Picon
Favicon

Re: [tt] World's most powerful supercomputer goes online

At 06:23 AM 9/1/2007, Robert G. Brown wrote:
>On Fri, 31 Aug 2007, Jim Lux wrote:
>
>Similarly lots of other problems become tractible to a brute force
>search algorithm when you can displose of order of 20 petaclocks worth
>of cycles. (Am I multiplying that out right?  10^7 times 2x10^9 =
>2x10^16, 9 is giga, 12 is tera, 15 is peta.  Yup.  Petacycles.).  Brute
>force searches require minimal IPCs, although I'm sure there are
>interesting problems associated with IPCs and data harvesting when it
>has to be done in "stealth" mode and not lead investigators back to you
>and when you need to make it robust against nodes dropping out (being
>cleaned by their owners) and popping back in (as yet another virus
>propagates).

There is a fair amount of literature on such communications problems. 
For instance, the classic Byzantine Generals problem deals with how 
to reliably communicate through (potentially deliberately) unreliable 
channels.  And if the seamier side of the internet isn't byzantine, what is?

>Then there is denial of service.  Everybody knows that this is an
>attack, but few recognize its potential terror value.  Just remember the
>>>cost<< of some of the countdown viruses of years past.  Some of them
>literally shut down the Internet for close to a day -- clogging all the
>main arteries and switch points until hosts were run down one at a time
>and isolated by their hosting ISPs.  The cost of those incidents in real
>dollars, lost productivity, and human misery was easily a billion
>dollars each (I read estimates that were much higher, but I don't want
>to be hyperbolic so let's stay conservative here).

When speaking or writing of world domination, a bit of hyperbole is 
(Continue reading)

andrew holway | 1 Sep 2007 18:03
Picon

Re: [tt] World's most powerful supercomputer goes online

Does the mass replication of an exploit really constitute a
supercomputer? Has it reached the point where a computing environment
capable of supporting programs is created or is it simply a mechanism
of attack controlled by a human operator?

Andy

On 01/09/07, Jim Lux <James.P.Lux <at> jpl.nasa.gov> wrote:
> At 06:23 AM 9/1/2007, Robert G. Brown wrote:
> >On Fri, 31 Aug 2007, Jim Lux wrote:
> >
> >Similarly lots of other problems become tractible to a brute force
> >search algorithm when you can displose of order of 20 petaclocks worth
> >of cycles. (Am I multiplying that out right?  10^7 times 2x10^9 =
> >2x10^16, 9 is giga, 12 is tera, 15 is peta.  Yup.  Petacycles.).  Brute
> >force searches require minimal IPCs, although I'm sure there are
> >interesting problems associated with IPCs and data harvesting when it
> >has to be done in "stealth" mode and not lead investigators back to you
> >and when you need to make it robust against nodes dropping out (being
> >cleaned by their owners) and popping back in (as yet another virus
> >propagates).
>
> There is a fair amount of literature on such communications problems.
> For instance, the classic Byzantine Generals problem deals with how
> to reliably communicate through (potentially deliberately) unreliable
> channels.  And if the seamier side of the internet isn't byzantine, what is?
>
>
>
> >Then there is denial of service.  Everybody knows that this is an
(Continue reading)

Robert G. Brown | 2 Sep 2007 17:38
Gravatar

Re: [tt] World's most powerful supercomputer goes online

The following is yet another in a long line of:

<r(ant, )b(y )g(od! offtopic_index=99 amusement_index=-1>

and can be skipped by the terminally busy...;-)

On Sat, 1 Sep 2007, Ellis Wilson wrote:

> My own "solution" to this is pretty draconian -- a "final solution" of
> sorts.  I would legislate an "acceptable use agreement" for the Internet
> at the federal level (to be used for state models as well).  It would
> not be worded to compromise the rights to free speech, it would leave
> pornography mostly alone (tempting a prize as that would be to idiot
> lawmakers) and would focus strictly on the issues above that are clearly
> attacks and which clearly cost a fortune.
> -----------
>
> I personally feel that attempting to establish which actions online
> are within the realm of attacks is a job that will be unfortunately held
> (and run poorly) by human beings.  Perhaps in the beginning all will be
> well, and indeed free speech will continue to reign.  However, I would
> not at all be suprised if the entire system went awry and some federal
> body (I presume you are making this argument American centered, which
> also presents an interesting thought:  America filters "acceptable"
> action on the net; China anyone?) decides to waver from its obviously
> unbiased stance and attempt to benefit a company moreso than another.
>
> Take this example.  Let's say such an agreement was established at the
> "beginning of the internet" (yes, I know, I'm young :).  One of the
> markets that seriously suffered (I'm talking billions here too) was term
(Continue reading)


Gmane