headers
Prentice Bisbal | 1 Nov 2011 16:31
Favicon

Re: Users abusing screen

IAS is definitely interesting place. I'll have to look up Dima in the
directory.

On 10/28/2011 07:16 PM, Peter St. John wrote:
> Prentice,
> No, I didin't mean to imply anything specific about e.g. your budget,
> but IAS has a fantastic reputation.
> Say hi to Dima for me, he plays Go and is an algebraic geometer
> visiting this year.
> Peter
>
> On Fri, Oct 28, 2011 at 6:21 PM, Prentice Bisbal <prentice <at> ias.edu
> <mailto:prentice <at> ias.edu>> wrote:
>
>
>     On 10/28/2011 04:56 PM, Peter St. John wrote:
>     > I think Greg is right on the money. Particularly at a place like
>     IAS,
>     > where resources are good and users may be errant but are doing great
>     > things,
>
>     Have you been a visitor, member or staff member at IAS?
>
>     --
>     Prentice
>     _______________________________________________
>     Beowulf mailing list, Beowulf <at> beowulf.org
>     <mailto:Beowulf <at> beowulf.org> sponsored by Penguin Computing
>     To change your subscription (digest mode or unsubscribe) visit
>     http://www.beowulf.org/mailman/listinfo/beowulf
(Continue reading)

Permalink | Reply | 0 comments |
headers
Douglas Eadline | 1 Nov 2011 22:42
Favicon

Exascale Breakfast

I have nothing to say about screen, but I do want to
mention I will be moderating a breakfast panel discussion on
the push toward exascale at SC11 this year. It is sponsored
but Panasas and SICORP. Here are the details

  http://www.clustermonkey.net//content/view/314/1/

Does an Exascale Breakfast mean lots of food?

And, the Beobash announcement is imminent!
Monday November 14th 9PM. Traditional witty invite to
arrive soon.

--
Doug

--

-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.
Permalink | Reply | 2 comments |
headers
Bill Broadley | 2 Nov 2011 03:10
Picon

HP redstone servers

The best summary I've found:
http://www.theregister.co.uk/2011/11/01/hp_redstone_calxeda_servers/

Specifications at for the ECX-1000:
http://www.calxeda.com/products/energycore/ecx1000/techspecs

And EnergyCard:
http://www.calxeda.com/products/energycards/techspecs

The only hint on price that I found was from theregister.co.uk:
 The sales pitch for the Redstone systems, says Santeler, is that a
 half rack of Redstone machines and their external switches
 implementing 1,600 server nodes has 41 cables, burns 9.9 kilowatts,
 and costs $1.2m.

So it sounds like for 6 watts and $750 you get a quad core 1.4 GHz arm
10G connected node.

Comments?
Permalink | Reply | 4 comments |
headers
Prentice Bisbal | 2 Nov 2011 14:10
Favicon

Re: Exascale Breakfast


On 11/01/2011 05:42 PM, Douglas Eadline wrote:
> I have nothing to say about screen, 

I have  a feeling that 10 years from now, I'm still going to be getting
shit about this.

--
Prentice
Permalink | Reply | 0 comments |
headers
Douglas Eadline | 3 Nov 2011 12:53
Favicon

2011 BeoBash


You asked for it, here it is:

  http://www.xandmarketing.com/beobash11/

I have one request, if you work for a company that
is not already a sponsor, please ask them to
consider helping with the event. It is a community
party with lots of visibility and promotion.
Please have them contact Lara at lara <at> xandmarketing.com
as soon as possible.

Since we have grown so big, if we do not get enough sponsors
we may have to limit the attendees -- something we
do not want to do.

Give a little, get a lot...

And, a big thank you to the sponsors!

--
Doug

--

-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.
Permalink | Reply | 0 comments |
headers
Vincent Diepeveen | 7 Nov 2011 00:01
Picon
Picon
Favicon

building Infiniband 4x cluster questions

hi,

There is a lot of infiniband 4x stuff on ebay now. Most interesting  
for me to buy some and toy with it. However i have not much clue
about infiniband as it always used to be 'out of my pricerange'. So  
looking for som expert advice here. A few questions:

Now i assume what i need is: bunch of cards, copper cables, and a  
switch, and a big dosis of luck.

There is a lot of cards on ebay with 2 ports.
10 gbit  + 10 gbit.

Do i need to connect both to the same switch?
So in short with infiniband you lose 2 ports  of the switch to 1  
card, is that correct?

CARDS:
Do all switches work with all cards?
Can you mix the many different cards that are out there of 4x  
infiniband?
If not, can you mix from mellanox the different cards theirs? So mix  
from 1 manufacturer cards?

SOCKET 1155:
Do the cards work for socket 1155 if it's pci-e versions? (of course  
watercooled nodes each)

Is there a limit on how much RAM the machine can have? (referring to  
the famous 4GB limit of the QM400 cards of quadrics)
(Continue reading)

Permalink | Reply | 26 comments |
headers
John Hearns | 7 Nov 2011 12:10

Re: building Infiniband 4x cluster questions

Vincent,
I cannot answer all of your questions.
I have a couple of answers:

Regarding MPI, you will be looking for OpenMPI

You will need a subnet manager running somewhere on the fabric.
These can either run on the switch or on a host.
If you are buying this equipment from eBay I would imagine you will be
running the Open Fabrics subnet manager
on a host on your cluster, rather than on a switch.
I might be wrong - depends if the switch has a SM license.
Permalink | Reply | 11 comments |
headers
Eugen Leitl | 7 Nov 2011 12:35

Re: building Infiniband 4x cluster questions

On Mon, Nov 07, 2011 at 11:10:50AM +0000, John Hearns wrote:
> Vincent,
> I cannot answer all of your questions.
> I have a couple of answers:
> 
> Regarding MPI, you will be looking for OpenMPI
> 
> You will need a subnet manager running somewhere on the fabric.
> These can either run on the switch or on a host.
> If you are buying this equipment from eBay I would imagine you will be
> running the Open Fabrics subnet manager
> on a host on your cluster, rather than on a switch.
> I might be wrong - depends if the switch has a SM license.

Assuming ebay-sourced equipment, what price tag
are we roughly looking at, per node, assuming small 
(8-16 nodes) cluster sizes?

--

-- 
Eugen* Leitl <a href="http://leitl.org">leitl</a> http://leitl.org
______________________________________________________________
ICBM: 48.07100, 11.36820 http://www.ativel.com http://postbiota.org
8B29F6BE: 099D 78BA 2FD3 B014 B08A  7779 75B0 2443 8B29 F6BE
Permalink | Reply | 1 comment |
headers
Robert Horton | 7 Nov 2011 12:44
Picon

Re: building Infiniband 4x cluster questions

Hi,

Most of what I know about Infiniband came from the notes at
http://www.hpcadvisorycouncil.com/events/switzerland_workshop/agenda.php
(or John Hearns in his previous life!).

On Mon, 2011-11-07 at 00:01 +0100, Vincent Diepeveen wrote:
> Do i need to connect both to the same switch?
> So in short with infiniband you lose 2 ports  of the switch to 1  
> card, is that correct?

You probably want to just connect one port to a switch and leave the
other one unconnected to start with.

> CARDS:
> Do all switches work with all cards?
> Can you mix the many different cards that are out there of 4x  
> infiniband?
> If not, can you mix from mellanox the different cards theirs? So mix  
> from 1 manufacturer cards?

They will (or at least should) all work to a point but depending on what
combination you are using you may not get some features. If you want an
easy life keep it all from the same manufacturer

> Does infiniband 4x work for x64 machines?

The 4x bit is the number of links aggregated together. 4x is normal for
connections from a switch to a node, higher numbers are sometimes used
for inter-switch links. You also need to note the data rate (eg SDR,
(Continue reading)

Permalink | Reply | 8 comments |
headers
Vincent Diepeveen | 7 Nov 2011 15:28
Picon
Picon
Favicon

Re: building Infiniband 4x cluster questions

hi John,

I had read already about subnet manager but i don't really understand  
this, except when it's only configuration tool.

I assume it's not something that's critical in terms of bandwidth, it  
doesn't need nonstop bandwidth from the machine & switch is it?

In case of a simple cluster consisting out of 1 switch with some  
nodes attached, is it really a problem?

On Nov 7, 2011, at 12:10 PM, John Hearns wrote:

> Vincent,
> I cannot answer all of your questions.
> I have a couple of answers:
>
> Regarding MPI, you will be looking for OpenMPI
>
> You will need a subnet manager running somewhere on the fabric.
> These can either run on the switch or on a host.
> If you are buying this equipment from eBay I would imagine you will be
> running the Open Fabrics subnet manager
> on a host on your cluster, rather than on a switch.
> I might be wrong - depends if the switch has a SM license.
> _______________________________________________
> Beowulf mailing list, Beowulf <at> beowulf.org sponsored by Penguin  
> Computing
> To change your subscription (digest mode or unsubscribe) visit  
> http://www.beowulf.org/mailman/listinfo/beowulf
(Continue reading)

Permalink | Reply | 8 comments |

Gmane