headers
Wendy Cheng | 1 Jun 2008 06:12
Picon

Re: Distributed LVM/filesystem/storage

Jan-Benedict Glaw wrote:
> On Fri, 2008-05-30 09:03:35 +0100, Gerrard Geldenhuis <Gerrard.Geldenhuis <at> datacash.com> wrote:
>   
>> On Behalf Of Jan-Benedict Glaw
>>     
>>> I'm just thinking about using my friend's overly empty harddisks for a
>>> common large filesystem by merging them all together into a single,
>>> large storage pool accessible by everybody.
>>>       
> [...]
>   
>>> It would be nice to see if anybody of you did the same before (merging
>>> the free space from a lot computers into one commonly used large
>>> filesystem), if it was successful and what techniques
>>> (LVM/NBD/DM/MD/iSCSI/Tahoe/Freenet/Other P2P/...) you used to get there,
>>> and how well that worked out in the end.
>>>       
>> Maybe have a look at GFS.
>>     
>
> GFS (or GFS2 fwiw) imposes a single, shared storage as its backend. At
> least I get that from reading the documentation. This would result in
> merging all the single disks via NBD/LVM to one machine first and
> export that merged volume back via NBD/iSCSI to the nodes. In case the
> actual data is local to a client, it would still be first send to the
> central machine (running LVM) and loaded back from there. Not as
> distributed as I hoped, or are there other configuration possibilities
> to not go that route?
>
(Continue reading)

Permalink | Reply | 0 comments |
headers
Jan-Benedict Glaw | 1 Jun 2008 09:07
Picon
Favicon

Re: Distributed LVM/filesystem/storage

On Sat, 2008-05-31 23:12:21 -0500, Wendy Cheng <s.wendy.cheng <at> gmail.com> wrote:
> Jan-Benedict Glaw wrote:
> > On Fri, 2008-05-30 09:03:35 +0100, Gerrard Geldenhuis <Gerrard.Geldenhuis <at> datacash.com> wrote:
> > > On Behalf Of Jan-Benedict Glaw
> > > > I'm just thinking about using my friend's overly empty harddisks for a
> > > > common large filesystem by merging them all together into a single,
> > > > large storage pool accessible by everybody.
> >
> > [...]
> >  
> > > > It would be nice to see if anybody of you did the same before (merging
> > > > the free space from a lot computers into one commonly used large
> > > > filesystem), if it was successful and what techniques
> > > > (LVM/NBD/DM/MD/iSCSI/Tahoe/Freenet/Other P2P/...) you used to get there,
> > > > and how well that worked out in the end.
> > >
> > > Maybe have a look at GFS.
> >
> > GFS (or GFS2 fwiw) imposes a single, shared storage as its backend. At
> > least I get that from reading the documentation. This would result in
> > merging all the single disks via NBD/LVM to one machine first and
> > export that merged volume back via NBD/iSCSI to the nodes. In case the
> > actual data is local to a client, it would still be first send to the
> > central machine (running LVM) and loaded back from there. Not as
> > distributed as I hoped, or are there other configuration possibilities
> > to not go that route?
> 
>                         However, with its symmetric architecture, 
> nothing can prevent it running on top of a group of iscsi disks (with 
> GFS node as initiator), as long as each node can see and access these
(Continue reading)

Permalink | Reply | 0 comments |
headers
Ron Cronenwett | 1 Jun 2008 14:37
Picon

Re: apache resource problem in RHCS 5.1

Hi Lorenz

I had a similar problem while testing with Centos 5.1 on a VMWare
workstation setup. One more difference, I have been using
system-config-cluster
to configure the cluster. Luci seemed to be giving me problems with
setting up a mount of an NFS export. But I have not retried Luci since
changing
the selinux setting I mention below.

I found if I did not configure SELinux with setenforce permissive, the
/usr/share/cluster/apache.sh script did not execute. Once that runs,
it creates
/etc/cluster/apache/apache:"name". In that subdirectory, the script
creates an httpd.conf file from /etc/httpd/httpd.conf. I also found
the new httpd.conf
had the Listen statement commented out even though I had set it to my
clustered address in /etc/httpd/httpd. I needed to manually uncomment
the
Listen statement on each node in /etc/cluster/apache/apache:"name"/httpd.conf.

Hope this helps.

Ron C.

On Thu, May 29, 2008 at 11:22 AM, Lorenz Pfiffner <lp <at> xbe.ch> wrote:
>
> Hello everybody
>
> I have the following test setup:
(Continue reading)

Permalink | Reply | 10 comments |
headers
Wendy Cheng | 1 Jun 2008 15:50
Picon

Re: [linux-lvm] Distributed LVM/filesystem/storage

Jan-Benedict Glaw wrote:
> On Sat, 2008-05-31 23:12:21 -0500, Wendy Cheng <s.wendy.cheng <at> gmail.com> wrote:
>   
>> Jan-Benedict Glaw wrote:
>>     
>>> On Fri, 2008-05-30 09:03:35 +0100, Gerrard Geldenhuis <Gerrard.Geldenhuis <at> datacash.com> wrote:
>>>       
>>>> On Behalf Of Jan-Benedict Glaw
>>>>         
>>>>> I'm just thinking about using my friend's overly empty harddisks for a
>>>>> common large filesystem by merging them all together into a single,
>>>>> large storage pool accessible by everybody.
>>>>>           
>>> [...]
>>>  
>>>       
>>>>> It would be nice to see if anybody of you did the same before (merging
>>>>> the free space from a lot computers into one commonly used large
>>>>> filesystem), if it was successful and what techniques
>>>>> (LVM/NBD/DM/MD/iSCSI/Tahoe/Freenet/Other P2P/...) you used to get there,
>>>>> and how well that worked out in the end.
>>>>>           
>>>> Maybe have a look at GFS.
>>>>         
>>> GFS (or GFS2 fwiw) imposes a single, shared storage as its backend. At
>>> least I get that from reading the documentation. This would result in
>>> merging all the single disks via NBD/LVM to one machine first and
>>> export that merged volume back via NBD/iSCSI to the nodes. In case the
>>> actual data is local to a client, it would still be first send to the
>>> central machine (running LVM) and loaded back from there. Not as
(Continue reading)

Permalink | Reply | 0 comments |
headers
Jan-Benedict Glaw | 1 Jun 2008 17:56
Picon
Favicon

Re: Distributed LVM/filesystem/storage

On Sun, 2008-06-01 08:50:26 -0500, Wendy Cheng <s.wendy.cheng <at> gmail.com> wrote:
> Jan-Benedict Glaw wrote:
> > On Sat, 2008-05-31 23:12:21 -0500, Wendy Cheng <s.wendy.cheng <at> gmail.com> wrote:
> > > Jan-Benedict Glaw wrote:
> > > > On Fri, 2008-05-30 09:03:35 +0100, Gerrard Geldenhuis <Gerrard.Geldenhuis <at> datacash.com> wrote:
> > > > > On Behalf Of Jan-Benedict Glaw
> > > > > > I'm just thinking about using my friend's overly empty harddisks for a
> > > > > > common large filesystem by merging them all together into a single,
> > > > > > large storage pool accessible by everybody.
> > > > [...]
> > > > > > It would be nice to see if anybody of you did the same before (merging
> > > > > > the free space from a lot computers into one commonly used large
> > > > > > filesystem), if it was successful and what techniques
> > > > > > (LVM/NBD/DM/MD/iSCSI/Tahoe/Freenet/Other P2P/...) you used to get 
> > > > > > there, and how well that worked out in the end.
> > > > >
> > > > > Maybe have a look at GFS.
> >
> > So I'd configure each machine's empty disk/partition as an iSCSI
> > target and let them show up an every "client" machine and run that
> > setup. How good will GFS deal with temporary (or total) outage of
> > single targets? Eg. 24h disconnects with ADSL connectivity etc.?
> 
> High availability will not work well in this particular setup - it is 
> more about data and storage sharing between GFS nodes.
> 
> Note that GFS normally runs on top of CLVM (clustered lvm, in case you 
> don't know about it). You might want to check current (Linux) CLVM raid 
> level support to see whether it fits your needs.
(Continue reading)

Permalink | Reply | 0 comments |
headers
Dinesh | 1 Jun 2008 20:08
Picon

rhel5

 


No virus found in this outgoing message.
Checked by AVG Free Edition.
Version: 7.5.516 / Virus Database: 269.24.4/1475 - Release Date: 30/05/2008 14:53

<div>

<div class="Section1">

<p class="MsoNormal"><span><p>&nbsp;</p></span></p>

</div>

<br><p>No virus found in this outgoing message.<br>
Checked by AVG Free Edition.<br>
Version: 7.5.516 / Virus Database: 269.24.4/1475 - Release Date: 30/05/2008 14:53<br> </p>
</div>
Permalink | Reply | 0 comments |
headers
Dinesh Patel | 1 Jun 2008 20:09
Picon
Favicon

rhel5

 


No virus found in this outgoing message.
Checked by AVG Free Edition.
Version: 7.5.516 / Virus Database: 269.24.4/1475 - Release Date: 30/05/2008 14:53

<div>

<div class="Section1">

<p class="MsoNormal"><span><p>&nbsp;</p></span></p>

</div>

<br><p>No virus found in this outgoing message.<br>
Checked by AVG Free Edition.<br>
Version: 7.5.516 / Virus Database: 269.24.4/1475 - Release Date: 30/05/2008 14:53<br> </p>
</div>
Permalink | Reply | 0 comments |
headers
doobs72 _ | 1 Jun 2008 20:12
Picon
Favicon

rhel5


Get 5GB of online storage for free! Get it Now! 
<div>
<br>Get 5GB of online storage for free! <a href="http://clk.atdmt.com/UKM/go/msnnkmgl0010000005ukm/direct/01/" target="_new">Get it Now! </a>
</div>
Permalink | Reply | 0 comments |
headers
doobs72 _ | 1 Jun 2008 21:33
Picon
Favicon

RHEL5.0 Cluster fencing problems involving bonding

Hi

 

 I’m having fencing problems in my 3 node cluster running on RHEL5.0 which involves bonding.

 

I have 3 severs A, B & C in a cluster with bonding configured on eth2 & eth3 for my cluster traffic.  The config is as below:

 

DEVICE=eth2

BOOTPROTO=none

ONBOOT=yes

TYPE=Ethernet

MASTER=bond1

SLAVE=yes

USRCTL=no

 

DEVICE=eth3

BOOTPROTO=none

ONBOOT=yes

TYPE=Ethernet

MASTER=bond1

SLAVE=yes

USRCTL=no

 

 

DEVICE=bond1

IPADDR=192.168.x.x

NETMASK=255.255.255.0

NETWORK=192.168.x.0

BROADCAST=192.168.x.255

ONBOOT=YES

BOOTPROTO=none

 

The /etc/modprobe.conf file is configured as below:

 

alias eth0 bnx2

alias eth1 bnx2

alias eth2 e1000

alias eth3 e1000

alias eth4 e1000

alias eth5 e1000

alias scsi_hostadapter cciss

alias bond0 bonding

options bond0 miimon=100 mode=active-backup max_bonds=3

alias bond1 bonding

options bond1 miimon=100 mode=active-backup

alias bond2 bonding

options bond2 miimon=100 mode=active-backup

alias scsi_hostadapter1 qla2xxx

alias scsi_hostadapter2 usb-storage

 

 

The cluster starts up OK, however when I try to test the bonded interfaces my troubles begin.

On Node C if I "ifdown bond1", the node C, is fenced and everything works as expected.

 

However if on Node C, I take down the interfaces one at a time i.e. 

 "ifdown  eth2", - the cluster stays up as expected using eth3 for routing traffic  

  "ifdown eth3" 

then node C is fenced by Node A. However in the /var/log/messages file on Node C I see a message saying that Node B will be fenced. The outcome is Nodes C & B are fenced.

 

My question is why does node B get fenced as well?

 

 

 D.

 

 

 

 
Get fish-slapping on Messenger! Play Now 
<div>
<p class="MsoNormal"><span lang="EN-GB">Hi</span></p>
<p class="MsoNormal"><span lang="EN-GB"></span>&nbsp;</p>
<p class="MsoNormal"><span lang="EN-GB">&nbsp;I&rsquo;m having fencing problems in my 3 node cluster running on RHEL5.0&nbsp;which involves bonding.<p></p></span></p>
<p class="MsoNormal"><span lang="EN-GB"><p>&nbsp;</p></span></p>
<p class="MsoNormal"><span lang="EN-GB">I have 3 severs A, B &amp; C in a cluster<span>&nbsp;</span>with bonding configured on eth2 &amp; eth3 for my cluster traffic. <span>&nbsp;</span>The config is as below:</span></p>
<p class="MsoNormal"><span lang="EN-GB"></span>&nbsp;</p>
<span lang="EN-GB">
<p class="MsoNormal"><span lang="EN-GB">DEVICE=eth2</span></p>
<p class="MsoNormal"><span lang="EN-GB">BOOTPROTO=none</span></p>
<p class="MsoNormal"><span lang="EN-GB">ONBOOT=yes</span></p>
<p class="MsoNormal"><span lang="EN-GB">TYPE=Ethernet</span></p>
<p class="MsoNormal"><span lang="EN-GB">MASTER=bond1</span></p>
<p class="MsoNormal"><span lang="EN-GB">SLAVE=yes</span></p>
<p class="MsoNormal"><span lang="EN-GB">USRCTL=no</span></p>
<p class="MsoNormal"><span lang="EN-GB"><p>&nbsp;</p></span></p>
<p class="MsoNormal"><span lang="EN-GB">DEVICE=eth3</span></p>
<p class="MsoNormal"><span lang="EN-GB">BOOTPROTO=none</span></p>
<p class="MsoNormal"><span lang="EN-GB">ONBOOT=yes</span></p>
<p class="MsoNormal"><span lang="EN-GB">TYPE=Ethernet</span></p>
<p class="MsoNormal"><span lang="EN-GB">MASTER=bond1</span></p>
<p class="MsoNormal"><span lang="EN-GB">SLAVE=yes</span></p>
<p class="MsoNormal"><span lang="EN-GB">USRCTL=no</span></p>
<p class="MsoNormal">&nbsp;</p>
<p class="MsoNormal">&nbsp;</p>
<p class="MsoNormal">DEVICE=bond1</p>
<p class="MsoNormal">IPADDR=192.168.x.x</p>
<p class="MsoNormal">NETMASK=255.255.255.0</p>
<p class="MsoNormal">NETWORK=192.168.x.0</p>
<p class="MsoNormal">BROADCAST=192.168.x.255</p>
<p class="MsoNormal">ONBOOT=YES</p>
<p class="MsoNormal">BOOTPROTO=none</p>
<p class="MsoNormal">&nbsp;</p>
<p class="MsoNormal"><span lang="EN-GB">The /etc/modprobe.conf file is configured as below:</span></p>
<p class="MsoNormal"><span lang="EN-GB"><p>&nbsp;</p></span></p>
<p class="MsoNormal"><span lang="EN-GB">alias eth0 bnx2</span></p>
<p class="MsoNormal"><span lang="EN-GB">alias eth1 bnx2</span></p>
<p class="MsoNormal"><span lang="EN-GB">alias eth2 e1000</span></p>
<p class="MsoNormal"><span lang="EN-GB">alias eth3 e1000</span></p>
<p class="MsoNormal"><span lang="EN-GB">alias eth4 e1000</span></p>
<p class="MsoNormal"><span lang="EN-GB">alias eth5 e1000</span></p>
<p class="MsoNormal"><span lang="EN-GB">alias scsi_hostadapter cciss</span></p>
<p class="MsoNormal"><span lang="EN-GB">alias bond0 bonding</span></p>
<p class="MsoNormal"><span lang="EN-GB">options bond0 miimon=100 mode=active-backup max_bonds=3</span></p>
<p class="MsoNormal"><span lang="EN-GB">alias bond1 bonding</span></p>
<p class="MsoNormal"><span lang="EN-GB">options bond1 miimon=100 mode=active-backup</span></p>
<p class="MsoNormal"><span lang="EN-GB">alias bond2 bonding</span></p>
<p class="MsoNormal"><span lang="EN-GB">options bond2 miimon=100 mode=active-backup</span></p>
<p class="MsoNormal"><span lang="SV">alias scsi_hostadapter1 qla2xxx<p></p></span></p>
<p class="MsoNormal"><span lang="SV">alias scsi_hostadapter2 usb-storage<p></p></span></p>
<p class="MsoNormal"><span lang="SV"><p>&nbsp;</p></span></p>
<p class="MsoNormal"><span lang="SV"><p>&nbsp;</p></span></p>
<p class="MsoNormal"><span lang="EN-GB">The cluster starts up OK, however when I try to test the bonded interfaces my troubles begin.</span></p>
<p class="MsoNormal"><span lang="EN-GB">On Node C if I "ifdown bond1", the node C, is fenced and everything works as expected.</span></p>
<p class="MsoNormal"><span lang="EN-GB"></span>&nbsp;</p>
<p class="MsoNormal"><span lang="EN-GB">However if on Node C, I take down the interfaces one at a time i.e.&nbsp;</span></p>
<p class="MsoNormal"><span lang="EN-GB">&nbsp;"ifdown<span>&nbsp; </span>eth2", - the cluster stays up as expected using eth3 for routing traffic&nbsp;</span><span lang="EN-GB">&nbsp;</span></p>
<p class="MsoNormal"><span lang="EN-GB">&nbsp; "ifdown eth3"&nbsp;</span></p>
<p class="MsoNormal"><span lang="EN-GB">then node C is fenced&nbsp;by Node A. However in the /var/log/messages file on Node C I see a message saying that Node B will be fenced. The outcome is Nodes C &amp; B are fenced. </span></p>
<p class="MsoNormal"><span lang="EN-GB"><p>&nbsp;</p></span></p>
<p class="MsoNormal"><span lang="EN-GB">My question is why does node B get fenced as well?</span></p>
<p class="MsoNormal"><span lang="EN-GB"></span>&nbsp;</p>
<p class="MsoNormal"><span lang="EN-GB"></span>&nbsp;</p>
<p class="MsoNormal"><span lang="EN-GB"><p>&nbsp;D.</p></span></p>
<p class="MsoNormal">
</p>
<p class="MsoNormal">&nbsp;</p>
<p class="MsoNormal">&nbsp;</p>
<p class="MsoNormal">&nbsp;</p>
<p class="MsoNormal"></p></span>&nbsp;<br>Get fish-slapping on Messenger! <a href="http://clk.atdmt.com/UKM/go/msnnkmgl0010000008ukm/direct/01/" target="_new">Play Now</a>
</div>
Permalink | Reply | 1 comment |
headers
S. Zachariah Sprackett | 2 Jun 2008 06:48
Favicon
Gravatar

Announcing Perl bindings for libcman

Hello,

I'd like to announce the availability of my Perl bindings for libcman.

You can grab them from here:

http://zac.sprackett.com/cman/cluster-cman-0.01.tar.gz

A simple example script would be as follows:

use Cluster::CMAN;

my $cman = new Cluster::CMAN();
$cman->init();

foreach ($cman->get_nodes) {
    print "Found a node: " . $_->{name} ."\n";
}

print "Cluster is"
   . ($cman->is_quorate() ? "" : " NOT") . " quorate!\n";

$cman->finish();

These bindings also fully support both the notification and recv_data
callbacks allowing you to take advantage of them from within perl.

Please let me know if you have any trouble with them.

-z

<div><p>Hello,<br><br>I'd like to announce the availability of my Perl bindings for libcman.<br><br>You can grab them from here:<br><br><a href="http://zac.sprackett.com/cman/cluster-cman-0.01.tar.gz">http://zac.sprackett.com/cman/cluster-cman-0.01.tar.gz</a><br><br>A simple example script would be as follows:<br><br>use Cluster::CMAN;<br><br>my $cman = new Cluster::CMAN();<br>$cman-&gt;init();<br><br>foreach ($cman-&gt;get_nodes) {<br>&nbsp;&nbsp;&nbsp; print "Found a node: " . $_-&gt;{name} ."\n";<br>
}<br><br>print "Cluster is"<br>&nbsp;&nbsp; . ($cman-&gt;is_quorate() ? "" : " NOT") . " quorate!\n";<br><br>$cman-&gt;finish();<br><br>These bindings also fully support both the notification and recv_data <br>
callbacks allowing you to take advantage of them from within perl.<br><br>Please let me know if you have any trouble with them.<br><br>-z<br></p></div>
Permalink | Reply | 1 comment |

Gmane