Charles Chou | 15 May 2012 17:24
Favicon

AOE/vblade session shutdown

Hi,
     What is the proper way to gracefully shutdown an AOE session?  I 
have been just killing the vblade processes on the server and rmmod aoe 
on the client but this seems unnatural.

      Also vblade is run as a foreground process as default. To make it 
run as a daemon I had to just put it in background with an & (I need to 
export more than one target). Is this the right way?

     Lastly, where does the vblade log go? Do I need to explicitly do a 
re-direct of stdout/stderr?

Thanks,
Charles Chou

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
Nicolas Jungers | 15 May 2012 18:11

Re: AOE/vblade session shutdown

On 05/15/2012 05:24 PM, Charles Chou wrote:
> Hi,
>       What is the proper way to gracefully shutdown an AOE session?  I
> have been just killing the vblade processes on the server and rmmod aoe
> on the client but this seems unnatural.
>
>        Also vblade is run as a foreground process as default. To make it
> run as a daemon I had to just put it in background with an&  (I need to
> export more than one target). Is this the right way?
>
>       Lastly, where does the vblade log go? Do I need to explicitly do a
> re-direct of stdout/stderr?
>

I suggest that you use vblade-persist instead of vblade. It's a wraper 
around vblade which provides all the facilities you mention.

Regards,
N.

> Thanks,
> Charles Chou
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> _______________________________________________
(Continue reading)

Torbjørn Thorsen | 15 May 2012 18:15
Picon
Favicon

Re: AOE/vblade session shutdown

Hey.

I usually unload the module on the client first, before killing vblade.
AFAIK, you can be pretty sure there will be no more requests to vblade
when the module is unloaded, so shutting down vblade using ctrl-c or a
signal should be fine.

As for keeping vblade running, I really recommend using "service controller",
such as supervisor or upstart.

I'm using supervisor, so I just drop a small configuration file in the
right directory,
and superviser will start and stop vblade when I need it to.
It will also output stdout and stderr from vblade to a file or syslog.

On Tue, May 15, 2012 at 5:24 PM, Charles Chou <cchou@...> wrote:
> Hi,
>     What is the proper way to gracefully shutdown an AOE session?  I
> have been just killing the vblade processes on the server and rmmod aoe
> on the client but this seems unnatural.
>
>      Also vblade is run as a foreground process as default. To make it
> run as a daemon I had to just put it in background with an & (I need to
> export more than one target). Is this the right way?
>
>     Lastly, where does the vblade log go? Do I need to explicitly do a
> re-direct of stdout/stderr?
>
> Thanks,
> Charles Chou
(Continue reading)

Alexandre | 15 May 2012 18:57
Picon
Gravatar

Re: AOE/vblade session shutdown

I usually use aoe-flush to stop using an aoe block device  on a client. Doing so has the great advantage of deleting an exported device from a client and still use others from other target (or not). While unloading the module shuts everything down.
Flushing aoe devices require recent aoe module, won't work on stock Kernel AFAIR.

Le 15 mai 2012 17:38, "Charles Chou" <cchou-+C33oKt33t1GBRGhe+f61g@public.gmane.org> a écrit :
Hi,
    What is the proper way to gracefully shutdown an AOE session?  I
have been just killing the vblade processes on the server and rmmod aoe
on the client but this seems unnatural.

     Also vblade is run as a foreground process as default. To make it
run as a daemon I had to just put it in background with an & (I need to
export more than one target). Is this the right way?

    Lastly, where does the vblade log go? Do I need to explicitly do a
re-direct of stdout/stderr?

Thanks,
Charles Chou

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss@...
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
Simon Kirby | 17 May 2012 01:36
Picon

Re: AOE/vblade session shutdown

On a semi-related note,

I've always wondered why AOE doesn't have an un-advertisment for offlined
luns. Onlining a lun sends out a packet, so why not the reverse.

If any AOE clients have the device open, they can just ignore it like
they currently do anyway (and wait for aoe_deadsecs before kicking up the
failure). The rest could just flush the device and pretend it never
existed.

The current behaviour can be dangerous because certain other typical
tools can stumble over an old lun unexpectly at some later time. For
example, running of "fdisk -l", or UUID scanning when doing HA fail-over,
etc. There are lots of ways to trip on this. We have to also be careful
when making upate luns to go and flush them from all hosts so that they
don't hang later when initiating a fail-over.

I suppose for completeness, the same packet should be sent as a shelf
reboots (or vblade exits), which should be handled the same way by the
clients. This would take care of left-over update luns, too.

Simon-

On Tue, May 15, 2012 at 06:57:21PM +0200, Alexandre wrote:

> I usually use aoe-flush to stop using an aoe block device  on a client.
> Doing so has the great advantage of deleting an exported device from a
> client and still use others from other target (or not). While unloading the
> module shuts everything down.
> Flushing aoe devices require recent aoe module, won't work on stock Kernel
> AFAIR.
> Le 15 mai 2012 17:38, "Charles Chou" <cchou@...> a ?crit :
> 
> > Hi,
> >     What is the proper way to gracefully shutdown an AOE session?  I
> > have been just killing the vblade processes on the server and rmmod aoe
> > on the client but this seems unnatural.
> >
> >      Also vblade is run as a foreground process as default. To make it
> > run as a daemon I had to just put it in background with an & (I need to
> > export more than one target). Is this the right way?
> >
> >     Lastly, where does the vblade log go? Do I need to explicitly do a
> > re-direct of stdout/stderr?
> >
> > Thanks,
> > Charles Chou
> >
> >
> > ------------------------------------------------------------------------------
> > Live Security Virtual Conference
> > Exclusive live event will cover all the ways today's security and
> > threat landscape has changed and how IT managers can respond. Discussions
> > will include endpoint security, mobile security and the latest in malware
> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> > _______________________________________________
> > Aoetools-discuss mailing list
> > Aoetools-discuss@...
> > https://lists.sourceforge.net/lists/listinfo/aoetools-discuss

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
Jesse Becker | 17 May 2012 02:12
Picon

Re: AOE/vblade session shutdown

On Wed, May 16, 2012 at 07:36:32PM -0400, Simon Kirby wrote:
>On a semi-related note,
>
>I've always wondered why AOE doesn't have an un-advertisment for offlined
>luns. Onlining a lun sends out a packet, so why not the reverse.

The protocol seems to include support for this already:
http://support.coraid.com/documents/AoEr11.txt

Section 2.4 ("Error") reads:

    If Flags bit E is set, this field contains an error code defined as
    follows:
       [...]
       Error 3: Device unavailable
       The server can no longer accept ATA commands.
       [...]

>If any AOE clients have the device open, they can just ignore it like
>they currently do anyway (and wait for aoe_deadsecs before kicking up the
>failure). The rest could just flush the device and pretend it never
>existed.
>
>The current behaviour can be dangerous because certain other typical
>tools can stumble over an old lun unexpectly at some later time. For
>example, running of "fdisk -l", or UUID scanning when doing HA fail-over,
>etc. There are lots of ways to trip on this. We have to also be careful
>when making upate luns to go and flush them from all hosts so that they
>don't hang later when initiating a fail-over.
>
>I suppose for completeness, the same packet should be sent as a shelf
>reboots (or vblade exits), which should be handled the same way by the
>clients. This would take care of left-over update luns, too.
>
>Simon-
>
>On Tue, May 15, 2012 at 06:57:21PM +0200, Alexandre wrote:
>
>> I usually use aoe-flush to stop using an aoe block device  on a client.
>> Doing so has the great advantage of deleting an exported device from a
>> client and still use others from other target (or not). While unloading the
>> module shuts everything down.
>> Flushing aoe devices require recent aoe module, won't work on stock Kernel
>> AFAIR.
>> Le 15 mai 2012 17:38, "Charles Chou" <cchou@...> a ?crit :
>>
>> > Hi,
>> >     What is the proper way to gracefully shutdown an AOE session?  I
>> > have been just killing the vblade processes on the server and rmmod aoe
>> > on the client but this seems unnatural.
>> >
>> >      Also vblade is run as a foreground process as default. To make it
>> > run as a daemon I had to just put it in background with an & (I need to
>> > export more than one target). Is this the right way?
>> >
>> >     Lastly, where does the vblade log go? Do I need to explicitly do a
>> > re-direct of stdout/stderr?
>> >
>> > Thanks,
>> > Charles Chou
>> >
>> >
>> > ------------------------------------------------------------------------------
>> > Live Security Virtual Conference
>> > Exclusive live event will cover all the ways today's security and
>> > threat landscape has changed and how IT managers can respond. Discussions
>> > will include endpoint security, mobile security and the latest in malware
>> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
>> > _______________________________________________
>> > Aoetools-discuss mailing list
>> > Aoetools-discuss@...
>> > https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
>
>------------------------------------------------------------------------------
>Live Security Virtual Conference
>Exclusive live event will cover all the ways today's security and
>threat landscape has changed and how IT managers can respond. Discussions
>will include endpoint security, mobile security and the latest in malware
>threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
>_______________________________________________
>Aoetools-discuss mailing list
>Aoetools-discuss@...
>https://lists.sourceforge.net/lists/listinfo/aoetools-discuss

--

-- 
Jesse Becker
NHGRI Linux support (Digicon Contractor)
:(){ :&:};:

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
Charles Chou | 17 May 2012 05:16
Favicon

AOE ports

Hi,
     In the diagram I found below it shows how a 64K IO is broken into 
8x8K blocks and transferred to the AOE target via 4 ports. Can someone 
kindly show me how to configured the AOE to use multiple ports? Thanks!

http://www.millennia.it/images/AoE_delivery.png

Regards,
Charles Chou

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
Alexandre | 17 May 2012 09:29

Re: AOE ports

It depends on the AoE target implementation you're using.

regards.

2012/5/17 Charles Chou <cchou <at> kimberlite.com>
Hi,
    In the diagram I found below it shows how a 64K IO is broken into
8x8K blocks and transferred to the AOE target via 4 ports. Can someone
kindly show me how to configured the AOE to use multiple ports? Thanks!

http://www.millennia.it/images/AoE_delivery.png

Regards,
Charles Chou


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss@...
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
Roland Kletzing | 17 May 2012 11:01
Picon

Re: AOE ports

The blog entry where this picture is from tells, that multiple ports being used automatically:
 
 
 
 

From: Alexandre
Sent: Thursday, May 17, 2012 9:29 AM
Subject: Re: [Aoetools-discuss] AOE ports

It depends on the AoE target implementation you're using.

regards.

2012/5/17 Charles Chou <cchou-+C33oKt33t1GBRGhe+f61g@public.gmane.org>
Hi,
    In the diagram I found below it shows how a 64K IO is broken into
8x8K blocks and transferred to the AOE target via 4 ports. Can someone
kindly show me how to configured the AOE to use multiple ports? Thanks!

http://www.millennia.it/images/AoE_delivery.png

Regards,
Charles Chou


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss@...
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
Charles Chou | 17 May 2012 19:46
Favicon

Re: AOE ports

Hi,
    Yes I do see that. I just don't know how to find out what "all available ports" are and how many, or if this is a configurable parameter.

Thanks,
Charles Chou
On 5/16/2012 11:01 PM, Roland Kletzing wrote:
The blog entry where this picture is from tells, that multiple ports being used automatically:
 
 
 
 

From: Alexandre
Sent: Thursday, May 17, 2012 9:29 AM
Subject: Re: [Aoetools-discuss] AOE ports

It depends on the AoE target implementation you're using.

regards.

2012/5/17 Charles Chou <cchou-+C33oKt33t1GBRGhe+f61g@public.gmane.org>
Hi,
    In the diagram I found below it shows how a 64K IO is broken into
8x8K blocks and transferred to the AOE target via 4 ports. Can someone
kindly show me how to configured the AOE to use multiple ports? Thanks!

http://www.millennia.it/images/AoE_delivery.png

Regards,
Charles Chou


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss


------------------------------------------------------------------------------ Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

_______________________________________________ Aoetools-discuss mailing list Aoetools-discuss-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org https://lists.sourceforge.net/lists/listinfo/aoetools-discuss

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Aoetools-discuss mailing list
Aoetools-discuss@...
https://lists.sourceforge.net/lists/listinfo/aoetools-discuss

Gmane