Eric Shubert | 19 Aug 2011 17:24
Favicon

[tagcose] Fwd: Re: Will the SATA drivers in IPCop V2.0 support TRIM?

Interesting stuff regarding running on USB/SSD drives.

-------- Original Message --------
Subject: Re: Will the SATA drivers in IPCop V2.0 support TRIM?
Date: Thu, 18 Aug 2011 23:59:36 -0700
From: David W Studeman <dwstudeman@...>
To: ipcop-user@...
Newsgroups: gmane.comp.security.ipcop.user
References: <4E4CFE31.4040804 <at> mindspring.com> 
<CAAxQi-895idMdT=XKgKXHhf_mu_PNPHRzdq-s04v9Bauwvvxug <at> mail.gmail.com>

On 8/18/2011 9:22 AM, Bao Ha wrote:
> On Thu, Aug 18, 2011 at 4:57 AM, ftarz@...
> <ftarz@...>wrote:
>
>> I don't want to start a war of words, but just ask if the SATA drivers
>> in the IPCop V2.0 kernel will provide TRIM support.  I'm thinking of
>> building a small low power, fanless IPCop box and a small, recycled SSD
>> would help keep the heat down.  Does anyone know if an SSD is a good idea?
>>
>> Yes and No.
>
> SSD is flash memory and is subject to wear and tear.
>
> To use SSD successfully, you would not put the swap and on it.  You would
> also try not to do caching or proxy.
>
> You would also need to use these options for the root filesystem in the
> /etc/fstab:
>
(Continue reading)

Dwayne Haught | 19 Aug 2011 17:35
Picon

Re: [tagcose] Fwd: Re: Will the SATA drivers in IPCop V2.0 support TRIM?

I was working on this topic this week. Researching and reading about the most ideal way to handle flash storage. Would you think, for the most part, that USB & SSD can be approached in a similar way?

On Aug 19, 2011 8:25 AM, "Eric Shubert" <ejs <at> shubes.net> wrote:
> Interesting stuff regarding running on USB/SSD drives.
>
> -------- Original Message --------
> Subject: Re: Will the SATA drivers in IPCop V2.0 support TRIM?
> Date: Thu, 18 Aug 2011 23:59:36 -0700
> From: David W Studeman <dwstudeman-ceosCSQIA1M@public.gmane.org>
> To: ipcop-user-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
> Newsgroups: gmane.comp.security.ipcop.user
> References: <4E4CFE31.4040804 <at> mindspring.com>
> <CAAxQi-895idMdT=XKgKXHhf_mu_PNPHRzdq-s04v9Bauwvvxug <at> mail.gmail.com>
>
> On 8/18/2011 9:22 AM, Bao Ha wrote:
>> On Thu, Aug 18, 2011 at 4:57 AM, ftarz-mn4gwa5WIIQysxA8WJXlww@public.gmane.org
>> <ftarz-mn4gwa5WIIQysxA8WJXlww@public.gmane.org>wrote:
>>
>>> I don't want to start a war of words, but just ask if the SATA drivers
>>> in the IPCop V2.0 kernel will provide TRIM support. I'm thinking of
>>> building a small low power, fanless IPCop box and a small, recycled SSD
>>> would help keep the heat down. Does anyone know if an SSD is a good idea?
>>>
>>> Yes and No.
>>
>> SSD is flash memory and is subject to wear and tear.
>>
>> To use SSD successfully, you would not put the swap and on it. You would
>> also try not to do caching or proxy.
>>
>> You would also need to use these options for the root filesystem in the
>> /etc/fstab:
>>
>> "rw,noatime,commit=60"
>>
>> We calculated that a Kingstom 8GB SSD can survive at least 3 years with a
>> 128KB block write (erase) every 45 seconds. This is for pfSense, but should
>> be applicable to IPCop as well.
>>
>
> Ok, let me try this again with a real email client:
>
> Actually all one needs to do is choose flash install just prior to
> format during install, it is designed to write to disk only once an
> hour, more on that follows. I have always sworn by flash installs (done
> correctly with mkflash) in 1.4 and 2.0 is improved twofold over the
> standard flash method in 1.4. One, you can choose flash install during
> installation, Two, rather than the RD filesystem that really has not
> been necessary since the 2.2 kernel but was the method in 1.4, flash
> installs in 2.0 use TMPFS for the ramdisk which is superior in every
> respect to RD. It needs no formatting and can be resized on the fly
> while mounted with no data loss. I also like the low power draw and low
> heat of a flash installs. It's a winner the whole way around if done
> correctly as is the case with flash installs.
>
>
> The way the flash version works is that /var/log and some of the html
> graphs as well as cron are actually held in a mounted TMPFS (Ramdisk)
> and written to tarballs once an hour for backup ON the disk. These
> tarballs are actually untargzipped on boot as well AFTER the TMPFS is
> mounted as /ram. In the event of a cold reboot or power loss, the most
> logs you will ever lose are close to an hour. I use a UPS and have the
> logs write to my server anyway. Running all the rapidly changing info in
> ram rather than disk and writing to disk only once an hour increases the
> life expectancy of a flash drive to years (15 maybe?) and since you have
> all your graphs and volatile info running in ram rather than on disk, it
> performs extremely well. It also uses NO swap. As far as proxy cache, if
> you want it, give it enough ram for the desired size. I only use the
> proxy for url filtering these days and really need no cache but that's
> my preference.
>
>
> I actually switched flash installs to TMPFS in 2008 on my Raqcop
> adaptation of IPCop for Cobalt hardware. I borrowed it from 2.0svn.
> TMPFS also allows you to use a percentage of ram rather than a fixed
> value. I set mine at 50%. Any of that 50% not used by the info in /ram
> in my case is still available to the system to use if need be. I should
> also mention that I am using flash raid on a Cobalt test box and have
> been able to do so for some time with the 2.0svn branch.On a standard PC
> it's like cake.
>
> --
> Dave Studeman
> http:/www.raqcop.com
>
>
> ------------------------------------------------------------------------------
> Get a FREE DOWNLOAD! and learn more about uberSVN rich system,
> user administration capabilities and model configuration. Take
> the hassle out of deploying and managing Subversion and the
> tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2
> _______________________________________________
> list mailing list
> list <at> tagcose.com
> https://lists.tagcose.com/mailman/listinfo/list
_______________________________________________
list mailing list
list <at> tagcose.com
https://lists.tagcose.com/mailman/listinfo/list
Eric Shubert | 19 Aug 2011 17:42
Favicon

Re: [tagcose] Fwd: Re: Will the SATA drivers in IPCop V2.0 support TRIM?

They're both flash storage, so short answer is yes.
Keep in mind though that each mfr may have different ways of dealing 
with various challenges that flash storage presents, regarding wear and 
performance.

On 08/19/2011 08:35 AM, Dwayne Haught wrote:
> I was working on this topic this week. Researching and reading about the
> most ideal way to handle flash storage. Would you think, for the most
> part, that USB & SSD can be approached in a similar way?
>
> On Aug 19, 2011 8:25 AM, "Eric Shubert" <ejs <at> shubes.net
> <mailto:ejs <at> shubes.net>> wrote:
>  > Interesting stuff regarding running on USB/SSD drives.
>  >
>  > -------- Original Message --------
>  > Subject: Re: Will the SATA drivers in IPCop V2.0 support TRIM?
>  > Date: Thu, 18 Aug 2011 23:59:36 -0700
>  > From: David W Studeman <dwstudeman <at> ovi.com
> <mailto:dwstudeman <at> ovi.com>>
>  > To: ipcop-user <at> lists.sourceforge.net
> <mailto:ipcop-user-5NWGOfrQmneRv%2BLV9MX5uipxlwaOVQ5f <at> public.gmane.org>
>  > Newsgroups: gmane.comp.security.ipcop.user
>  > References: <4E4CFE31.4040804 <at> mindspring.com
> <mailto:4E4CFE31.4040804 <at> mindspring.com>>
>  > <CAAxQi-895idMdT=XKgKXHhf_mu_PNPHRzdq-s04v9Bauwvvxug <at> mail.gmail.com
> <mailto:XKgKXHhf_mu_PNPHRzdq-s04v9Bauwvvxug <at> mail.gmail.com>>
>  >
>  > On 8/18/2011 9:22 AM, Bao Ha wrote:
>  >> On Thu, Aug 18, 2011 at 4:57 AM,
> ftarz <at> mindspring.com
> <mailto:ftarz <at> mindspring.com>
>  >> <ftarz <at> mindspring.com
> <mailto:ftarz <at> mindspring.com>>wrote:
>  >>
>  >>> I don't want to start a war of words, but just ask if the SATA drivers
>  >>> in the IPCop V2.0 kernel will provide TRIM support. I'm thinking of
>  >>> building a small low power, fanless IPCop box and a small, recycled SSD
>  >>> would help keep the heat down. Does anyone know if an SSD is a good
> idea?
>  >>>
>  >>> Yes and No.
>  >>
>  >> SSD is flash memory and is subject to wear and tear.
>  >>
>  >> To use SSD successfully, you would not put the swap and on it. You would
>  >> also try not to do caching or proxy.
>  >>
>  >> You would also need to use these options for the root filesystem in the
>  >> /etc/fstab:
>  >>
>  >> "rw,noatime,commit=60"
>  >>
>  >> We calculated that a Kingstom 8GB SSD can survive at least 3 years
> with a
>  >> 128KB block write (erase) every 45 seconds. This is for pfSense, but
> should
>  >> be applicable to IPCop as well.
>  >>
>  >
>  > Ok, let me try this again with a real email client:
>  >
>  > Actually all one needs to do is choose flash install just prior to
>  > format during install, it is designed to write to disk only once an
>  > hour, more on that follows. I have always sworn by flash installs (done
>  > correctly with mkflash) in 1.4 and 2.0 is improved twofold over the
>  > standard flash method in 1.4. One, you can choose flash install during
>  > installation, Two, rather than the RD filesystem that really has not
>  > been necessary since the 2.2 kernel but was the method in 1.4, flash
>  > installs in 2.0 use TMPFS for the ramdisk which is superior in every
>  > respect to RD. It needs no formatting and can be resized on the fly
>  > while mounted with no data loss. I also like the low power draw and low
>  > heat of a flash installs. It's a winner the whole way around if done
>  > correctly as is the case with flash installs.
>  >
>  >
>  > The way the flash version works is that /var/log and some of the html
>  > graphs as well as cron are actually held in a mounted TMPFS (Ramdisk)
>  > and written to tarballs once an hour for backup ON the disk. These
>  > tarballs are actually untargzipped on boot as well AFTER the TMPFS is
>  > mounted as /ram. In the event of a cold reboot or power loss, the most
>  > logs you will ever lose are close to an hour. I use a UPS and have the
>  > logs write to my server anyway. Running all the rapidly changing info in
>  > ram rather than disk and writing to disk only once an hour increases the
>  > life expectancy of a flash drive to years (15 maybe?) and since you have
>  > all your graphs and volatile info running in ram rather than on disk, it
>  > performs extremely well. It also uses NO swap. As far as proxy cache, if
>  > you want it, give it enough ram for the desired size. I only use the
>  > proxy for url filtering these days and really need no cache but that's
>  > my preference.
>  >
>  >
>  > I actually switched flash installs to TMPFS in 2008 on my Raqcop
>  > adaptation of IPCop for Cobalt hardware. I borrowed it from 2.0svn.
>  > TMPFS also allows you to use a percentage of ram rather than a fixed
>  > value. I set mine at 50%. Any of that 50% not used by the info in /ram
>  > in my case is still available to the system to use if need be. I should
>  > also mention that I am using flash raid on a Cobalt test box and have
>  > been able to do so for some time with the 2.0svn branch.On a standard PC
>  > it's like cake.
>  >
>  > --
>  > Dave Studeman
>  > http:/www.raqcop.com <http://www.raqcop.com>
>  >
>  >
>  >
> ------------------------------------------------------------------------------
>  > Get a FREE DOWNLOAD! and learn more about uberSVN rich system,
>  > user administration capabilities and model configuration. Take
>  > the hassle out of deploying and managing Subversion and the
>  > tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2
>  > _______________________________________________
>  > list mailing list
>  > list <at> tagcose.com <mailto:list <at> tagcose.com>
>  > https://lists.tagcose.com/mailman/listinfo/list
>
>
>
> _______________________________________________
> list mailing list
> list <at> tagcose.com
> https://lists.tagcose.com/mailman/listinfo/list

--

-- 
-Eric 'shubes'
Dwayne Haught | 19 Aug 2011 17:43
Picon

Re: [tagcose] Fwd: Re: Will the SATA drivers in IPCop V2.0 support TRIM?

Once we get past being in this "blast furnace" I will be looking forward to us continuing our dialog and "laboratory" effort (the topics we touched on at B&N).

For myself, when starting a new job, like you have done, it takes a certain amount of time and effort to make it your own. Though our dialog has "paused" for the summer, I am still holding the excitement for that topic.

On Aug 19, 2011 8:25 AM, "Eric Shubert" <ejs <at> shubes.net> wrote:
> Interesting stuff regarding running on USB/SSD drives.
>
> -------- Original Message --------
> Subject: Re: Will the SATA drivers in IPCop V2.0 support TRIM?
> Date: Thu, 18 Aug 2011 23:59:36 -0700
> From: David W Studeman <dwstudeman-ceosCSQIA1M@public.gmane.org>
> To: ipcop-user-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
> Newsgroups: gmane.comp.security.ipcop.user
> References: <4E4CFE31.4040804 <at> mindspring.com>
> <CAAxQi-895idMdT=XKgKXHhf_mu_PNPHRzdq-s04v9Bauwvvxug <at> mail.gmail.com>
>
> On 8/18/2011 9:22 AM, Bao Ha wrote:
>> On Thu, Aug 18, 2011 at 4:57 AM, ftarz-mn4gwa5WIIQysxA8WJXlww@public.gmane.org
>> <ftarz-mn4gwa5WIIQysxA8WJXlww@public.gmane.org>wrote:
>>
>>> I don't want to start a war of words, but just ask if the SATA drivers
>>> in the IPCop V2.0 kernel will provide TRIM support. I'm thinking of
>>> building a small low power, fanless IPCop box and a small, recycled SSD
>>> would help keep the heat down. Does anyone know if an SSD is a good idea?
>>>
>>> Yes and No.
>>
>> SSD is flash memory and is subject to wear and tear.
>>
>> To use SSD successfully, you would not put the swap and on it. You would
>> also try not to do caching or proxy.
>>
>> You would also need to use these options for the root filesystem in the
>> /etc/fstab:
>>
>> "rw,noatime,commit=60"
>>
>> We calculated that a Kingstom 8GB SSD can survive at least 3 years with a
>> 128KB block write (erase) every 45 seconds. This is for pfSense, but should
>> be applicable to IPCop as well.
>>
>
> Ok, let me try this again with a real email client:
>
> Actually all one needs to do is choose flash install just prior to
> format during install, it is designed to write to disk only once an
> hour, more on that follows. I have always sworn by flash installs (done
> correctly with mkflash) in 1.4 and 2.0 is improved twofold over the
> standard flash method in 1.4. One, you can choose flash install during
> installation, Two, rather than the RD filesystem that really has not
> been necessary since the 2.2 kernel but was the method in 1.4, flash
> installs in 2.0 use TMPFS for the ramdisk which is superior in every
> respect to RD. It needs no formatting and can be resized on the fly
> while mounted with no data loss. I also like the low power draw and low
> heat of a flash installs. It's a winner the whole way around if done
> correctly as is the case with flash installs.
>
>
> The way the flash version works is that /var/log and some of the html
> graphs as well as cron are actually held in a mounted TMPFS (Ramdisk)
> and written to tarballs once an hour for backup ON the disk. These
> tarballs are actually untargzipped on boot as well AFTER the TMPFS is
> mounted as /ram. In the event of a cold reboot or power loss, the most
> logs you will ever lose are close to an hour. I use a UPS and have the
> logs write to my server anyway. Running all the rapidly changing info in
> ram rather than disk and writing to disk only once an hour increases the
> life expectancy of a flash drive to years (15 maybe?) and since you have
> all your graphs and volatile info running in ram rather than on disk, it
> performs extremely well. It also uses NO swap. As far as proxy cache, if
> you want it, give it enough ram for the desired size. I only use the
> proxy for url filtering these days and really need no cache but that's
> my preference.
>
>
> I actually switched flash installs to TMPFS in 2008 on my Raqcop
> adaptation of IPCop for Cobalt hardware. I borrowed it from 2.0svn.
> TMPFS also allows you to use a percentage of ram rather than a fixed
> value. I set mine at 50%. Any of that 50% not used by the info in /ram
> in my case is still available to the system to use if need be. I should
> also mention that I am using flash raid on a Cobalt test box and have
> been able to do so for some time with the 2.0svn branch.On a standard PC
> it's like cake.
>
> --
> Dave Studeman
> http:/www.raqcop.com
>
>
> ------------------------------------------------------------------------------
> Get a FREE DOWNLOAD! and learn more about uberSVN rich system,
> user administration capabilities and model configuration. Take
> the hassle out of deploying and managing Subversion and the
> tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2
> _______________________________________________
> list mailing list
> list <at> tagcose.com
> https://lists.tagcose.com/mailman/listinfo/list
_______________________________________________
list mailing list
list <at> tagcose.com
https://lists.tagcose.com/mailman/listinfo/list
Dwayne Haught | 19 Aug 2011 17:48
Picon

Re: [tagcose] Fwd: Re: Will the SATA drivers in IPCop V2.0 support TRIM?

Of course, i.e. firmware, controllers, hardware quality, etc. We will work through those issues. Justin has been running the AMD Fusion with USBs for a few months now. He has some type of Minecraft server running. For our matters I'm thinking of some type of rigorous machine trials, as appropriate.

On Aug 19, 2011 8:43 AM, "Eric Shubert" <ejs <at> shubes.net> wrote:
> They're both flash storage, so short answer is yes.
> Keep in mind though that each mfr may have different ways of dealing
> with various challenges that flash storage presents, regarding wear and
> performance.
>
> On 08/19/2011 08:35 AM, Dwayne Haught wrote:
>> I was working on this topic this week. Researching and reading about the
>> most ideal way to handle flash storage. Would you think, for the most
>> part, that USB & SSD can be approached in a similar way?
>>
>> On Aug 19, 2011 8:25 AM, "Eric Shubert" <ejs <at> shubes.net
>> <mailto:ejs <at> shubes.net>> wrote:
>> > Interesting stuff regarding running on USB/SSD drives.
>> >
>> > -------- Original Message --------
>> > Subject: Re: Will the SATA drivers in IPCop V2.0 support TRIM?
>> > Date: Thu, 18 Aug 2011 23:59:36 -0700
>> > From: David W Studeman <dwstudeman <at> ovi.com
>> <mailto:dwstudeman <at> ovi.com>>
>> > To: ipcop-user <at> lists.sourceforge.net
>> <mailto:ipcop-user-5NWGOfrQmneRv%2BLV9MX5uipxlwaOVQ5f@public.gmane.org>
>> > Newsgroups: gmane.comp.security.ipcop.user
>> > References: <4E4CFE31.4040804 <at> mindspring.com
>> <mailto:4E4CFE31.4040804 <at> mindspring.com>>
>> > <CAAxQi-895idMdT=XKgKXHhf_mu_PNPHRzdq-s04v9Bauwvvxug <at> mail.gmail.com
>> <mailto:XKgKXHhf_mu_PNPHRzdq-s04v9Bauwvvxug <at> mail.gmail.com>>
>> >
>> > On 8/18/2011 9:22 AM, Bao Ha wrote:
>> >> On Thu, Aug 18, 2011 at 4:57 AM,
>> ftarz <at> mindspring.com
>> <mailto:ftarz <at> mindspring.com>
>> >> <ftarz <at> mindspring.com
>> <mailto:ftarz <at> mindspring.com>>wrote:
>> >>
>> >>> I don't want to start a war of words, but just ask if the SATA drivers
>> >>> in the IPCop V2.0 kernel will provide TRIM support. I'm thinking of
>> >>> building a small low power, fanless IPCop box and a small, recycled SSD
>> >>> would help keep the heat down. Does anyone know if an SSD is a good
>> idea?
>> >>>
>> >>> Yes and No.
>> >>
>> >> SSD is flash memory and is subject to wear and tear.
>> >>
>> >> To use SSD successfully, you would not put the swap and on it. You would
>> >> also try not to do caching or proxy.
>> >>
>> >> You would also need to use these options for the root filesystem in the
>> >> /etc/fstab:
>> >>
>> >> "rw,noatime,commit=60"
>> >>
>> >> We calculated that a Kingstom 8GB SSD can survive at least 3 years
>> with a
>> >> 128KB block write (erase) every 45 seconds. This is for pfSense, but
>> should
>> >> be applicable to IPCop as well.
>> >>
>> >
>> > Ok, let me try this again with a real email client:
>> >
>> > Actually all one needs to do is choose flash install just prior to
>> > format during install, it is designed to write to disk only once an
>> > hour, more on that follows. I have always sworn by flash installs (done
>> > correctly with mkflash) in 1.4 and 2.0 is improved twofold over the
>> > standard flash method in 1.4. One, you can choose flash install during
>> > installation, Two, rather than the RD filesystem that really has not
>> > been necessary since the 2.2 kernel but was the method in 1.4, flash
>> > installs in 2.0 use TMPFS for the ramdisk which is superior in every
>> > respect to RD. It needs no formatting and can be resized on the fly
>> > while mounted with no data loss. I also like the low power draw and low
>> > heat of a flash installs. It's a winner the whole way around if done
>> > correctly as is the case with flash installs.
>> >
>> >
>> > The way the flash version works is that /var/log and some of the html
>> > graphs as well as cron are actually held in a mounted TMPFS (Ramdisk)
>> > and written to tarballs once an hour for backup ON the disk. These
>> > tarballs are actually untargzipped on boot as well AFTER the TMPFS is
>> > mounted as /ram. In the event of a cold reboot or power loss, the most
>> > logs you will ever lose are close to an hour. I use a UPS and have the
>> > logs write to my server anyway. Running all the rapidly changing info in
>> > ram rather than disk and writing to disk only once an hour increases the
>> > life expectancy of a flash drive to years (15 maybe?) and since you have
>> > all your graphs and volatile info running in ram rather than on disk, it
>> > performs extremely well. It also uses NO swap. As far as proxy cache, if
>> > you want it, give it enough ram for the desired size. I only use the
>> > proxy for url filtering these days and really need no cache but that's
>> > my preference.
>> >
>> >
>> > I actually switched flash installs to TMPFS in 2008 on my Raqcop
>> > adaptation of IPCop for Cobalt hardware. I borrowed it from 2.0svn.
>> > TMPFS also allows you to use a percentage of ram rather than a fixed
>> > value. I set mine at 50%. Any of that 50% not used by the info in /ram
>> > in my case is still available to the system to use if need be. I should
>> > also mention that I am using flash raid on a Cobalt test box and have
>> > been able to do so for some time with the 2.0svn branch.On a standard PC
>> > it's like cake.
>> >
>> > --
>> > Dave Studeman
>> > http:/www.raqcop.com <http://www.raqcop.com>
>> >
>> >
>> >
>> ------------------------------------------------------------------------------
>> > Get a FREE DOWNLOAD! and learn more about uberSVN rich system,
>> > user administration capabilities and model configuration. Take
>> > the hassle out of deploying and managing Subversion and the
>> > tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2
>> > _______________________________________________
>> > list mailing list
>> > list <at> tagcose.com <mailto:list <at> tagcose.com>
>> > https://lists.tagcose.com/mailman/listinfo/list
>>
>>
>>
>> _______________________________________________
>> list mailing list
>> list <at> tagcose.com
>> https://lists.tagcose.com/mailman/listinfo/list
>
>
> --
> -Eric 'shubes'
>
> _______________________________________________
> list mailing list
> list <at> tagcose.com
> https://lists.tagcose.com/mailman/listinfo/list
_______________________________________________
list mailing list
list <at> tagcose.com
https://lists.tagcose.com/mailman/listinfo/list
Eric Shubert | 19 Aug 2011 17:48
Favicon

[tagcose] Fwd: Re: mail spool filesystem

A nice piece regarding *very* large mail storage.

-------- Original Message --------
Subject: Re: mail spool filesystem
Date: Fri, 19 Aug 2011 03:48:00 -0500
From: Stan Hoeppner <stan <at> hardwarefreak.com>
To: dovecot <at> dovecot.org
Newsgroups: gmane.mail.imap.dovecot
References: <4E4BC0CC.5010908 <at> psi.com.br> 
<20110817164207.2e9c1d49 <at> echelon.ethz.ch>

On 8/17/2011 9:42 AM, Adrian Ulrich wrote:
>> I read that XFS is a good choice, but is not
>> too reliable...
>
> Are you using Maildir or MBOX?
>
> In any case: XFS would be my last choice:
>
> XFS is nice if you are working with large files (> 2GB), but
> for E-Mail i'd stick with ext3 (or maybe even reiser3)
> as it works very well with small files.

XFS was designed for parallelism, whether with large files or small,
though it has been optimized a bit more for large file throughput.  In
yet another attempt to dispel the XFS "small file problem" myth, XFS has
never had a performance problem with "small" files.  In the past XFS did
have a performance problem with large metadata operations due to the way
the delayed allocation had been designed.  The perennial example of this
was the horrible unlink performance when whacking a kernel tree with 'rm
-rf'.  It used to take forever, multiple tens of times slower than
Reiser or EXT.  This metadata bottleneck in the delayed allocation path
was largely resolved by Dave Chinner's delayed logging patch which was
experimental in 2.6.35 and is enabled by default in 2.6.39 and later.
XFS metadata performance is now on par with that of EXT3/4.

Because of this, and XFS' use of allocation groups, today, for a busy
IMAP server with lots of maildir mailboxen, one of the highest
performance storage stack setups is the following:

1.  A dozen or more hardware or software RAID1 mirrors
2.  A linear concat over the mirrors
3.  XFS with 2*num_mirrors allocation groups, mounted with 'inode64'
4.  maildir mailboxes

This setup will give you significantly higher real IOPS than any striped
array setup with any filesystem atop, for a couple of reasons:

1.  No partial stripe width writes, and no unnecessary full stripe
reads.  All reads and writes match the page size and filesystem block
size of 4KB.

2.  In the example above, you have two AGs per mirror pair, 24 total AGs
on 12 mirrors.  The first two maildir directories will be created in AGs
1 and 2 on the first mirror.  The second two in AGs 3 & 4 on the 2nd
mirror pair, and so on.  The 25th/26th directories will 'wrap' back to
AGs 1 & 2 and the directory creation pattern will continue.

Because of its allocation group design XFS is the only filesystem that
can accomplish this level of parallelism with a concatenated array and
small email files.  All others must rely on striped arrays, either
RAID10 or 5/6.  These come with the inefficiencies of writing/reading
files as small as 2KB on a stripe ranging from 256KB-1MB or larger,
depending on the number of disks in the array and the chosen stripe
size.  If you have a high write load, the Linux allocator will pack
multiple files into a single stripe, but one rarely sees 100% efficiency
here.  Even at 100% on writes, at low read rates, you end up reading a
lot of full 256KB-1MB stripes just to get a 2KB file, wasting bandwidth
and filling up the buffer cache with unneeded data, not to mention any
read cache on your hardware RAID controller or SAN head.

The only potential downside to this setup is the rare situation where
your current logged in users all have their mailbox in the same AG or
two AGs on the same spindle.  I've yet to see this happen, though it is
a theoretical possibility, though the probability is extremely low.

--

-- 
Stan
Eric Shubert | 19 Aug 2011 17:54
Favicon

Re: [tagcose] Fwd: Re: Will the SATA drivers in IPCop V2.0 support TRIM?

I'm glad, as the job I had has concluded. Nice while it lasted, but I'm 
glad it's over so I can spend more time on this.

So what's on the agenda for the IF tomorrow?

On 08/19/2011 08:43 AM, Dwayne Haught wrote:
> Once we get past being in this "blast furnace" I will be looking forward
> to us continuing our dialog and "laboratory" effort (the topics we
> touched on at B&N).
>
> For myself, when starting a new job, like you have done, it takes a
> certain amount of time and effort to make it your own. Though our dialog
> has "paused" for the summer, I am still holding the excitement for that
> topic.
>
> On Aug 19, 2011 8:25 AM, "Eric Shubert" <ejs <at> shubes.net
> <mailto:ejs <at> shubes.net>> wrote:
>  > Interesting stuff regarding running on USB/SSD drives.
>  >
>  > -------- Original Message --------
>  > Subject: Re: Will the SATA drivers in IPCop V2.0 support TRIM?
>  > Date: Thu, 18 Aug 2011 23:59:36 -0700
>  > From: David W Studeman <dwstudeman <at> ovi.com
> <mailto:dwstudeman <at> ovi.com>>
>  > To: ipcop-user <at> lists.sourceforge.net
> <mailto:ipcop-user-5NWGOfrQmneRv%2BLV9MX5uipxlwaOVQ5f <at> public.gmane.org>
>  > Newsgroups: gmane.comp.security.ipcop.user
>  > References: <4E4CFE31.4040804 <at> mindspring.com
> <mailto:4E4CFE31.4040804 <at> mindspring.com>>
>  > <CAAxQi-895idMdT=XKgKXHhf_mu_PNPHRzdq-s04v9Bauwvvxug <at> mail.gmail.com
> <mailto:XKgKXHhf_mu_PNPHRzdq-s04v9Bauwvvxug <at> mail.gmail.com>>
>  >
>  > On 8/18/2011 9:22 AM, Bao Ha wrote:
>  >> On Thu, Aug 18, 2011 at 4:57 AM,
> ftarz <at> mindspring.com
> <mailto:ftarz <at> mindspring.com>
>  >> <ftarz <at> mindspring.com
> <mailto:ftarz <at> mindspring.com>>wrote:
>  >>
>  >>> I don't want to start a war of words, but just ask if the SATA drivers
>  >>> in the IPCop V2.0 kernel will provide TRIM support. I'm thinking of
>  >>> building a small low power, fanless IPCop box and a small, recycled SSD
>  >>> would help keep the heat down. Does anyone know if an SSD is a good
> idea?
>  >>>
>  >>> Yes and No.
>  >>
>  >> SSD is flash memory and is subject to wear and tear.
>  >>
>  >> To use SSD successfully, you would not put the swap and on it. You would
>  >> also try not to do caching or proxy.
>  >>
>  >> You would also need to use these options for the root filesystem in the
>  >> /etc/fstab:
>  >>
>  >> "rw,noatime,commit=60"
>  >>
>  >> We calculated that a Kingstom 8GB SSD can survive at least 3 years
> with a
>  >> 128KB block write (erase) every 45 seconds. This is for pfSense, but
> should
>  >> be applicable to IPCop as well.
>  >>
>  >
>  > Ok, let me try this again with a real email client:
>  >
>  > Actually all one needs to do is choose flash install just prior to
>  > format during install, it is designed to write to disk only once an
>  > hour, more on that follows. I have always sworn by flash installs (done
>  > correctly with mkflash) in 1.4 and 2.0 is improved twofold over the
>  > standard flash method in 1.4. One, you can choose flash install during
>  > installation, Two, rather than the RD filesystem that really has not
>  > been necessary since the 2.2 kernel but was the method in 1.4, flash
>  > installs in 2.0 use TMPFS for the ramdisk which is superior in every
>  > respect to RD. It needs no formatting and can be resized on the fly
>  > while mounted with no data loss. I also like the low power draw and low
>  > heat of a flash installs. It's a winner the whole way around if done
>  > correctly as is the case with flash installs.
>  >
>  >
>  > The way the flash version works is that /var/log and some of the html
>  > graphs as well as cron are actually held in a mounted TMPFS (Ramdisk)
>  > and written to tarballs once an hour for backup ON the disk. These
>  > tarballs are actually untargzipped on boot as well AFTER the TMPFS is
>  > mounted as /ram. In the event of a cold reboot or power loss, the most
>  > logs you will ever lose are close to an hour. I use a UPS and have the
>  > logs write to my server anyway. Running all the rapidly changing info in
>  > ram rather than disk and writing to disk only once an hour increases the
>  > life expectancy of a flash drive to years (15 maybe?) and since you have
>  > all your graphs and volatile info running in ram rather than on disk, it
>  > performs extremely well. It also uses NO swap. As far as proxy cache, if
>  > you want it, give it enough ram for the desired size. I only use the
>  > proxy for url filtering these days and really need no cache but that's
>  > my preference.
>  >
>  >
>  > I actually switched flash installs to TMPFS in 2008 on my Raqcop
>  > adaptation of IPCop for Cobalt hardware. I borrowed it from 2.0svn.
>  > TMPFS also allows you to use a percentage of ram rather than a fixed
>  > value. I set mine at 50%. Any of that 50% not used by the info in /ram
>  > in my case is still available to the system to use if need be. I should
>  > also mention that I am using flash raid on a Cobalt test box and have
>  > been able to do so for some time with the 2.0svn branch.On a standard PC
>  > it's like cake.
>  >
>  > --
>  > Dave Studeman
>  > http:/www.raqcop.com <http://www.raqcop.com>
>  >
>  >
>  >
> ------------------------------------------------------------------------------
>  > Get a FREE DOWNLOAD! and learn more about uberSVN rich system,
>  > user administration capabilities and model configuration. Take
>  > the hassle out of deploying and managing Subversion and the
>  > tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2
>  > _______________________________________________
>  > list mailing list
>  > list <at> tagcose.com <mailto:list <at> tagcose.com>
>  > https://lists.tagcose.com/mailman/listinfo/list
>
>
>
> _______________________________________________
> list mailing list
> list <at> tagcose.com
> https://lists.tagcose.com/mailman/listinfo/list

--

-- 
-Eric 'shubes'
Eric Shubert | 25 Aug 2011 19:51
Favicon

[tagcose] Usage: Hardening your instance

Did I send you this link yet? We should have it on the wiki somewhere.

http://www.pmman.com/usage/hardening/

--

-- 
-Eric 'shubes'
BaconBits | 25 Aug 2011 20:17
Picon

Re: [tagcose] Usage: Hardening your instance

I have no idea what that means
Steve 

-----Original Message-----
From: list-bounces+baconbitsaz=gmail.com <at> tagcose.com
[mailto:list-bounces+baconbitsaz=gmail.com <at> tagcose.com] On Behalf Of Eric
Shubert
Sent: Thursday, August 25, 2011 10:51 AM
To: Tagcose General List
Subject: [tagcose] Usage: Hardening your instance

Did I send you this link yet? We should have it on the wiki somewhere.

http://www.pmman.com/usage/hardening/

--
-Eric 'shubes'

_______________________________________________
list mailing list
list <at> tagcose.com
https://lists.tagcose.com/mailman/listinfo/list
Eric Shubert | 25 Aug 2011 20:23
Favicon

Re: [tagcose] Usage: Hardening your instance

On 08/25/2011 11:17 AM, BaconBits wrote:
> I have no idea what that means
> Steve
>
> -----Original Message-----
> From: list-bounces+baconbitsaz=gmail.com <at> tagcose.com
> [mailto:list-bounces+baconbitsaz=gmail.com <at> tagcose.com] On Behalf Of Eric
> Shubert
> Sent: Thursday, August 25, 2011 10:51 AM
> To: Tagcose General List
> Subject: [tagcose] Usage: Hardening your instance
>
> Did I send you this link yet? We should have it on the wiki somewhere.
>
> http://www.pmman.com/usage/hardening/
>
> --
> -Eric 'shubes'
>
>
> _______________________________________________

Don't worry, Steve. This post was mainly for Dwayne.

Steve, if you'd like to meet up soon, please contact me off list.

--

-- 
-Eric 'shubes'

Gmane