Timo Sirainen <tss <at> iki.fi>
2003-08-04 00:35:33 GMT
So I finally got the new mail caching code fully working in normal
conditions. Index rebuilding and some error correction still needs a
bit work. mbox is also still broken. Anyway, I was mostly interested
how fast Dovecot now works with my 367000 LKML mails, but thought I'd
have to get something to compare the results against, so here's Dovecot
Results against older Dovecot would have been pretty boring, the older
Dovecot could never perform threading without opening all the files
and reading References-headers from them. Sorting would could have been
done from cache if IMAP ENVELOPEs were cached, I'd estimate maybe 2-3x
larger user CPU usage with it and a _lot_ larger cache file since it
would have stored from, to, etc. fields in it.
Results against Cyrus would be interesting. I'll probably do those
sometimes later too.. Last I checked, Cyrus was very slow at inserting
the mails into it's database, it took .. was it 1-3 hours to insert all
those mails, while a simple copying took maybe 20 mins. Anyway, Cyrus's
caching is pretty dummy as well so I'd expect Dovecot to be many times
faster in threading and likely somewhat faster in sorting.
Maildir: Linux Kernel Mailing List with 367918 mails, total of 1,9GB.
NOTE: The total times are heavily affected by disk I/O. In these tests the
index files are cached in memory by OS. The files themselves are mostly
uncached (I flushed the cache by reading another 2GB file 3 times).
System: 1GHz AMD Athlon CPU, 1GB RAM, 120GB IDE disk,