Andrew Biggadike | 7 Mar 10:48 2006
Picon

Strange :info and old messages in mutt

I am seeing strange :info portions of maildir message filenames that
correspond directly to messages marked as old in mutt that shouldn't
be.  I believe mutt can be ruled out as the culprit since I can quit
mutt and have a cur directory with no filenames of this type, then
after an offlineimap sync have several messages' filenames return
again to this form.

This "strange" form I'm referring to looks like

  uniq:)S()S()Se()S\e2,()S\en

instead of

  uniq:2,S

(where uniq is <timeval>_<timeseq>.<pid>.<hostname>,U=<uid>,FMD5=<md5>
as specified in folder/Maildir.py, as expected).  The only thing I
know about this filename format is from [1], so this looks quite
strange to me.

I'm guessing there's something unexpected going on in the regular
expressions of MaildirFolder's savemessageflags().  I'll probably try
and figure out what's going on over the next few days as I have time,
but thought I'd post here in case someone more familiar with the code
can provide any insight or get to it sooner.

I am using the 4.0.11 debian package of offlineimap.  Let me know if
there is any other information I can provide.

Thanks,
(Continue reading)

Steve Traylen | 17 Mar 14:20 2006
Picon
Picon

offlineimap, mutt and exchange.


Hi,

In the last few days I'm using offlineimap to sync an imap enabled=20
M$ exchange server to a local maildir that I then read with mutt.

Everything almost works perfectly except for one annoyance.

Often in Mutt messages that I have read appear in the index=20
with the 'O' flag which is for old.

  20 r   Mar 17 Steve Traylen   (0.7K) Headphones and cameras.
  21     Mar 17 Steve Traylen   (1.1K) =E2=94=94=E2=94=80>
  22     Mar 17 Bruffell, J (Ja (1.6K) Angie Loveday is leaving RAL
  23 O   Mar 17 Wheeler, JF (Jo (1.6K) [Gridpp #13015] Re: PBS JOB 228215=
6.csfln  24 O   Mar 17 Sansum, RA (And (0.2K) Leave this PM

Despite the fact that these messages have been read in Mutt they=20
appear on the exchange server via outlook still as new and
unread.

Reading the messages again in Mutt is enough to switch the messages
to read on the imap server.

I guess the imap server is not respecting some flag that mutt is
setting. Any ideas?

 Steve

--=20
(Continue reading)

Jan Korger | 17 Mar 14:36 2006
Picon

Re: offlineimap, mutt and exchange.

On Fri, Mar 17, 2006 at 01:20:04PM +0000, Steve Traylen wrote:

> Often in Mutt messages that I have read appear in the index=20
> with the 'O' flag which is for old.
> [...] 
> Despite the fact that these messages have been read in Mutt they=20
> appear on the exchange server via outlook still as new and
> unread.

Isn't "O" in mutt for messages which are old (older than current mutt
session), but unread. Maybe the problem is on the mutt (MAILDIR?) side.

jan

Jon Riddle | 17 Mar 14:42 2006

Re: offlineimap, mutt and exchange.

I'm getting the same thing (kind of).  I use offlineimap to sync between
two BincIMAP servers.  One of those is at home, where I use Mutt to
access the Maildir directly.  As soon as it syncs, Mutt changes the
message from N (new) to O (old).  

This may be Binc specific (then again, it may not), but I noticed that
when a message is considered new by Mutt, it's in the /new/ folder:

Mail/INBOX/new/1142602523.M416790P11003.bacon

but as soon as offlineimap hits it, it gets moved to the /cur/ folder
without a seen flag (S) on it:

Mail/INBOX/cur/1142602523.M416790P11003.bacon:2,

Then, of course, when it has been read, the Seen flag gets appended per
the Maildir spec:

Mail/INBOX/cur/1142602523.M416790P11003.bacon:2,S

This may be Maildir-specific, but I suspect that it's a Mutt thing.
Most IMAP clients I know of don't differentiate between new, old, and
read - they just know read and unread.

That's my 2 cents - hope it helps...

Jon

> 
> Hi,
(Continue reading)

Andrew Biggadike | 17 Mar 17:48 2006
Picon

Re: offlineimap, mutt and exchange.

Steve Traylen <s.traylen <at> rl.ac.uk> wrote:
> In the last few days I'm using offlineimap to sync an imap enabled=20
> M$ exchange server to a local maildir that I then read with mutt.
> 
> Everything almost works perfectly except for one annoyance.
> 
> Often in Mutt messages that I have read appear in the index=20
> with the 'O' flag which is for old.
> 
>   20 r   Mar 17 Steve Traylen   (0.7K) Headphones and cameras.
>   21     Mar 17 Steve Traylen   (1.1K) =E2=94=94=E2=94=80>
>   22     Mar 17 Bruffell, J (Ja (1.6K) Angie Loveday is leaving RAL
>   23 O   Mar 17 Wheeler, JF (Jo (1.6K) [Gridpp #13015] Re: PBS JOB 228215=
> 6.csfln  24 O   Mar 17 Sansum, RA (And (0.2K) Leave this PM
> 
> Despite the fact that these messages have been read in Mutt they=20
> appear on the exchange server via outlook still as new and
> unread.

I posted about a similar problem last week.  I investigated enough to
find that -- for some reason -- offlineimap is creating Maildir files
with invalid flags.  The diff below fixed my problem and I haven't
yet had time to figure out why savemessageflags() is getting called
with invalid flags such as '(', '\\', 'e'. 

Have a look in your Maildir directory and see if you have filenames
ending with something like ":)S()S()Se()S\e2,()S\en".  If so, this
diff may remove the annoyance until we find the actual cause of this.
For what it's worth, I am also syncing an Exchange IMAP to Maildir and
using mutt as my MUA.
(Continue reading)

John Goerzen | 17 Mar 18:06 2006

Re: offlineimap, mutt and exchange.

On Fri, Mar 17, 2006 at 08:48:07AM -0800, Andrew Biggadike wrote:
> Steve Traylen <s.traylen <at> rl.ac.uk> wrote:
> 
> I posted about a similar problem last week.  I investigated enough to
> find that -- for some reason -- offlineimap is creating Maildir files
> with invalid flags.  The diff below fixed my problem and I haven't
> yet had time to figure out why savemessageflags() is getting called
> with invalid flags such as '(', '\\', 'e'. 

That is very odd, and I've never seen it.  Thanks for the diff, but I'd
rather identify the root cause of the problem.  If you can shed light on
that, it'd be great.

Note that OfflineIMAP 3.99.2 added:

  * OfflineIMAP now moves messages between new and cur in Maildir when
    flags have changed on the server.

That seems to be the correct behavior though.

What version of OfflineIMAP are you all using?

-- John

Andrew Biggadike | 17 Mar 18:40 2006
Picon

Re: offlineimap, mutt and exchange.

John Goerzen <jgoerzen <at> complete.org> wrote:
> On Fri, Mar 17, 2006 at 08:48:07AM -0800, Andrew Biggadike wrote:
> > I posted about a similar problem last week.  I investigated enough to
> > find that -- for some reason -- offlineimap is creating Maildir files
> > with invalid flags.  The diff below fixed my problem and I haven't
> > yet had time to figure out why savemessageflags() is getting called
> > with invalid flags such as '(', '\\', 'e'. 
> 
> That is very odd, and I've never seen it.  Thanks for the diff, but I'd
> rather identify the root cause of the problem.  If you can shed light on
> that, it'd be great.

I completely agree about the diff, and I'm glad to hear you say that;
I provided it simply as a temporary workaround.  I will see if I can
make some time to investigate further over the weekend.

> Note that OfflineIMAP 3.99.2 added:
> 
>   * OfflineIMAP now moves messages between new and cur in Maildir when
>     flags have changed on the server.
> 
> That seems to be the correct behavior though.

I have not had any problems with respect to messages being moved
between new and cur, just incorrect flags on the info portion of
messages in cur.

> What version of OfflineIMAP are you all using?

I'm using 4.0.11 out of the Debian testing package.
(Continue reading)

John Goerzen | 17 Mar 20:44 2006

Re: offlineimap, mutt and exchange.

On Fri, Mar 17, 2006 at 09:40:03AM -0800, Andrew Biggadike wrote:
> > What version of OfflineIMAP are you all using?
> 
> I'm using 4.0.11 out of the Debian testing package.

That's strange.  That version has been around for quite awhile with no
reports of things like that until just recently.  What version of Python
do you have?

Andrew Biggadike | 17 Mar 21:18 2006
Picon

Re: offlineimap, mutt and exchange.

John Goerzen <jgoerzen <at> complete.org> wrote:
> On Fri, Mar 17, 2006 at 09:40:03AM -0800, Andrew Biggadike wrote:
> > > What version of OfflineIMAP are you all using?
> > 
> > I'm using 4.0.11 out of the Debian testing package.
> 
> That's strange.  That version has been around for quite awhile with no
> reports of things like that until just recently.  What version of Python
> do you have?

2.3.5, also from Debian testing.  I wonder, then, if it's something
having to do with syncing from an Exchange IMAP server.  It wouldn't
surprise me if Exchange used non-standard IMAP flags that only MS
clients knew about.

Jon Riddle | 18 Mar 03:06 2006

Re: offlineimap, mutt and exchange.

I was responding more to Steve Traylen's original message, though now
that I have reread the post, I think his is different problem than
either of ours.  I was wondering if your Mutt access was through IMAP to
try to isolate the cause.

As John Goerzen pointed out, as of 3.99.2, offlineimap moves messages
from /new to /cur, which is what is changing my messages in Mutt from N
to O (I'm using 4.0.11).  You are correct in that this is a different
problem than yours, and apparently from Steve's as well.  I'll start
another thread with my question.

Jon

> Content-Length: 1719
> 
> Jon,
> 
> Jon Riddle <list <at> jdrnetworking.com> wrote:
> > If it's an Exchange thing, then why am I getting the same thing?  I'm
> > syncing between two BincIMAP servers. 
> 
> I believe that you and I are /not/ seeing the same problem.  As I said
> in an earlier email, I do not have any problems with messages moved
> between directories; those movements all seem correct to me.  What I
> am seeing is strange flags appended to the info portions of Maildir
> messages in the cur directory.  See my original post on this: 
> http://lists.complete.org/offlineimap <at> complete.org/2006/03/msg00000.html.gz
> 
> I just re-read your original mail and it seems like your problem is
> that messages go from N to O, whereas mine is that messages go from
(Continue reading)


Gmane