wayne | 4 Jan 03:28

SPF I-D for review: draft-schlitt-spf-classic-00.txt


fyi;

There is a new I-D for the SPF email anti-forgery system available for
review.  This draft tries to document the current practices of the
~1,000,000[1] published SPF records and ~10,000[1] deployed SPF
systems that are checking 20-100million emails per day.

See: http://www.ietf.org/internet-drafts/draft-schlitt-spf-classic-00.txt

Discussions about this, and previous, drafts have been taking place on
the spf-discuss <at> v2.listbox.com mailing list.  To subscribe or read
the archives, see http://spf.pobox.com/mailinglist.html

While I have been reading this mailing list for many months and will
note any comments posted here, sending email to the spf-discuss list
or to me personally is probably better than flooding this list.

I realize that the whole subject of SPF (and similar systems) has a
certain amount of controversy to it, but for the purposes of this
draft, I am very reluctant to try debate these issues.  The goal is to
document a de-facto standard.  Debates about better techniques, why
SPF is evil, etc. are probably best discussed on things like the IRTF
ASRG list, SPAM-L, the NANAE newsgroup, or on spf-discuss on a
separate thread/subject.

While SPF mostly deals with the [2]821 SMTP level, there are some
[2]822 issues, in particular, the Received-SPF header.  To be quite
honest, this header has kind of been neglected and could use more
refinement than most other parts of the draft.  One thing I just
(Continue reading)

Favicon

vMessage 1.1 Specification needed

Hello,
    Can I know the place where I can get the vMessage 1.1 specification
Thnx
Dore
Bruce Lilly | 10 Jan 15:20
Picon

Re: Attempts at establishing harmful conventions


On Thu December 2 2004 18:58, Steve Dorner wrote:
> Re: Attempts at establishing harmful conventions
>  Date: 2004-12-02 18:58
>  From: Steve Dorner <sdorner <at> qualcomm.com>
>  To: Kai Henningsen <kaih <at> khms.westfalen.de>
>  CC: ietf-822 <at> imc.org
>  
> At 8:27 PM +0200 12/2/04, Kai Henningsen wrote:
> >  > For that matter, how many permit a user to select multiple
> >>  messages to compose a response citing all of the selected
> >>  messages (including appropriate setting of In-Reply-To and
> >>  References fields)?
> >
> >Hopefully few, as there *is no* appropriate setting for those fields in 
> >that situation.
> 
> We actually hashed out a way that seemed right enough on this list a 
> year or so ago.

There was a discussion in June 2003, however if it can be
said to have reached any conclusions, I believe those
conclusions include:
1. imposing new syntax on the References field is not
   backwards compatible
2. expecting UAs to coordinate updates to multiple fields
   is probably over-optimistic
3. several existing UAs botch References and In-Reply-To
   fields, destroying their utility
4. repeating message-ids may make a field "too long" (there
   is of course no limit to the length of a logical (continued)
   field, however a msg-id doesn't look like "1", it looks
   more like
   "<supercalifragilisticexpialidoceous <at> xn--blurfl.xn--grimble.xn--pritz.foo.bar.com>",
   (that's a short example -- the domain name on the RHS can be
   up to 255 octets, and the local-part can also be lengthy)
   and one wouldn't want to have to repeat that)
5. rather than overload additional semantics on the References
   field, a new field or set of fields should be developed

So far, I haven't seen any detailed proposal to address the
issue in accordance with those conclusions (indeed, several
points are somewhat contradictory).

Charles Lindsey | 11 Jan 12:46
Picon
Picon

References with multiple precursore (was Attempts at establishing harmful conventions)


In <200501100920.17864.blilly <at> erols.com> Bruce Lilly <blilly <at> erols.com> writes:

>On Thu December 2 2004 18:58, Steve Dorner wrote:
>>  
>> At 8:27 PM +0200 12/2/04, Kai Henningsen wrote:
>> >  > For that matter, how many permit a user to select multiple
>> >>  messages to compose a response citing all of the selected
>> >>  messages (including appropriate setting of In-Reply-To and
>> >>  References fields)?
>> >
>> >Hopefully few, as there *is no* appropriate setting for those fields in 
>> >that situation.
>> 
>> We actually hashed out a way that seemed right enough on this list a 
>> year or so ago.

>There was a discussion in June 2003, however if it can be
>said to have reached any conclusions, I believe those
>conclusions include:

[snipped list of problems]

>So far, I haven't seen any detailed proposal to address the
>issue in accordance with those conclusions (indeed, several
>points are somewhat contradictory).

Yes, that is a reasonable summary of the problems that we found. Here is
another suggestion:

Currently, where a response has only one precursor, a discussion thread
consists of a tree, and the References header consists of the path from
the root of the tree to the message at the tip of the tree which contains
that References header.

Sometimes the path may get pruned, because its length has become
excessive. And sometimes implementations botch it in various ways, or even
omit it entirely. But by and large it is well understood, and MUAs manage
to display threads more or less OK.

If you want to extend that to responses to multiple precursors, then the
tree becomes a DAG (Directed Acyclic Graph), and there are many possible
paths from the root to each tip, and there is no way for the References
header to represent that situation. Moreover, inventing new syntax for the
References header leads to compatibility problems.

So here is a suggestion to get around the problem in a way that will
probaby allow existing MUAs to do a reasonable job:

Simply allow there to be multiple occurrences of the References header in
each message - one for each path from the root to the tip in question.

Then an updated MUA can look at them all, and has full information
available to give the best possible presentation. Meanwhile, an unupdated
MUA will probably just take the first, or the last, or a randomly chosen
one, and will at least produce a plausible thread.

And it is not actually necessary for the whole of each of the various
paths to appear in the various References headers. Just the segment that
differs from the others should suffice, though careful thought would have
to be given to defining exactly what the rule should be.

--

-- 
Charles H. Lindsey ---------At Home, doing my own thing------------------------
Tel: +44 161 436 6131 Fax: +44 161 436 6133   Web: http://www.cs.man.ac.uk/~chl
Email: chl <at> clerew.man.ac.uk      Snail: 5 Clerewood Ave, CHEADLE, SK8 3JU, U.K.
PGP: 2C15F1A9      Fingerprint: 73 6D C2 51 93 A0 01 E7 65 E8 64 7E 14 A4 AB A5

Bruce Lilly | 12 Jan 15:09
Picon

Re: References with multiple precursore [sic] (was Attempts at establishing harmful conventions)


On Tue January 11 2005 06:46, Charles Lindsey wrote:

> Currently, where a response has only one precursor, a discussion thread
> consists of a tree, and the References header consists of the path from
> the root of the tree to the message at the tip of the tree which contains
> that References header.
[...]
> If you want to extend that to responses to multiple precursors, then the
> tree becomes a DAG (Directed Acyclic Graph), and there are many possible
> paths from the root to each tip

Yes, as noted (more succinctly) by Adam M. Costello a year and a half
ago.

> So here is a suggestion to get around the problem in a way that will
> probaby allow existing MUAs to do a reasonable job:
> 
> Simply allow there to be multiple occurrences of the References header in
> each message - one for each path from the root to the tip in question.

No. Expressly forbidden by RFC 2822 section 3.6.2, which specifies
a maximum of one References field per header.

> Then an updated MUA can look at them all, and has full information
> available to give the best possible presentation. Meanwhile, an unupdated
> MUA will probably just take the first, or the last, or a randomly chosen
> one, and will at least produce a plausible thread.

That is not backwards compatible. We don't foist illegal content
(in this case multiple References fields) on widely deployed
implementations and shrug off the incompatibility with an off-hand
remark hypothesizing that those implementations will "probably"
cope in some way.

> And it is not actually necessary for the whole of each of the various
> paths to appear in the various References headers. Just the segment that
> differs from the others should suffice, though careful thought would have
> to be given to defining exactly what the rule should be.

Having failed to give careful thought, you still claim that deployed
MUAs "will at least produce a plausible thread".  Incredible.

You also failed to take note of the summary of conclusions of the
earlier discussion; your scheme, in addition to failing to be
backwards compatible:

a. ignores that "expecting UAs to coordinate updates to multiple fields
   is probably over-optimistic"; you fail to even mention how the
   multiple References fields which you propose would be updated when
   such a message is responded to.

b. ignores the fact that "several existing UAs botch References and
   In-Reply-To fields, destroying their utility"; illegally adding
   more instances of the field can only exacerbate that problem.

c. does not address repetition of message-ids and the bulk associated
   with such repetition; indeed, it involves such repetition

d. ignores the conclusion that "rather than overload additional
   semantics on the References field, a new field or set of fields
   should be developed"

Charles Lindsey | 13 Jan 11:47
Picon
Picon

Re: References with multiple precursors (was Attempts at establishing harmful conventions)


In <200501120909.05983.blilly <at> erols.com> Bruce Lilly <blilly <at> erols.com> writes:

>On Tue January 11 2005 06:46, Charles Lindsey wrote:

>> So here is a suggestion to get around the problem in a way that will
>> probaby allow existing MUAs to do a reasonable job:
>> 
>> Simply allow there to be multiple occurrences of the References header in
>> each message - one for each path from the root to the tip in question.

>No. Expressly forbidden by RFC 2822 section 3.6.2, which specifies
>a maximum of one References field per header.

Yawn!

Has it not occurred to you that what I am suggesting would require an
update of RFC 2822, and of several other documents as well. The whole
purpose of this discussion list is to examine suggested enhancements to
the mail protocols to see whether they are worth pursuing. So it is hardly
sensible to say "you can't consider that change to the protocols because
it would change the protocols".
> 
>> Then an updated MUA can look at them all, and has full information
>> available to give the best possible presentation. Meanwhile, an unupdated
>> MUA will probably just take the first, or the last, or a randomly chosen
>> one, and will at least produce a plausible thread.

>That is not backwards compatible. We don't foist illegal content
>(in this case multiple References fields) on widely deployed
>implementations and shrug off the incompatibility with an off-hand
>remark hypothesizing that those implementations will "probably"
>cope in some way.

No, it is not necessarily backwards incompatible, for reasons which I
tried to explain, but which you refuse even to listen to.

It may or may not be the case that existing implementations would break in
disastrous ways if more than one References header was found in a message.
I rather expect they would not, for the simple reason that implementors
would have had to go out of their way to cause such nasties, and
implementors are not noted for doing unnecessary work.

It is indeed the case that no present MUA would generate such a thing, and
might even thwart a user who tried to create it manually, but that is not
the point.

Would any transport fail to deliver it? I doubt it, because I doubt any
transport even bothers to look at the References header. Would any storage
agent fail to store it? I doubt it, because no-one would want a storage
agent so illiberal as to drop malformed messages on the floor (there are
too many malformed messages around for that). It might truncate one of the
'superfluous' headers, but that is not a cause of serious harm.

Would any MUA fail to display the message altogether? No, for the same
reason. Would an MUA fail to display it in a sensible place in a thread?
Yes, that is indeed the problem that might arise. But my guess is that it
would either fail to include the message in any thread at all, or it would
thread it based upon examination of one of the References headers only,
and my reason for supposing that is that I cannot imagine any way of
writing an agent that was expecting to thread based on examination of one
header that would have any effect other than one of those. But the only
way to find out would be to try it on various existing agents, and see.

Yes, the behaviour of such an agent wouold be sub-optimal, but if you
introduce new functionality into a protocol, then you expect sub-optimal
behaviour from agents that have not been upgraded. The same would be true
if you introduced some brand new header to achieve the new functionality,
but that would not amount to backwards incompatibility. There is no gain
without pain.

Anyway, I shall now try to post messages with multiple Reference headers
to this list, so that we can gauge the extent of any possible problems.
Would anyone who completely fails to see them please report here.
Otherwise, please reply to them.

> 
>> And it is not actually necessary for the whole of each of the various 
>> paths to appear in the various References headers. Just the segment that 
>> differs from the others should suffice, though careful thought would have
>> to be given to defining exactly what the rule should be.

>Having failed to give careful thought, you still claim that deployed
>MUAs "will at least produce a plausible thread".  Incredible.

>You also failed to take note of the summary of conclusions of the
>earlier discussion; your scheme, in addition to failing to be
>backwards compatible:

>a. ignores that "expecting UAs to coordinate updates to multiple fields
>   is probably over-optimistic"; you fail to even mention how the
>   multiple References fields which you propose would be updated when
>   such a message is responded to.

I am making a suggestion for a method that may be worth looking at further,
and you complain that I have not described every last nuance of a new
protocol. It I had described a whole new protocol at that level, you would
have complained that it was premature to describe the gory details when
the general principle had not been established.

>b. ignores the fact that "several existing UAs botch References and
>   In-Reply-To fields, destroying their utility"; illegally adding
>   more instances of the field can only exacerbate that problem.

So you are saying that the current existence of broken implementations
should be a bar to all future protocol development?

>c. does not address repetition of message-ids and the bulk associated
>   with such repetition; indeed, it involves such repetition

Any solution will involve additional bulk (because there is additional
information to be conveyed). Exactly how much bulk is one of those gory
details which would have to be sorted out if this idea became a serious
endeavour.

>d. ignores the conclusion that "rather than overload additional
>   semantics on the References field, a new field or set of fields
>   should be developed"

No, the previous discussion reached no such conclusion. Indeed it reached
no consensus at all, except that there were difficulties with all methods
proposed up to that time. There may well be difficulties with what I now
suggest, but progress will never be made unless people are prepared to
evaluate such difficulties to see whether they are outweighed by the
advantages to be gained.

--

-- 
Charles H. Lindsey ---------At Home, doing my own thing------------------------
Tel: +44 161 436 6131 Fax: +44 161 436 6133   Web: http://www.cs.man.ac.uk/~chl
Email: chl <at> clerew.man.ac.uk      Snail: 5 Clerewood Ave, CHEADLE, SK8 3JU, U.K.
PGP: 2C15F1A9      Fingerprint: 73 6D C2 51 93 A0 01 E7 65 E8 64 7E 14 A4 AB A5

Charles Lindsey | 13 Jan 11:52
Picon
Picon

Experiment with multiple Reference headers (was References with multiple precursore [sic])


This message contains two Reference headers. Please report whether it is
delivered intact and whether it causes any other problems, such as
peculiar threading.

For this first experiment, both the Reference headers are identical. If
this causes no obvious problems, then I shall try further examples
representing various DAGs.

--

-- 
Charles H. Lindsey ---------At Home, doing my own thing------------------------
Tel: +44 161 436 6131 Fax: +44 161 436 6133   Web: http://www.cs.man.ac.uk/~chl
Email: chl <at> clerew.man.ac.uk      Snail: 5 Clerewood Ave, CHEADLE, SK8 3JU, U.K.
PGP: 2C15F1A9      Fingerprint: 73 6D C2 51 93 A0 01 E7 65 E8 64 7E 14 A4 AB A5

Keith Moore | 13 Jan 15:47
Picon

Re: Experiment with multiple Reference headers (was References with multiple precursore [sic])


> 
> This message contains two Reference headers. Please report whether it is
> delivered intact and whether it causes any other problems, such as
> peculiar threading.
> 
> For this first experiment, both the Reference headers are identical. If
> this causes no obvious problems, then I shall try further examples
> representing various DAGs.

such experiments can do nothing to demonstrate whether this works in the
Internet as a whole, as the recipients of this list are not even close to
being a representative sample of Internet users.

furthermore, you don't seem willing to accept or act on negative results,
as evidenced by your continued insistence on using LIST: despite having 
been informed that it confuses one widely used mail user agent.

if you're not going to heed negative results, and positive results are
meaningless, why should anyone bother to help you with these experiments?

Frank Ellermann | 13 Jan 19:26
Picon
Picon

Re: Experiment with multiple Reference headers


Charles Lindsey wrote:

> This message contains two Reference headers.

Not "here" = on GMaNe,

> Please report whether it is delivered intact

It's not "intact", one of your References didn't make it.  
If GMaNe would be my gateway I'd be tempted to reject it
instead of removing any extraneous References.

                    Bye, Frank

P.S.: courtesy copy because I'm not subscribed and maybe
      my reply via GMaNe doesn't make it to the list.

Richard Clayton | 13 Jan 20:03

Re: Experiment with multiple Reference headers (was References with multiple precursore [sic])


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

>Return-path: <owner-ietf-822 <at> mail.imc.org>
>To: LIST: ietf-822 <at> imc.org;
>Xref: clerew local.mime:4338
>Newsgroups: local.mime
>Path: clerew!chl
>From: "Charles Lindsey" <chl <at> clerew.man.ac.uk>
>Subject: Experiment with multiple Reference headers
> (was References with multiple precursore [sic])
>Message-ID: <IA94w4.B0K <at> clerew.man.ac.uk>
>X-Newsreader: NN version 6.5.2 (NOV)
>References: <200411302014.06108.blilly <at> erols.com> <200501100920.17864.blilly <at> ero
>ls.com> <IA5I0q.JCI <at> clerew.man.ac.uk> <200501120909.05983.blilly <at> erols.com>
>Date: Thu, 13 Jan 2005 10:52:52 GMT
>Lines: 18
>Sender: owner-ietf-822 <at> mail.imc.org
>Precedence: bulk
>List-Archive: <http://www.imc.org/ietf-822/mail-archive/>
>List-ID: <ietf-822.imc.org>
>List-Unsubscribe: <mailto:ietf-822-request <at> imc.org?body=unsubscribe>
>
>
>This message contains two Reference headers. 

not here it didn't

>Please report whether it is
>delivered intact 

exactly how might one know ?

I've snipped a lot of transport stuff already ... but I wouldn't like to
guess how much of what remains was added by that process -- or whether
other things have disappeared on the way

>and whether it causes any other problems, such as
>peculiar threading.

it always strikes me that the sort of people who combine two threads
into one and answer bits of both at random (and who therefore demand two
reference headers so that their valuable contributions can be correctly
placed into the responses) are exactly the sort of people I find have
contributed very little to the conversation :(

viz: It might be elitist, but I find that the directed tree graphs we
have at the moment work remarkably well --- and I don't see why anyone
wants to encourage random connections between multiple discussions :(

>For this first experiment, both the Reference headers are identical. If
>this causes no obvious problems, then I shall try further examples
>representing various DAGs.

also, I endorse Keith Moore's point about the likely value of the
experiments given the huge number of clients out there -- are you
expecting me to feed this through a few dozen of my Perl scripts as
well, to see what they do ? If they die("multiple References") then
should we just criticise my coding style ?

- -- 
richard @ highwayman . com                       "Nothing seems the same
                          Still you never see the change from day to day
                                And no-one notices the customs slip away"

-----BEGIN PGP SIGNATURE-----
Version: PGPsdk version 1.7.1

iQA/AwUBQebGFJoAxkTY1oPiEQKLzgCePT+a1UKZIGAtsbFewo1cgSo6UT0AoPD0
U9p68E20foKVX4+UfiBcsmax
=zSiS
-----END PGP SIGNATURE-----


Gmane