Jiankang YAO | 1 Feb 2012 04:01
Picon

Re: Determine for EAI to meet at IETF83 or not

If there are some important issue to be discussed, I think that it should be pop-imap-downgrade issue.

Anyway, I will be in Paris.

Jiankang Yao

----- Original Message ----- 
From: "Joseph Yee" <jyee <at> afilias.info>
To: <ima <at> ietf.org>
Sent: Tuesday, January 31, 2012 6:11 PM
Subject: [EAI] Determine for EAI to meet at IETF83 or not

All,

I made a session request for EAI at upcoming IETF (see attached).  However, it's likely that John and I would
not be in Paris.  I would like to ask who will go to Paris, and what issues are the WG facing that we need a face to
face meeting to resolve.  Having a meeting or not will be determined by attendance and issues at hand.  If
there will be meeting in Paris, then I will ask for volunteers to help hosting the session.

Regards,
Joseph, co-chair EAI

--------------------------------------------------------------------------------

> _______________________________________________
> IMA mailing list
> IMA <at> ietf.org
> https://www.ietf.org/mailman/listinfo/ima
>
(Continue reading)

John Levine | 2 Feb 2012 16:59

Re: Unhappy with the complexity of pop-imap-downgrade

In article <4F268A40.1090408 <at> gulbrandsen.priv.no> you write:
>TL;DR: Change downgrading to support what's most important to the end 
>user, and drop the rest. Lessen the amount of code provided to implement 
>downgrade to the minimum possible.

I have to agree.  The current document is basically a detailed design
to tunnel EAI messages through hostile MUAs that is so complex that it
seems unlikely to me that two implementations would ever match in
practice.  If that's what you want to do, you can always wrap the
messages as message/global attachments.

Arnt's suggested changes seem right, chop it down to the minimum
needed to produce a version of a message that won't break MUAs.

R's,
John
John C Klensin | 2 Feb 2012 17:19

Re: Unhappy with the complexity of pop-imap-downgrade


--On Thursday, February 02, 2012 15:59 +0000 John Levine
<johnl <at> taugh.com> wrote:

> In article <4F268A40.1090408 <at> gulbrandsen.priv.no> you write:
>> TL;DR: Change downgrading to support what's most important to
>> the end  user, and drop the rest. Lessen the amount of code
>> provided to implement  downgrade to the minimum possible.
> 
> I have to agree.  The current document is basically a detailed
> design to tunnel EAI messages through hostile MUAs that is so
> complex that it seems unlikely to me that two implementations
> would ever match in practice.  If that's what you want to do,
> you can always wrap the messages as message/global attachments.
> 
> Arnt's suggested changes seem right, chop it down to the
> minimum needed to produce a version of a message that won't
> break MUAs.

<role cochair>

For the moment, let me note that there are other options and
that circumstances may differ in different environments.  Just
to help with the discussion (this isn't a proposal yet, much
less one that I'm ready to advocate), note that this entire
downgrading model is something that happens between the delivery
MTA, the mail store, and the MUA.   We make strong assumptions
here and elsewhere about that being a relatively tight,
mutual-consent, relationship.   That is not traditionally IETF
territory.  More important, the nature of interoperability
(Continue reading)

Arnt Gulbrandsen | 2 Feb 2012 17:36
Picon
Favicon
Gravatar

Re: Unhappy with the complexity of pop-imap-downgrade

To be honest I think it's not.

This isn't the common path. Sending mail to people who cannot really read it is an exceptional activity, not the kind of thing that warrants very much server code or several different protocol variants.

Arnt

_______________________________________________
IMA mailing list
IMA <at> ietf.org
https://www.ietf.org/mailman/listinfo/ima
John R Levine | 6 Feb 2012 02:42

Re: Unhappy with the complexity of pop-imap-downgrade

> The fact that we've gone a few years without any discussion along this 
> line certainly entitles the existing document to the presumption that it 
> is the way the WG wants to go.

You're right, although it might also mean that nobody's been paying 
attention recently.  It feels to me like a vestige of the downgrade on 
demand model that EAI rejected for mail transport.

> I wonder if it would be possible to define a family of
> self-consistent downgrade options, such that we could preserve
> the current model for those environments that needed it

Possibly.  In order of distance from the current text, I'd suggest:

1.  Since downgrades aren't reversible, there isn't really an interop 
reason to specify the details.  Say that for headers that contain UTF8 
text, do some combination of MIME encoding where possible (most headers), 
redacting parts of them (address headers), and throwing them away (trace 
headers).

2.  To deliver an EAI message to a non-EAI MUA, wrap it as a 
message/global, copy whatever headers you can into the wrapper message, 
and it's the MUA's problem.

3.  John's suggestion, synhesize a DSN that says you need a better MUA and 
deliver that to the user.

4.  For the rest of EAI, we made the decision that the EAI and legacy mail 
streams are parallel but separate, if you want to send an EAI message and 
there isn't an EAI path to the recipient, you lose.  Why should this be 
any different?  If the user doesn't have an EAI MUA, he can't pick up mail 
from an EAI POP or IMAP server.

My inclination leans toward #2, since MUAs that don't support EAI can 
often nonetheless display UTF-8 text.

Regards,
John Levine, johnl <at> taugh.com, Taughannock Networks, Trumansburg NY
"I dropped the toothpaste", said Tom, crestfallenly.
Arnt Gulbrandsen | 6 Feb 2012 12:17
Picon
Favicon
Gravatar

Re: Unhappy with the complexity of pop-imap-downgrade

Fwiw, the reason for me to implement a kind of downgrade is that EAI mail may appear in folders whet you don't expect it, such as the one in which you store this mailing list.

It would be rather irritating if, say, your EAI-ignorant smartphone could not read any mail in that folder merely because someone posted a message to the list using EAI. Downgrade needs to be good enough to let you read the rest of your mail and have some idea of what's in the mail you cannot properly read. Locking your phone out of the entire folder would not be good.

Arnt

_______________________________________________
IMA mailing list
IMA <at> ietf.org
https://www.ietf.org/mailman/listinfo/ima
fujiwara | 6 Feb 2012 12:19
Picon
Favicon

Re: Unhappy with the complexity of pop-imap-downgrade

The purpose of post-delivery message downgrading is
that POP/IMAP servers can send/remove internalionalized messages
to traditional POP/IMAP clients
and receivers can know they received internationalized messages.

No popimap-downgrading, POP/IMAP server could not send EAI messages to
traditional clients and POP server cound not remove the messages.

> From: "John R Levine" <johnl <at> taugh.com>
> 1.  Since downgrades aren't reversible, there isn't really an interop
> reason to specify the details.  Say that for headers that contain UTF8
> text, do some combination of MIME encoding where possible (most
> headers), redacting parts of them (address headers), and throwing them
> away (trace headers).

Current draft.
Tried not to break current MUAs. (Except allowing empty from:).

> 2.  To deliver an EAI message to a non-EAI MUA, wrap it as a
> message/global, copy whatever headers you can into the wrapper
> message, and it's the MUA's problem.

Do you think that end user understands what happend?

> 3.  John's suggestion, synhesize a DSN that says you need a better MUA
> and deliver that to the user.
> 
> 4.  For the rest of EAI, we made the decision that the EAI and legacy
> mail streams are parallel but separate, if you want to send an EAI
> message and there isn't an EAI path to the recipient, you lose.  Why
> should this be any different?  If the user doesn't have an EAI MUA, he
> can't pick up mail from an EAI POP or IMAP server.

Any MUA can access EAI POP servers which offer EAI messages for the MUA.

Port number and protocols are the same.

--
Kazunori Fujiwara, JPRS <fujiwara <at> jprs.co.jp>
John R Levine | 6 Feb 2012 16:15

Re: Unhappy with the complexity of pop-imap-downgrade

> Fwiw, the reason for me to implement a kind of downgrade is that EAI mail may appear in folders whet you don't
expect it, such as the one in which you store this mailing list.

Understood, but there's simpler ways to do that than to specify a detailed 
non-reversible downgrade scheme.

Regards,
John Levine, johnl <at> taugh.com, Taughannock Networks, Trumansburg NY
"I dropped the toothpaste", said Tom, crestfallenly.
John R Levine | 6 Feb 2012 16:37

Re: Unhappy with the complexity of pop-imap-downgrade

>> 1.  Since downgrades aren't reversible, there isn't really an interop
>> reason to specify the details.  Say that for headers that contain UTF8
>> text, do some combination of MIME encoding where possible (most
>> headers), redacting parts of them (address headers), and throwing them
>> away (trace headers).
>
> Current draft.
> Tried not to break current MUAs. (Except allowing empty from:).

Agreed, but we could strip out a great deal of the detail and just say 
here are the three techniques you can use to fix headers, use whichever 
ones you want.  Since the transformations aren't reversible and the user 
can't reply to a message with an EAI return address, the details don't 
really matter.

>> 2.  To deliver an EAI message to a non-EAI MUA, wrap it as a
>> message/global, copy whatever headers you can into the wrapper
>> message, and it's the MUA's problem.
>
> Do you think that end user understands what happend?

I don't know, but I don't see any reason to think that it's more or less 
baffling than a message full of Downgraded-this and redacted that headers. 
The IETF has never been very good at user interface design.

>> 4.  For the rest of EAI, we made the decision that the EAI and legacy
>> mail streams are parallel but separate, if you want to send an EAI
>> message and there isn't an EAI path to the recipient, you lose.  Why
>> should this be any different?  If the user doesn't have an EAI MUA, he
>> can't pick up mail from an EAI POP or IMAP server.
>
> Any MUA can access EAI POP servers which offer EAI messages for the MUA.
>
> Port number and protocols are the same.

We could simplify section 3.1 of RFC5721bis and section 4 or RFC5738bis, 
so that if the client hasn't said UTF8, requests to retrieve EAI messages 
fail.  They currently offer a choice between fail and downgrade, just take 
out the downgrade choice.

Regards,
John Levine, johnl <at> taugh.com, Taughannock Networks, Trumansburg NY
"I dropped the toothpaste", said Tom, crestfallenly.
John C Klensin | 7 Feb 2012 06:39

Question about AUTH48 text for 5336bis/ proto-RFC 6531

Hi.

We have encountered a small problem at AUTH48 with some text in
5336bis (RFC-to-be 6531).  The text in Section 3.2 of
draft-ietf-eai-rfc5336bis-16 (just before the numbered list)
reads:

	"Instead, if a UTF8SMTPbis-aware SMTP client
	"(UTF8SMTPbis-aware SMTP sender) attempts to transfer an
	internationalized message and encounters an SMTP server
	that does not support the extension, it MUST make one of
	the following three choices and the priority order is 1, 2
	and 3." 

The last part of that sentence was added in response to a Last
Call comment.  If there is a moral here, it is that folks
should be really careful with changes in response to even
seemingly-editorial comments made during Last Call.  In any
event, "the priority order is 1, 2 and 3" is ambiguous as to
whether the WG thinks choice 1 or choice 3 should come first.

But it is a little worse than that because, in trying to fix
this, we discovered that the phrasing of those three choices
may not have been quite right.  In particular, the third case
seemed to contradict a very carefully-worded exception case in
RFC 5321.

To be clear what we are talking about before I outline what I
think are the options and ask for a decision, the current
AUTH48 working text reads (please don't worry about spacing):

   ...Instead, if an SMTPUTF8-aware SMTP client
   (sender) attempts to transfer an internationalized message
   and encounters an SMTP server that does not support the
   extension, it MUST make one of the following three choices.
   These are listed in decreasing order of preference.

   1.  It MAY either reject the message during the SMTP
       transaction or
       accept the message and then generate and transmit a
       notification of non-deliverability.  Such notification
       MUST be done as specified in RFC 5321 [RFC5321], RFC
       3464 [RFC3464], and RFC 6533 [RFC6533].

   2.  If and only if the SMTPUTF8-aware SMTP client (sender)
      is a
       Message Submission Agent (MSA) [RFC6409] [RFC5598], it
       MAY choose its own way to deal with this scenario
       according to the provisions of RFC 6409 [RFC6409] or its
       future versions.  However, the detailed specification of
       this process and its results are outside the scope of
       this document.

   3.  It MAY find an alternate route to the destination that
       permits
       SMTPUTF8.  That route MAY be discovered by trying
       alternate Mail eXchanger (MX) hosts (using preference
       rules as specified in RFC 5321) or using other means
       available to the SMTPUTF8-aware SMTP client.

There was an earlier stage in which the text was the same, but
"increasing" was substituted for "decreasing".

With an adjustment for what RFC 5321 actually allows, Pete
summarized these three cases as: 

	1. It MAY reject the message.
	2. If and only if it's a submission server, it MAY
	   something of its own choosing. 
	3. It MAY try another MX.

	If we take RFC 5321 Section 2.2.3 into account, 3 can be
	expanded to "It MAY try another MX if it decides to do so
	based on the particular circumstances."

It is absolutely clear to us (myself, Joseph, and Pete) that
the WG intended to encourage letting submission servers fix up
messages if they knew how (case 2 above) and rejecting/bouncing
messages back to those servers so that they could fix things
(case 1 above).  The third case is certainly reasonable as long
as it makes clear, somehow, that the circumstances are
important.  Indeed, although it is a useful clarification that
RFC 5321 Section 2.2.3 may apply to this particular extension,
it actually adds nothing to what RFC 5321 would permit if this
document said nothing at all.

So we probably need to fix the text (and to spend as little
time as possible making a decision).  I think the following are
a complete list of options although, if someone has a better
idea, he or she should raise it.  I hope that the WG can reach
consensus by mid-week (please make comments quickly so the WG
has a chance to discuss them if needed or, if you need more
time, say so).  If there is no consensus on choice of text,
Joseph, Jiankang, Pete, and I will make a decision.  If we have
to make a decision, we will consider both preferences for
particular approaches and remarks along the line of "do
whatever you like as long as you don't pick option 99".  Note
that I'm not asking whether the WG still believes in correction
by submission servers, etc.: those issues are closed unless
someone comes up with a _really_ strong argument, presumably
strong enough to put all of this back into WG and IETF LC.  We
are only trying to figure how to most clearly and accurately
reflect the WG's existing conclusions in the document.

Note that whatever is chosen may still be fine-tuned
editorially.

These options are deliberately in no particular order:

A.  Drop case 3 entirely to be consistent with the model of
putting nothing in these specs that is really part of the base
protocol (RFC 5321 in this case) and then clean up the text.
Note that this drops one piece of information that is not in
the base protocol, i.e., the WG's belief that SMTPUTF8 is an
extension to which Section 2.2.3 might reasonably be applied.

   ...Instead, if an SMTPUTF8-aware SMTP client
   (sender) attempts to transfer an internationalized message
   and encounters an SMTP server that does not support the
   extension, it SHOULD make one of the following two choices.
   These are listed in decreasing order of preference.

   1.  It MAY either reject the message during the SMTP
       transaction or
       accept the message and then generate and transmit a
       notification of non-deliverability.  Such notification
       MUST be done as specified in RFC 5321 [RFC5321], RFC
       3464 [RFC3464], and RFC 6533 [RFC6533].

   2.  If and only if the SMTPUTF8-aware SMTP client (sender)
       is a
       Message Submission Agent (MSA) [RFC6409] [RFC5598], it
       MAY choose its own way to deal with this scenario
       according to the provisions of RFC 6409 [RFC6409] or its
       future versions.  However, the detailed specification of
       this process and its results are outside the scope of
       this document.

Note the change from MUST to SHOULD because there is another
choice (the MX searching of RFC 5321 Section 2.2.3) out there.
It could just be left alone on the theory that whatever 5321
says overrides whatever is said here.   Or we could explain the
SHOULD, but that takes us back to three cases and...

B.  We leave all three cases as above and come up with revised
text as needed to clarify both the order and fact that case 3
isn't to be used unless the client has the information
(presumably out of band) that permits it to conform to the key
requirement in RFC 5321 Section 2.2.3.  That requirement
(second paragraph of 2.2.3) starts:

   In particular, if an extension implies that the delivery
   path normally supports special features of that extension,
   and an intermediate SMTP system finds a next hop that does
   not support the required extension, it MAY choose, based on
   the specific extension and circumstances, to requeue the
   message and try later and/or try an alternate MX host.

Note that 2.2.3 goes on to impose additional requirements on
timeouts in that case.

C.  We conclude that the "preference" order doesn't actually
mean much in this case.  From that point of view, option 2
applies only if the client is a submission server, option 3
applies only if the client has special additional information
or circumstances (information or circumstances that presumably
could override either of the other preference), and option 1
applies otherwise.  If we then turn the wording around a bit,
we would get something like (borrowing text from the above
where possibe)...

   ...Instead, if an SMTPUTF8-aware SMTP client
   (sender) attempts to transfer an internationalized message
   and encounters an SMTP server that does not support the
   extension, the best action for it to take depends on other
   conditions.  In particular:

    o If it is a Message Submission Agent (MSA) [RFC6409]
      [RFC5598], it MAY choose its own way to deal with this
	  scenario using the wide discretion for changing addresses
	  or otherwise fixing up and transforming messages allowed
	  by RFC 6409. As long as the resulting message conforms
	  to the requirements of RFC 5321 (i.e., without the
	  SMTPUTF8 extension), the details of that transformation
	  are outside the scope of this document.  

    o Otherwise, it SHOULD reject the message.  As usual, this
      can be done either by generating an appropriate reply
	  during the SMTP transaction or by accepting the message
	  and then generating and transmit a non-delivery
	  notification.  If the latter choice is made, the
	  notification process MUST conform to the requirements of
	  RFC 5321 [RFC5321], RFC 3464 [RFC3464], and RFC 6533
	  [RFC6533]. 

    o As specified in RFC 5321 Section 2.2.3, an SMTP client
	  with additional information and/or knowledge of special
	  circumstances MAY choose to requeue the message and try
	  later and/or try an alternate MX host as specified in
	  that section.

D.  Just about the same thing could be done, in somewhat more
terse form, by saying something like:

	"If the client is a submission agent [RFC6409], it SHOULD,
	if possible, fix the message to be consistent with SMTP
	requirements (in the absence of this extension) and resend
	the transformed message.   If it cannot or is not a
	submission agent, it SHOULD reject or bounce the message
	to give the user an opportunity to make her own
	corrections.  Alternately, if the client has sufficient
	additional information to know that special circumstances
	exist, it MAY examine hosts specified in DNS MX records
	with equal or lower preferences as specified in RFC 5321
	Section 2.2.3."

That approach assumes that the NDN requirements are covered in
other standards and need not be repeated here.  Of course, they
could be listed if the WG prefers.

     john

Gmane