From owner-idn@ops.ietf.org  Tue Mar  1 03:15:48 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id DAA01387
	for <idn-archive@lists.ietf.org>; Tue, 1 Mar 2005 03:15:47 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D62QI-000JJE-3D
	for idn-data@psg.com; Tue, 01 Mar 2005 08:08:06 +0000
Received: from [128.32.132.165] (helo=nicemice.net)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1D62QG-000JFU-9z
	for idn@ops.ietf.org; Tue, 01 Mar 2005 08:08:04 +0000
Received: from amc by nicemice.net with local (Exim 3.35 #1 (Debian))
	id 1D61P7-00063f-00
	for <idn@ops.ietf.org>; Mon, 28 Feb 2005 23:02:49 -0800
Date: Tue, 1 Mar 2005 07:02:48 +0000
From: "Adam M. Costello" <idn.amc+0@nicemice.net.RemoveThisWord.cnri.reston.va.us>
To: IETF idn working group <idn@ops.ietf.org>
Subject: Re: [idn] something a little lighter for the weekend
Message-ID: <20050301070248.GA22381~@nicemice.net>
Reply-To: IETF idn working group <idn@ops.ietf.org>
References: <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <20050226081913.GD14956~@nicemice.net> <4220D1C4.7000909@vanderpoel.org> <20050228015545.GA23896~@nicemice.net> <003101c51db1$d8a16580$030aa8c0@DEWELL>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <FD16260E2EDF204E80A22FB904A425C30BF8EBD9@WIN-MSG-10.wingroup.windeploy.ntdev.microsoft.com> <003101c51db1$d8a16580$030aa8c0@DEWELL>
User-Agent: Mutt/1.5.6+20040722i
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Doug Ewell <dewell@adelphia.net> wrote:

> There may be 52 scripts currently encoded in Unicode, but I am sure
> Unicode does not claim that is the total number of scripts in the
> world.  Others can and will be encoded.

Michel Suignard <michelsu@windows.microsoft.com> wrote:

> The 2 current amendments of ISO/IEC 10646 (The ISO sibling of Unicode)
> being processed are adding about 10 new scripts.  And a new amendment
> will be initiated in September with few more scripts.  Any scheme
> based on a finite number of scripts is doomed.

Of course the number 52 would not be hard-coded into the policy.  It
would be expressed as "the number of Unicode scripts supported by the
latest version of IDNA".

Unicode tends to grow linearly, not exponentially, so that shouldn't
present a scaling problem.

AMC



From owner-idn@ops.ietf.org  Tue Mar  1 18:57:45 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id SAA25556
	for <idn-archive@lists.ietf.org>; Tue, 1 Mar 2005 18:57:44 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6H8O-000E4e-28
	for idn-data@psg.com; Tue, 01 Mar 2005 23:50:36 +0000
Received: from [193.201.200.34] (helo=tuschin.blackcatnetworks.co.uk)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D6H8M-000E4L-RC
	for idn@ops.ietf.org; Tue, 01 Mar 2005 23:50:34 +0000
Received: from grmarkham.plus.com ([80.229.30.161] helo=[192.168.1.100])
	by tuschin.blackcatnetworks.co.uk with asmtp (Exim 3.35 #1 (Debian))
	id 1D6H8M-0002qc-00
	for <idn@ops.ietf.org>; Tue, 01 Mar 2005 23:50:34 +0000
Message-ID: <4225A87B.7030204@mozilla.org>
Date: Wed, 02 Mar 2005 11:50:19 +0000
From: Gervase Markham <gerv@mozilla.org>
Organization: mozilla.org
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: idn@ops.ietf.org
Subject: Re: [idn] nameprep2 and the slash homograph issue
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <20050223105244.GE21463~@nicemice.net> <421CA114.9090302@vanderpoel.org> <20050224081721.GB12336~@nicemice.net> <421DEDFF.2000300@vanderpoel.org>
In-Reply-To: <421DEDFF.2000300@vanderpoel.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-1.6 required=5.0 tests=AWL,BAYES_00,
	DATE_IN_FUTURE_06_12,WHY_WAIT autolearn=no version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Erik van der Poel wrote:
> Here I agree with you. I'm not going to try to come up with the wording 
> for that, but this morning I started to think that the right-to-left DNS 
> and IDN spoofing problems *could* be addressed at the UI level by 
> providing a *tool* that security-conscious users could *choose* to use.

While security-conscious users are always less at risk than ordinary 
users, thinking in terms of a tool is IMO wrong.

> I'm thinking of a tool that might be implemented as an extension for 
> Mozilla, for example. It would offer to display domain names in the safe 
> order, i.e. left-to-right for users whose main language is 
> left-to-right. I have not heard of any UIs that offer top-to-bottom in 
> their menus, dialogs, etc, so I would guess that this would be omitted 
> in the extension too, though right-to-left might be offered for 
> right-to-left users (many of which are in the Middle East -- Hebrew and 
> Arabic).

The problem this is supposed to mitigate is mitigated in Firefox by the 
domain-only indicator in the status bar.

> In addition, such a tool would offer to display domain names in a clear 
> font, unlike the sans-serif that is commonly used today. This would make 
> the distinction between lowercase l and digit 1 clearer. And it would 
> separate the domain name from its context, e.g. using color.

Assuming we could determine such a font, why would we not always use it? 
Why wait for a tool to be deployed?

Gerv



From owner-idn@ops.ietf.org  Tue Mar  1 18:59:21 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id SAA25658
	for <idn-archive@lists.ietf.org>; Tue, 1 Mar 2005 18:59:21 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6HD6-000F5o-EG
	for idn-data@psg.com; Tue, 01 Mar 2005 23:55:28 +0000
Received: from [193.201.200.34] (helo=tuschin.blackcatnetworks.co.uk)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D6HD5-000F5a-Qc
	for idn@ops.ietf.org; Tue, 01 Mar 2005 23:55:27 +0000
Received: from grmarkham.plus.com ([80.229.30.161] helo=[192.168.1.100])
	by tuschin.blackcatnetworks.co.uk with asmtp (Exim 3.35 #1 (Debian))
	id 1D6HD5-0003pB-00
	for <idn@ops.ietf.org>; Tue, 01 Mar 2005 23:55:27 +0000
Message-ID: <4225A9A0.3020800@mozilla.org>
Date: Wed, 02 Mar 2005 11:55:12 +0000
From: Gervase Markham <gerv@mozilla.org>
Organization: mozilla.org
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: idn@ops.ietf.org
Subject: Re: [idn] process
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org>
In-Reply-To: <421EA0C9.1010500@vanderpoel.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-1.7 required=5.0 tests=AWL,BAYES_00,
	DATE_IN_FUTURE_06_12 autolearn=no version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Erik van der Poel wrote:
> 1. Is this the right time to start working on Internet Drafts leading up 
> to new version(s) of the IDNA RFC(s)? If not, when?

IMO, no. Nothing like consensus has yet emerged. However, I feel that 
the way forward will become clear eventually - we aren't going round in 
circles. It's just a big issue.

Gerv



From owner-idn@ops.ietf.org  Tue Mar  1 19:08:17 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id TAA26052
	for <idn-archive@lists.ietf.org>; Tue, 1 Mar 2005 19:08:16 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6HLl-000HRD-If
	for idn-data@psg.com; Wed, 02 Mar 2005 00:04:25 +0000
Received: from [193.201.200.34] (helo=tuschin.blackcatnetworks.co.uk)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D6HLk-000HQq-OZ
	for idn@ops.ietf.org; Wed, 02 Mar 2005 00:04:24 +0000
Received: from grmarkham.plus.com ([80.229.30.161] helo=[192.168.1.100])
	by tuschin.blackcatnetworks.co.uk with asmtp (Exim 3.35 #1 (Debian))
	id 1D6HLW-0008Ep-00; Wed, 02 Mar 2005 00:04:10 +0000
Message-ID: <4225ABAB.60002@mozilla.org>
Date: Wed, 02 Mar 2005 12:03:55 +0000
From: Gervase Markham <gerv@mozilla.org>
Organization: mozilla.org
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Paul Hoffman <phoffman@imc.org>
CC: Erik van der Poel <erik@vanderpoel.org>, John C Klensin <klensin@jck.com>,
        idn@ops.ietf.org
Subject: Re: [idn] Re: character tables
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <421FA55B.9000308@vanderpoel.org> <421FCBD7.8000805@vanderpoel.org> <42227EBF.9040703@vanderpoel.org> <45781B7428C6AA07C3B283BD@scan.jck.com> <42229BBC.8020608@vanderpoel.org> <p0621021ebe484f52c0c5@[10.20.30.249]>
In-Reply-To: <p0621021ebe484f52c0c5@[10.20.30.249]>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-1.6 required=5.0 tests=AWL,BAYES_00,
	DATE_IN_FUTURE_06_12 autolearn=no version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Paul Hoffman wrote:
> Yes. It turned out to be a bad idea that got more complicated and less 
> justifiable (that is, worse) with each rev, so I let it die. Others 
> (notably JET) tried different things.

Paul,

Could you tell us more about the problems you found with the ideas of 
bundling and blocking?

Gerv



From owner-idn@ops.ietf.org  Tue Mar  1 19:19:16 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id TAA26771
	for <idn-archive@lists.ietf.org>; Tue, 1 Mar 2005 19:19:16 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6HXB-000Jeu-KM
	for idn-data@psg.com; Wed, 02 Mar 2005 00:16:13 +0000
Received: from [208.184.76.39] (helo=above.proper.com)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1D6HXA-000Jei-TJ
	for idn@ops.ietf.org; Wed, 02 Mar 2005 00:16:12 +0000
Received: from [10.20.30.249] (adsl-66-125-125-65.dsl.pltn13.pacbell.net [66.125.125.65])
	(authenticated bits=0)
	by above.proper.com (8.12.11/8.12.9) with ESMTP id j220G9UN046063;
	Tue, 1 Mar 2005 16:16:10 -0800 (PST)
	(envelope-from phoffman@imc.org)
Mime-Version: 1.0
Message-Id: <p0621022dbe4ab4b8a3fa@[10.20.30.249]>
In-Reply-To: <4225ABAB.60002@mozilla.org>
References: <421B8484.3070802@vanderpoel.org>
 <20050223072837.GA21463~@nicemice.net>
 <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org>
 <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org>
 <p06210202be43c3888991@[192.168.0.101]>
 <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org>
 <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org>
 <00a401c51af3$7863aae0$030aa8c0@DEWELL>
 <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <421FA55B.9000308@vanderpoel.org>
 <421FCBD7.8000805@vanderpoel.org> <42227EBF.9040703@vanderpoel.org>
 <45781B7428C6AA07C3B283BD@scan.jck.com> <42229BBC.8020608@vanderpoel.org>
 <p0621021ebe484f52c0c5@[10.20.30.249]> <4225ABAB.60002@mozilla.org>
Date: Tue, 1 Mar 2005 16:16:07 -0800
To: Gervase Markham <gerv@mozilla.org>
From: Paul Hoffman <phoffman@imc.org>
Subject: Re: [idn] Re: character tables
Cc: Erik van der Poel <erik@vanderpoel.org>, John C Klensin <klensin@jck.com>,
        idn@ops.ietf.org
Content-Type: text/plain; charset="us-ascii" ; format="flowed"
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

At 12:03 PM +0000 3/2/05, Gervase Markham wrote:
>Could you tell us more about the problems you found with the ideas 
>of bundling and blocking?

It was impossible to come up with a bundling scheme that kept 
everyone happy. The needs of the Chinese language communities for 
bundling were different than the needs of the Scandinavian language 
communities, which in turn were different than the needs of the Indic 
language communities, which were different than the needs of the 
Arabic language communities, and so on. Then toss in the communities 
that truly want multiple scripts but want to avoid homograph attacks 
(yes, we really did think about that years ago...), and your brain 
starts dripping from your ears.

Other folks with more brains or who are less prone to dripping are 
welcome to try to fix this for the world, or at least for one 
community as the JET folks did.

--Paul Hoffman, Director
--Internet Mail Consortium



From owner-idn@ops.ietf.org  Tue Mar  1 20:10:00 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id UAA29980
	for <idn-archive@lists.ietf.org>; Tue, 1 Mar 2005 20:09:59 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6IIy-0001gd-OK
	for idn-data@psg.com; Wed, 02 Mar 2005 01:05:36 +0000
Received: from [207.115.63.77] (helo=pimout1-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D6IIw-0001fl-Np
	for idn@ops.ietf.org; Wed, 02 Mar 2005 01:05:35 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout1-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2215UhV268984;
	Tue, 1 Mar 2005 20:05:30 -0500
Message-ID: <42251159.1040300@vanderpoel.org>
Date: Tue, 01 Mar 2005 17:05:29 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Gervase Markham <gerv@mozilla.org>
CC: idn@ops.ietf.org
Subject: Re: [idn] nameprep2 and the slash homograph issue
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <20050223105244.GE21463~@nicemice.net> <421CA114.9090302@vanderpoel.org> <20050224081721.GB12336~@nicemice.net> <421DEDFF.2000300@vanderpoel.org> <4225A87B.7030204@mozilla.org>
In-Reply-To: <4225A87B.7030204@mozilla.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.2 required=5.0 tests=AWL,BAYES_00,WHY_WAIT 
	autolearn=no version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Gervase Markham wrote:
> While security-conscious users are always less at risk than ordinary 
> users, thinking in terms of a tool is IMO wrong.

Perhaps I was wrong to use the word "tool". There is a fundamental 
tension between security and user-friendliness. Some applications and 
vendors have a history of making their user interfaces *too* friendly, 
thereby neglecting to warn users of potential security risks. Other 
vendors have tried hard to strike a balance between security and 
seamlessness. I believe Netscape and Mozilla have been in this camp 
since Day One.

I hope that mozilla.org will deploy a better solution than the TLD and 
domain black/whitelists that have been discussed.

>> It would offer to display domain names in the 
>> safe order, i.e. left-to-right for users whose main language is 
>> left-to-right.
> 
> The problem this is supposed to mitigate is mitigated in Firefox by the 
> domain-only indicator in the status bar.

I just double-checked Firefox 1.0.1, and it just says "Done" at the 
lower left. Then I tried a secure (https) site, and, lo and behold, I 
saw the "domain-only" indicator at the lower right, next to the padlock 
icon. This is very good news (to me). And thank you for educating this 
particular user (me) about this security issue. As I have often said, 
education is key.

A couple of questions/comments: It might be nice to have this 
domain-only display even for non-secure sites (http). Also, do you know 
what happens if the domain name is very long? Finally, do you have any 
thoughts about the slash homograph problem? Thanks.

>> In addition, such a tool would offer to display domain names in a 
>> clear font, unlike the sans-serif that is commonly used today. This 
>> would make the distinction between lowercase l and digit 1 clearer. 
> 
> Assuming we could determine such a font, why would we not always use it? 
> Why wait for a tool to be deployed?

Indeed, why wait? I filed a bug a while ago:

https://bugzilla.mozilla.org/show_bug.cgi?id=282079

My feeling is that a sans-serif font (such as Arial) places the 
characters too close to each other and does not have the serifs that 
often serve to distinguish the characters better. How about a fixed 
width font with serifs, such as Courier New?

Erik



From owner-idn@ops.ietf.org  Tue Mar  1 20:52:16 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id UAA03406
	for <idn-archive@lists.ietf.org>; Tue, 1 Mar 2005 20:52:16 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6Iz5-000A4c-Lw
	for idn-data@psg.com; Wed, 02 Mar 2005 01:49:07 +0000
Received: from [207.115.63.102] (helo=pimout3-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D6Iz4-000A4O-8r
	for idn@ops.ietf.org; Wed, 02 Mar 2005 01:49:06 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout3-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j221mmVl227258;
	Tue, 1 Mar 2005 20:48:53 -0500
Message-ID: <42251B80.5050503@vanderpoel.org>
Date: Tue, 01 Mar 2005 17:48:48 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Paul Hoffman <phoffman@imc.org>
CC: Gervase Markham <gerv@mozilla.org>, John C Klensin <klensin@jck.com>,
        idn@ops.ietf.org
Subject: Re: [idn] Re: character tables
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <421FA55B.9000308@vanderpoel.org> <421FCBD7.8000805@vanderpoel.org> <42227EBF.9040703@vanderpoel.org> <45781B7428C6AA07C3B283BD@scan.jck.com> <42229BBC.8020608@vanderpoel.org> <p0621021ebe484f52c0c5@[10.20.30.249]> <4225ABAB.60002@mozilla.org> <p0621022dbe4ab4b8a3fa@[10.20.30.249]>
In-Reply-To: <p0621022dbe4ab4b8a3fa@[10.20.30.249]>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Paul Hoffman wrote:
> At 12:03 PM +0000 3/2/05, Gervase Markham wrote:
> 
>> Could you tell us more about the problems you found with the ideas of 
>> bundling and blocking?
> 
> It was impossible to come up with a bundling scheme that kept everyone 
> happy. The needs of the Chinese language communities for bundling were 
> different than the needs of the Scandinavian language communities, which 
> in turn were different than the needs of the Indic language communities, 
> which were different than the needs of the Arabic language communities, 
> and so on. Then toss in the communities that truly want multiple scripts 
> but want to avoid homograph attacks (yes, we really did think about that 
> years ago...), and your brain starts dripping from your ears.

Yes, as a long-time internationalization engineer, I can imagine that it 
was difficult to come up with a single set of guidelines for all of the 
world's registries. (In addition to language differences, some comments 
on this list have led me to believe that there are also protocol 
differences between the registries, i.e. VeriSign's multiple versions of 
RRP vs the EPP that Edmon Chung seems to have been working on vs fax and 
sneaker net vs any others?)

However, I note that this particular conversation is between a browser 
developer (Gervase) and one of the IDNA authors (Paul), neither of which 
is a registry representative, so why exactly are you 2 having this 
conversation? :-)

Sorry, I'm half joking. Half, because you two have every right to 
discuss whatever you wish. The other half because I believe browser 
developers can afford to focus more on their end of things. Allow me to 
insert an excerpt from a previous email I wrote up:

-----------------

It is pretty clear that none of the organizations can completely solve
the problem on its own. Unicode can warn about these issues, but that is
all they can do. They cannot remove characters. The IETF is currently
discussing the prohibition of certain characters or character types.
Even if the IETF publishes updated versions of the specs, there will
still be the problem of certain characters being unfamiliar to many
users (simply because they do not know all the legitimate characters in
the world), thereby leaving them exposed to the phishers. The registries
can enforce rules at their level, but nobody has yet shown that they can
truly enforce any rules at other levels. So, the browser developers must
address that problem.

There are several issues here. One is that domain names are typically
displayed inside something else, e.g. a URI. This, in itself, gives the
phishers something to work with. So the browser developers must think
about other ways to display domain names. This is not very easy. People
exchange URIs via email and other means all the time. Apps turn those
URIs into clickable links, as a service to users. If not, they can copy
and paste the URI into the URI field. Both of these methods could be
improved to highlight the domain name in the interests of security.

Another problem is that humans are only familiar with a small set of
characters. Some humans know *many* characters (i.e. the East Asians),
but most know a lot less than that. Now, within the set of characters
that each user is familiar with, there are no homograph problems (or
just a few). However, as soon as you stray outside any single user's
familiar set, there are many homographs, near-homographs and unfamiliar
symbols. When a typical computer user is faced with something
unfamiliar, they are quite likely to shrug it off and assume it's just
one of those "computer" things that they cannot understand. This is
something that IDN phishers could take advantage of, if the browsers do
not take steps to highlight the unfamiliar characters (via HTTP
Accept-Language and browser localization as I suggested). Of course,
highlighting is not sufficient. Education is also very important.

So, instead of wasting time talking about a non-solution (white/black
lists), it would be nice to see these parties spending their valuable
time on real solutions. The registries could be working on the
guidelines, to address the concerns about language tagging, variants and
so on. They could also get in touch with the IETF, to let them know
which Unicode characters and character types they wish to use, so that
the IETF can consider how to publish new specs that might prohibit other
characters. Browser developers could start working on ways to display
domain names in ways that give the phishers less to work with.

---------------------

In other words, I do not think browser developers need to be overly 
concerned with the particular bundling/blocking schemes that the 
registries might be using. Instead, I wish the browser developers would 
focus more on the *user*, who may be "surfing" from one site to the 
next, spanning the globe, and crossing language boundaries. In order to 
protect such a user, the browser should focus on the core set of 
characters that s/he is familiar with, and provide some sort of 
indication when unfamiliar characters appear, so that the 
security-conscious, educated user may know when to be careful. I.e. the 
language of the *user* is important, not the language of the domain name.

I am *not* saying that this would be easy to implement. I am not at all 
surprised that Mozilla and Opera have chosen an easy stopgap, hopefully 
only for the interim. It's great to see Mozilla and Opera lead the way 
as they have been!

Erik



From owner-idn@ops.ietf.org  Tue Mar  1 23:56:19 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id XAA19909
	for <idn-archive@lists.ietf.org>; Tue, 1 Mar 2005 23:56:19 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6Lls-000Emm-Lq
	for idn-data@psg.com; Wed, 02 Mar 2005 04:47:40 +0000
Received: from [207.115.63.101] (helo=pimout2-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D6Llr-000Elt-H8
	for idn@ops.ietf.org; Wed, 02 Mar 2005 04:47:39 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout2-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j224lOaU087250;
	Tue, 1 Mar 2005 23:47:25 -0500
Message-ID: <4225455C.2030109@vanderpoel.org>
Date: Tue, 01 Mar 2005 20:47:24 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Gervase Markham <gerv@mozilla.org>
CC: Paul Hoffman <phoffman@imc.org>, John C Klensin <klensin@jck.com>,
        idn@ops.ietf.org
Subject: Re: [idn] Re: character tables
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <421FA55B.9000308@vanderpoel.org> <421FCBD7.8000805@vanderpoel.org> <42227EBF.9040703@vanderpoel.org> <45781B7428C6AA07C3B283BD@scan.jck.com> <42229BBC.8020608@vanderpoel.org> <p0621021ebe484f52c0c5@[10.20.30.249]> <4225ABAB.60002@mozilla.org> <p0621022dbe4ab4b8a3fa@[10.20.30.249]> <42251B80.5050503@vanderpoel.org>
In-Reply-To: <42251B80.5050503@vanderpoel.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

> However, I note that this particular conversation is between a browser 
> developer (Gervase) and one of the IDNA authors (Paul), neither of which 
> is a registry representative, so why exactly are you 2 having this 
> conversation? :-)
> 
> Sorry, I'm half joking. Half, because you two have every right to 
> discuss whatever you wish. The other half because I believe browser 
> developers can afford to focus more on their end of things.

Sorry, I've been told that this half-joking thing was confusing, and I 
now believe I shouldn't have tried to be so cute.

All I'm trying to say to *Gervase* is that it doesn't really matter 
*what* characters are allowed to be registered in a registry, as long as 
the browser takes steps to warn the user when something phishy might be 
going on, e.g. a slash homograph, or a Cyrillic small 'a' when the user 
was probably expecting a Latin small 'a'. As I have pointed out, the 
registry does *not* have control over higher-numbered level domains. 
E.g. .de controls the 2nd level domain (2LD), but not the 3LD, 4LD and 
so on. That is where the slash homograph problem *really* matters.

> Instead, I wish the browser developers would 
> focus more on the *user*, who may be "surfing" from one site to the 
> next, spanning the globe, and crossing language boundaries.

Sorry, this may not have been the best logic to use in my argument. It 
would have been better to talk about phishers, who often spam users with 
email containing URIs that *could* contain IDN labels with dangerous 
homographs at any level of the name, 2LD, 3LD, or whatever.

(Most users *don't* surf around the world, since many are monolingual or 
maybe bilingual.)

Anyway, help me out, guys and gals. Pull my logic through the wringer, 
and comb it with the finest comb you have at your disposal. This way, we 
can collectively improve our understanding of the IDN phishing problem 
and ways to address it.

Erik



From owner-idn@ops.ietf.org  Wed Mar  2 04:03:54 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id EAA15319
	for <idn-archive@lists.ietf.org>; Wed, 2 Mar 2005 04:03:54 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6Pfp-0007nz-F6
	for idn-data@psg.com; Wed, 02 Mar 2005 08:57:41 +0000
Received: from [193.201.200.34] (helo=tuschin.blackcatnetworks.co.uk)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D6Pfn-0007n4-KY
	for idn@ops.ietf.org; Wed, 02 Mar 2005 08:57:39 +0000
Received: from grmarkham.plus.com ([80.229.30.161] helo=[192.168.1.100])
	by tuschin.blackcatnetworks.co.uk with asmtp (Exim 3.35 #1 (Debian))
	id 1D6Pfl-00011n-00; Wed, 02 Mar 2005 08:57:37 +0000
Message-ID: <42257FA5.9060604@mozilla.org>
Date: Wed, 02 Mar 2005 08:56:05 +0000
From: Gervase Markham <gerv@mozilla.org>
Organization: mozilla.org
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Erik van der Poel <erik@vanderpoel.org>
CC: idn@ops.ietf.org
Subject: Re: [idn] nameprep2 and the slash homograph issue
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <20050223105244.GE21463~@nicemice.net> <421CA114.9090302@vanderpoel.org> <20050224081721.GB12336~@nicemice.net> <421DEDFF.2000300@vanderpoel.org> <4225A87B.7030204@mozilla.org> <42251159.1040300@vanderpoel.org>
In-Reply-To: <42251159.1040300@vanderpoel.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-1.8 required=5.0 tests=AWL,BAYES_00,WHY_WAIT 
	autolearn=no version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Erik van der Poel wrote:
> Perhaps I was wrong to use the word "tool". There is a fundamental 
> tension between security and user-friendliness. 

Well, maybe. I'm not convinced the tension is absolute, but I agree you 
need to work very hard indeed to get both.

> A couple of questions/comments: It might be nice to have this 
> domain-only display even for non-secure sites (http).

We are probably going to change this for 1.1. It takes some careful 
thought so as not to confuse people.

> Also, do you know 
> what happens if the domain name is very long? 

It just gets very long, currently.

> Finally, do you have any 
> thoughts about the slash homograph problem? Thanks.

Well, the current domain indicator will show the domain, slash 
homographs and all. We're still developing our response, but it's likely 
that we'll have to blacklist this character. Opera's new beta already 
has a small set of characters it doesn't allow.

Ideally, we wouldn't be acting unilaterally on this one, and would be 
doing the restrictions based on consensus. But before we can go there, 
we need to figure out what we think is needed first. That process is 
still going on.

> Indeed, why wait? I filed a bug a while ago:
> 
> https://bugzilla.mozilla.org/show_bug.cgi?id=282079

Thanks :-)

> My feeling is that a sans-serif font (such as Arial) places the 
> characters too close to each other and does not have the serifs that 
> often serve to distinguish the characters better. How about a fixed 
> width font with serifs, such as Courier New?

The issue, of course, is that the font designation we use has to produce 
a good font on all platforms. This isn't fundamentally impossible, it 
just requires work and testing.

Gerv



From owner-idn@ops.ietf.org  Wed Mar  2 10:50:56 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id KAA25026
	for <idn-archive@lists.ietf.org>; Wed, 2 Mar 2005 10:50:54 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6W0f-0007Ne-1k
	for idn-data@psg.com; Wed, 02 Mar 2005 15:43:37 +0000
Received: from [209.187.148.211] (helo=bs.jck.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1D6W0Z-0007MJ-5q
	for idn@ops.ietf.org; Wed, 02 Mar 2005 15:43:31 +0000
Received: from [209.187.148.215] (helo=scan.jck.com)
	by bs.jck.com with esmtp (Exim 4.34)
	id 1D6W0V-000FP5-GY; Wed, 02 Mar 2005 10:43:27 -0500
Date: Wed, 02 Mar 2005 10:43:27 -0500
From: John C Klensin <klensin@jck.com>
To: Erik van der Poel <erik@vanderpoel.org>,
        Gervase Markham <gerv@mozilla.org>
cc: Paul Hoffman <phoffman@imc.org>, idn@ops.ietf.org
Subject: Re: [idn] Re: character tables
Message-ID: <A32EEA4DEC04F4C4122A64F9@scan.jck.com>
In-Reply-To: <4225455C.2030109@vanderpoel.org>
References: <421B8484.3070802@vanderpoel.org>
 <20050223072837.GA21463~@nicemice.net>
 <D872CCF059514053ECF8A198@scan.jck.com>
 <421D8411.9030006@vanderpoel.org>
 <p06210208be4390618c81@[192.168.0.101]>
 <421E0D0C.2000309@vanderpoel.org>
 <p06210202be43c3888991@[192.168.0.101]>
 <E07CE813AD23B2D95DA0C740@scan.jck.com>
 <421E30F2.1040408@vanderpoel.org>
 <0E7F74C71945B923C52211F3@scan.jck.com>
 <421EA0C9.1010500@vanderpoel.org>
 <00a401c51af3$7863aae0$030aa8c0@DEWELL>
 <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
 <421FA55B.9000308@vanderpoel.org>
 <421FCBD7.8000805@vanderpoel.org>
 <42227EBF.9040703@vanderpoel.org>
 <45781B7428C6AA07C3B283BD@scan.jck.com>
 <42229BBC.8020608@vanderpoel.org>
 <p0621021ebe484f52c0c5@[10.20.30.249]>
 <4225ABAB.60002@mozilla.org>
 <p0621022dbe4ab4b8a3fa@[10.20.30.249]>
 <42251B80.5050503@vanderpoel.org>
 <4225455C.2030109@vanderpoel.org>
X-Mailer: Mulberry/3.1.6 (Win32)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Erik,

A few observations...

	(1) First, a registry does have the right to require
	that registrants observe particular rules and conditions
	in subdomains they delegate and to pass those rules down
	the tree.  Whether that is wise or sensible is another
	issue, and enforceability is yet another question.
	But, unless national law prevents it, RFC 1591, to which
	all TLD registries more or less agreed, rather
	explicitly provides for passing the responsibilities to
	the community down the tree.  Even ignoring troublesome
	concepts like "require" and "enforce", certainly nothing
	prevents registries from educating and persuading
	registrants about how they should behave.
	
	(2) In my regular role as a luser, I really like fast,
	easily-used, small-footprint browsers.  I'm more
	security-conscious and suspicious than the user average,
	and therefore also like handy tools to help me dissect
	and verify things that might look suspicious.  Tying up
	a browser with heuristics, such as mixed-script
	detectors, that may not work well and have a large
	footprint, doesn't impress me as a good tradeoff.  For
	better or worse, the assumption of a decade ago that
	most criminals, especially most electronic criminals,
	were stupid is no longer applicable, if ever it was.
	That implies, I think, that if we design a simple test
	that blocks some look-alike cases but permits other,
	more subtle, ones, we will simply drive the phishers to
	better understand and use the subtle stuff: not a good
	tradeoff.

	(3) As far as surfing around the world is concerned,
	we've got a situation today in which the domain name
	associated with a particular URL does not really predict
	the content to be found on that page.  That will
	undoubtedly get worse, as more folks discover that the
	intersection of domain and host administration with web
	site organization often makes it much easier to maintain
	versions of pages in multiple languages in the same,
	rather than different, DNS trees.  So, since I don't
	read Chinese, I'm unlikely to frequently seek out pages
	whose content is in Chinese.  But I frequently find
	pages I can read via URLs that contain elements written
	in pinyin.  I fully expect those elements, and some of
	the subdomain names, will shift to Chinese characters as
	IDNs and IRIs are more widely available.   I also expect
	that transition will make things more comfortable for
	someone who reads Chinese and would prefer to not deal
	with Latin characters and harder for me, but that is a
	reasonable tradeoff over which none of us will have much
	influence.
	
	(4) We need to get unstuck from thinking about this
	purely as a browser problem.   The usual phishing attack
	involves an email message containing a link.  For those
	email clients that don't immediately invoke a full
	browser as soon as a link appears --and many of those
	links occur in plain-text, not HTML, email-- they are
	invoking the browser when the link is clicked on.  The
	situation in the browser is then different, since none
	of the "hover over link", "look at status bar", etc.,
	tools are going to apply, or, at least, are not going to
	work in the ways that some of these discussions suggest
	for links that appear on web pages that are already open
	in the browser.  Now, we have given MUA writers no
	advice about what they should pass to the browser if
	they see an IRI or otherwise-encoded string that
	contains an IDN.  If they pass the IRI/
	native-script-form IDN, they risk passing it to a
	browser version that doesn't have a clue.  So maybe they
	force the thing into URI/ punycode form and pass that.
	Now, do you really want the browser to look at the
	thing, perform ToUnicode on the name (which, of course,
	may yield something other than what the user saw),
	perform some tests, and then pop up a "you just passed
	me an IDN that looks suspicious, do you really want to
	open that page?" box.  I think probably not.   Moreover,
	I think that, if you do, there would quickly be a
	sufficient number of false positives (positive for bad
	stuff) to get users really used to clicking "yes"
	without thinking... and cursing the browser implementer
	for bothering them with a pointless warning.

So my conclusion is that we need a mixed
protocol-registry-browser strategy.  That strategy, IMO, should
shifted the processing burdens as much as possible to the first
two.  And I think that notions that the problem can or should be
solved in any of those three places alone are probably misguided.

     john






--On Tuesday, 01 March, 2005 20:47 -0800 Erik van der Poel
<erik@vanderpoel.org> wrote:

>> However, I note that this particular conversation is between
>> a browser  developer (Gervase) and one of the IDNA authors
>> (Paul), neither of which  is a registry representative, so
>> why exactly are you 2 having this  conversation? :-)
>> 
>> Sorry, I'm half joking. Half, because you two have every
>> right to  discuss whatever you wish. The other half because I
>> believe browser  developers can afford to focus more on their
>> end of things.
> 
> Sorry, I've been told that this half-joking thing was
> confusing, and I now believe I shouldn't have tried to be so
> cute.
> 
> All I'm trying to say to *Gervase* is that it doesn't really
> matter *what* characters are allowed to be registered in a
> registry, as long as the browser takes steps to warn the user
> when something phishy might be going on, e.g. a slash
> homograph, or a Cyrillic small 'a' when the user was probably
> expecting a Latin small 'a'. As I have pointed out, the
> registry does *not* have control over higher-numbered level
> domains. E.g. .de controls the 2nd level domain (2LD), but not
> the 3LD, 4LD and so on. That is where the slash homograph
> problem *really* matters.
> 
>> Instead, I wish the browser developers would 
>> focus more on the *user*, who may be "surfing" from one site
>> to the  next, spanning the globe, and crossing language
>> boundaries.
> 
> Sorry, this may not have been the best logic to use in my
> argument. It would have been better to talk about phishers,
> who often spam users with email containing URIs that *could*
> contain IDN labels with dangerous homographs at any level of
> the name, 2LD, 3LD, or whatever.
> 
> (Most users *don't* surf around the world, since many are
> monolingual or maybe bilingual.)
> 
> Anyway, help me out, guys and gals. Pull my logic through the
> wringer, and comb it with the finest comb you have at your
> disposal. This way, we can collectively improve our
> understanding of the IDN phishing problem and ways to address
> it.
> 
> Erik







From owner-idn@ops.ietf.org  Wed Mar  2 11:11:21 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id LAA27264
	for <idn-archive@lists.ietf.org>; Wed, 2 Mar 2005 11:11:20 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6WMe-000CMX-8K
	for idn-data@psg.com; Wed, 02 Mar 2005 16:06:20 +0000
Received: from [130.242.24.5] (helo=nic.museum)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D6WMa-000CLq-HS
	for idn@ops.ietf.org; Wed, 02 Mar 2005 16:06:16 +0000
Received: from nic.museum (nic.museum [127.0.0.1])
	by nic.museum (8.13.1/8.13.1) with ESMTP
	id j22G6jhT026147;
	Wed, 2 Mar 2005 17:06:45 +0100
Received: from localhost (ck@localhost)
	by nic.museum (8.13.1/8.13.1/Submit) with ESMTP id j22G6ion026144;
	Wed, 2 Mar 2005 17:06:44 +0100
Date: Wed, 2 Mar 2005 17:06:44 +0100 (CET)
From: Cary Karp <ck@nic.museum>
To: idn@ops.ietf.org
Subject: [idn] Re: character tables
In-Reply-To: <42251B80.5050503@vanderpoel.org>
Message-ID: <Pine.LNX.4.61.0503020759240.17184@nic.museum>
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net>
 <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org>
 <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org>
 <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com>
 <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com>
 <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL>
 <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <421FA55B.9000308@vanderpoel.org>
 <421FCBD7.8000805@vanderpoel.org> <42227EBF.9040703@vanderpoel.org>
 <45781B7428C6AA07C3B283BD@scan.jck.com> <42229BBC.8020608@vanderpoel.org>
 <p0621021ebe484f52c0c5@[10.20.30.249]> <4225ABAB.60002@mozilla.org>
 <p0621022dbe4ab4b8a3fa@[10.20.30.249]> <42251B80.5050503@vanderpoel.org>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Quoting Erik van der Poel:

> I note that this particular conversation is between a browser 
> developer (Gervase) and one of the IDNA authors (Paul), neither of 
> which is a registry representative, so why exactly are you 2 
> having this conversation? :-)
>
> Sorry, I'm half joking. Half, because you two have every right to 
> discuss whatever you wish. The other half because I believe 
> browser developers can afford to focus more on their end of 
> things.

Under the assumption that the discussion might be furthered by a 
registry rep describing that end of things --

I'm responsible for the development and maintenance of the policies 
for .museum. This is a sponsored gTLD (sTLD), which means that there 
are eligibility requirements for name holders, and restrictions on 
the way names may be structured and used. The policies specific to 
IDN are stated in detail at http://about.museum/idn/idnpolicy.html, 
which includes links to both the general policy statement and the 
listing of permitted characters and code points. Although 
prospective name holders are unlikely to read the fine print, the 
detailed statement provides an unequivocal reference in the 
case-to-case discussions about policy instantiation that we 
frequently conduct with individual museums. That dialogue provides 
an effective barrier to deliberate abuse of the .museum namespace 
(which we are contractually obligated to prevent) and is also a 
safeguard against inadvertent homographic confusion.

There are significant differences in the operation of an 
unrestricted gTLD (uTLD), where there may be a far greater volume of 
registration traffic, and direct contact between the registry and 
registrant is not a part of the registration process. In this 
situation, such things as restriction on IDN registration need to be 
fully automated, with sentient review being a remedial device when 
it is noted that something the algorithmic filter is intended to 
stop has nonetheless passed through.

The gTLD registries are as concerned by and with the present 
homograph alert as is any other group attempting to curb the risk 
for such damage. In addition to the range of operating conditions 
implied above, there are differences in the way the registries have 
interpreted and implemented ICANN's IDN Guidelines. That document 
states, "As the deployment of IDNs proceeds, ICANN and the IDN 
registries will review these Guidelines at regular intervals, and 
revise them as necessary based on experience." We are now clearly at 
such a juncture, and the revision process is already being 
initiated. Reducing the latitude for interpretation of the 
Guidelines will bring the registries one important step closer to 
being able to establish a best practice that can bring an end to the 
concern about point-of-registration control that is currently being 
expressed.

The development of these best practices would be further abetted by 
the candidate IDN repertoire being purged of the graphic symbols and 
other signs that are not needed in a naming system (using that term 
in a sense that a linguist might regard as reasonable) but clearly 
exacerbate the risk for malicious exploitation. There is similar 
utility in freeing IDNA from its current lock to Unicode 3.2. Since 
both of these concerns can only be addressed through revision of 
nameprep and stringprep, that action is of priority concern to the 
registries.

There is more to be said about gTLD perspectives on the role IDN 
plays in the communities that we serve, but I'll save that for 
separate communication.

/Cary



From owner-idn@ops.ietf.org  Wed Mar  2 11:43:05 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id LAA00456
	for <idn-archive@lists.ietf.org>; Wed, 2 Mar 2005 11:43:04 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6Wsh-000IJz-Mv
	for idn-data@psg.com; Wed, 02 Mar 2005 16:39:27 +0000
Received: from [63.247.74.122] (helo=montage.altserver.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1D6Wse-000IJf-Kt
	for idn@ops.ietf.org; Wed, 02 Mar 2005 16:39:24 +0000
Received: from lns-p19-8-idf-82-249-19-191.adsl.proxad.net ([82.249.19.191] helo=jfc.afrac.org)
	by montage.altserver.com with esmtpa (Exim 4.44)
	id 1D6Wsc-000301-8s; Wed, 02 Mar 2005 08:39:22 -0800
Message-Id: <6.1.2.0.2.20050302173136.0caa4ac0@mail.jefsey.com>
X-Sender: jefsey+jefsey.com@mail.jefsey.com
X-Mailer: QUALCOMM Windows Eudora Version 6.1.2.0
Date: Wed, 02 Mar 2005 17:37:51 +0100
To: John C Klensin <klensin@jck.com>
From: "JFC (Jefsey) Morfin" <jefsey@jefsey.com>
Subject: Re: [idn] Re: character tables
Cc: idn@ops.ietf.org
In-Reply-To: <A32EEA4DEC04F4C4122A64F9@scan.jck.com>
References: <421B8484.3070802@vanderpoel.org>
 <20050223072837.GA21463~@nicemice.net>
 <D872CCF059514053ECF8A198@scan.jck.com>
 <421D8411.9030006@vanderpoel.org>
 <p06210208be4390618c81@[192.168.0.101]>
 <421E0D0C.2000309@vanderpoel.org>
 <p06210202be43c3888991@[192.168.0.101]>
 <E07CE813AD23B2D95DA0C740@scan.jck.com>
 <421E30F2.1040408@vanderpoel.org>
 <0E7F74C71945B923C52211F3@scan.jck.com>
 <421EA0C9.1010500@vanderpoel.org>
 <00a401c51af3$7863aae0$030aa8c0@DEWELL>
 <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
 <421FA55B.9000308@vanderpoel.org>
 <421FCBD7.8000805@vanderpoel.org>
 <42227EBF.9040703@vanderpoel.org>
 <45781B7428C6AA07C3B283BD@scan.jck.com>
 <42229BBC.8020608@vanderpoel.org>
 <p0621021ebe484f52c0c5@[10.20.30.249]>
 <4225ABAB.60002@mozilla.org>
 <p0621022dbe4ab4b8a3fa@[10.20.30.249]>
 <42251B80.5050503@vanderpoel.org>
 <4225455C.2030109@vanderpoel.org>
 <A32EEA4DEC04F4C4122A64F9@scan.jck.com>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"; format=flowed
X-AntiAbuse: This header was added to track abuse, please include it with any abuse report
X-AntiAbuse: Primary Hostname - montage.altserver.com
X-AntiAbuse: Original Domain - ops.ietf.org
X-AntiAbuse: Originator/Caller UID/GID - [0 0] / [47 12]
X-AntiAbuse: Sender Address Domain - jefsey.com
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

On 16:43 02/03/2005, John C Klensin said:
>I fully expect those elements, and some of the subdomain names, will shift 
>to Chinese characters as IDNs and IRIs are more widely available.

The problem is the two necessary keyboards.
Please stop considering the solution to your own problems. Or let turn the 
Internet entirely in Chinese by default, and let help the IETF to document 
the best way to access pages written in English.
jfc




From owner-idn@ops.ietf.org  Wed Mar  2 12:22:32 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id MAA06308
	for <idn-archive@lists.ietf.org>; Wed, 2 Mar 2005 12:22:32 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6XUx-000Ppm-1M
	for idn-data@psg.com; Wed, 02 Mar 2005 17:18:59 +0000
Received: from [207.115.63.101] (helo=pimout2-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D6XUu-000PpO-UB
	for idn@ops.ietf.org; Wed, 02 Mar 2005 17:18:57 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout2-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j22HIoaU328826;
	Wed, 2 Mar 2005 12:18:50 -0500
Message-ID: <4225F579.8080200@vanderpoel.org>
Date: Wed, 02 Mar 2005 09:18:49 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Gervase Markham <gerv@mozilla.org>
CC: idn@ops.ietf.org, Yngve Nysaeter Pettersen <yngve@opera.com>
Subject: Re: [idn] nameprep2 and the slash homograph issue
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <20050223105244.GE21463~@nicemice.net> <421CA114.9090302@vanderpoel.org> <20050224081721.GB12336~@nicemice.net> <421DEDFF.2000300@vanderpoel.org> <4225A87B.7030204@mozilla.org> <42251159.1040300@vanderpoel.org> <42257FA5.9060604@mozilla.org>
In-Reply-To: <42257FA5.9060604@mozilla.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Gervase Markham wrote:
> Erik van der Poel wrote:
> > 
> > Also, do you know what happens if the domain name is very long? 
> 
> It just gets very long, currently.

I hope you will think about what to do when the name is really long, 
keeping in mind that the most important part of the name is the end (the 
right side).

> Well, the current domain indicator will show the domain, slash 
> homographs and all. We're still developing our response, but it's likely 
> that we'll have to blacklist this character. Opera's new beta already 
> has a small set of characters it doesn't allow.
> 
> Ideally, we wouldn't be acting unilaterally on this one, and would be 
> doing the restrictions based on consensus. But before we can go there, 
> we need to figure out what we think is needed first. That process is 
> still going on.

It's really great to hear this! I fully agree with you that consensus 
would be ideal. I'm taking the liberty of Cc'ing one of the Opera 
developers, in the hope that they might be willing to discuss their 
particular choices for the character blacklist. If various people can 
start to agree on a blacklist, this info can be fed into any RFC 
revision process (which I hope will begin).

> The issue, of course, is that the font designation we use has to produce 
> a good font on all platforms.

Yes, a good font on *all* platforms, and also for *all* parts of the 
world. I am quite aware of those issues. See the bottom of:

http://www.mozilla.org/projects/intl/fonts.html

One of the great things about open source is that lots of people from 
all over the world come to help you, with localizations, default font 
choices, etc.

Erik



From owner-idn@ops.ietf.org  Wed Mar  2 14:08:20 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id OAA15064
	for <idn-archive@lists.ietf.org>; Wed, 2 Mar 2005 14:08:19 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6Z7x-000Ik5-Jc
	for idn-data@psg.com; Wed, 02 Mar 2005 19:03:21 +0000
Received: from [207.115.63.102] (helo=pimout3-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D6Z7v-000Ijl-80
	for idn@ops.ietf.org; Wed, 02 Mar 2005 19:03:19 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout3-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j22J2tVl134450;
	Wed, 2 Mar 2005 14:03:01 -0500
Message-ID: <42260DDF.5010007@vanderpoel.org>
Date: Wed, 02 Mar 2005 11:02:55 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: John C Klensin <klensin@jck.com>
CC: Gervase Markham <gerv@mozilla.org>, Paul Hoffman <phoffman@imc.org>,
        idn@ops.ietf.org
Subject: Re: [idn] Re: character tables
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <421FA55B.9000308@vanderpoel.org> <421FCBD7.8000805@vanderpoel.org> <42227EBF.9040703@vanderpoel.org> <45781B7428C6AA07C3B283BD@scan.jck.com> <42229BBC.8020608@vanderpoel.org> <p0621021ebe484f52c0c5@[10.20.30.249]> <4225ABAB.60002@mozilla.org> <p0621022dbe4ab4b8a3fa@[10.20.30.249]> <42251B80.5050503@vanderpoel.org> <4225455C.2030109@vanderpoel.org> <A32EEA4DEC04F4C4122A64F9@scan.jck.com>
In-Reply-To: <A32EEA4DEC04F4C4122A64F9@scan.jck.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

John,

John C Klensin wrote:
> So my conclusion is that we need a mixed
> protocol-registry-browser strategy.  That strategy, IMO, should
> shifted the processing burdens as much as possible to the first
> two.  And I think that notions that the problem can or should be
> solved in any of those three places alone are probably misguided.

I strongly agree with everything you said. I am sorry if I gave the 
impression that the browser implementors are the *only* people that can 
and should address this IDN phishing problem. I don't think I said that, 
but maybe I'm just not very good at email and/or expressing myself. I 
also agree that the burden should be shifted as much as possible to the 
first two. It would be bad if the many implementations all did it 
differently.

I would only add one component to your strategy. It should be a 
Unicode-protocol-registry-browser strategy. Unicode has already started 
working on their part:

http://www.unicode.org/reports/tr36/

Erik



From owner-idn@ops.ietf.org  Wed Mar  2 15:05:42 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id PAA19797
	for <idn-archive@lists.ietf.org>; Wed, 2 Mar 2005 15:05:41 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6a1t-0003Jg-Uj
	for idn-data@psg.com; Wed, 02 Mar 2005 20:01:09 +0000
Received: from [207.115.63.102] (helo=pimout3-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D6a1s-0003JC-Mo
	for idn@ops.ietf.org; Wed, 02 Mar 2005 20:01:09 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout3-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j22JvsVl301426;
	Wed, 2 Mar 2005 14:57:55 -0500
Message-ID: <42261AC2.3020004@vanderpoel.org>
Date: Wed, 02 Mar 2005 11:57:54 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Cary Karp <ck@nic.museum>
CC: idn@ops.ietf.org
Subject: Re: [idn] Re: character tables
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <421FA55B.9000308@vanderpoel.org> <421FCBD7.8000805@vanderpoel.org> <42227EBF.9040703@vanderpoel.org> <45781B7428C6AA07C3B283BD@scan.jck.com> <42229BBC.8020608@vanderpoel.org> <p0621021ebe484f52c0c5@[10.20.30.249]> <4225ABAB.60002@mozilla.org> <p0621022dbe4ab4b8a3fa@[10.20.30.249]> <42251B80.5050503@vanderpoel.org> <Pine.LNX.4.61.0503020759240.17184@nic.museum>
In-Reply-To: <Pine.LNX.4.61.0503020759240.17184@nic.museum>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Cary Karp wrote:
> In addition to the range of operating conditions implied above, there 
> are differences in the way the registries have interpreted and 
> implemented ICANN's IDN Guidelines. That document states, "As the 
> deployment of IDNs proceeds, ICANN and the IDN registries will review 
> these Guidelines at regular intervals, and revise them as necessary 
> based on experience." We are now clearly at such a juncture, and the 
> revision process is already being initiated.

Hi Cary,

It is really nice to hear from you. I have an idea for the Guidelines. 
As Paul has indicated, the various communities around the world have 
different needs, and some have already started writing down the rules 
that they are following in their registries. The JET community comes to 
mind:

http://www.ietf.org/rfc/rfc3743.txt

Other communities have other needs. I've been told that some communities 
use a set of letters that are currently encoded in two different ranges 
of the Unicode space (e.g. Latin and Cyrillic). Today, my idea is that 
these communities can "occupy" their "own" part of the DNS space, for 
example a .tld or a .2ld.tld. They can publish the rules that they 
enforce in their registries, and then the browsers can either allow any 
character sequence in those labels or check them to see if the rules 
were indeed followed.

Of course, it is much harder to come up with and enforce rules in a 
"global" TLD like .com. As a result, the browsers may simply blacklist 
.com in its entirety. Or maybe .com will eventually figure out some 
rules and actually enforce them in the 2LDs, so that the browsers don't 
have to check the 2LDs. Indeed, in a perfect world, .com would even 
enforce rules in 3LDs, 4LDs, etc, so that browsers would not have to 
check those either. We shall see what .com does.

But in the meantime, how about my idea for the Guidelines?

Erik



From owner-idn@ops.ietf.org  Wed Mar  2 18:18:10 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id SAA10600
	for <idn-archive@lists.ietf.org>; Wed, 2 Mar 2005 18:18:09 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6czD-0007a9-CM
	for idn-data@psg.com; Wed, 02 Mar 2005 23:10:35 +0000
Received: from [207.115.63.77] (helo=pimout1-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D6czA-0007Zj-34
	for idn@ops.ietf.org; Wed, 02 Mar 2005 23:10:32 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout1-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j22NALYV023624;
	Wed, 2 Mar 2005 18:10:22 -0500
Message-ID: <422647DC.20106@vanderpoel.org>
Date: Wed, 02 Mar 2005 15:10:20 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Soobok Lee <lsb@lsb.org>
CC: idn@ops.ietf.org
Subject: Re: [idn] another homograph attach: BIDI char
References: <421947FC.8000702@lsb.org>
In-Reply-To: <421947FC.8000702@lsb.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Soobok Lee wrote:
> You can replace %u2044 with %u2205,%u3033 etc. I am now searching more 
> slash/space like chars. I will post them here.

Hi Soobok,

Thank you for investigating and reporting on these characters. Have you 
found any others since then? I have started a table at:

http://nameprep.org/#delimit

Thanks,

Erik



From owner-idn@ops.ietf.org  Wed Mar  2 18:51:54 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id SAA13428
	for <idn-archive@lists.ietf.org>; Wed, 2 Mar 2005 18:51:54 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6dZv-000CmV-Bi
	for idn-data@psg.com; Wed, 02 Mar 2005 23:48:31 +0000
Received: from [193.201.200.34] (helo=tuschin.blackcatnetworks.co.uk)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D6dZu-000CmJ-H6
	for idn@ops.ietf.org; Wed, 02 Mar 2005 23:48:30 +0000
Received: from grmarkham.plus.com ([80.229.30.161] helo=[192.168.1.100])
	by tuschin.blackcatnetworks.co.uk with asmtp (Exim 3.35 #1 (Debian))
	id 1D6dZt-0003KU-00
	for <idn@ops.ietf.org>; Wed, 02 Mar 2005 23:48:29 +0000
Message-ID: <42265072.6040907@mozilla.org>
Date: Wed, 02 Mar 2005 23:46:58 +0000
From: Gervase Markham <gerv@mozilla.org>
Organization: mozilla.org
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: idn@ops.ietf.org
Subject: Re: [idn] Re: character tables
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <421FA55B.9000308@vanderpoel.org> <421FCBD7.8000805@vanderpoel.org> <42227EBF.9040703@vanderpoel.org> <45781B7428C6AA07C3B283BD@scan.jck.com> <42229BBC.8020608@vanderpoel.org> <p0621021ebe484f52c0c5@[10.20.30.249]> <4225ABAB.60002@mozilla.org> <p0621022dbe4ab4b8a3fa@[10.20.30.249]> <42251B80.5050503@vanderpoel.org> <4225455C.2030109@vanderpoel.org> <A32EEA4DEC04F4C4122A64F9@scan.jck.com>
In-Reply-To: <A32EEA4DEC04F4C4122A64F9@scan.jck.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.2 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

John C Klensin wrote:
> So my conclusion is that we need a mixed
> protocol-registry-browser strategy.  That strategy, IMO, should
> shifted the processing burdens as much as possible to the first
> two.  And I think that notions that the problem can or should be
> solved in any of those three places alone are probably misguided.

Absolutely. A strategy which involves changes all the way down the line 
is going to have the best chance of quashing the problem.

Gerv



From owner-idn@ops.ietf.org  Wed Mar  2 21:15:24 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id VAA27065
	for <idn-archive@lists.ietf.org>; Wed, 2 Mar 2005 21:15:23 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6fmC-0006hB-28
	for idn-data@psg.com; Thu, 03 Mar 2005 02:09:20 +0000
Received: from [159.226.7.151] (helo=cnnic.cn)
	by psg.com with smtp (Exim 4.44 (FreeBSD))
	id 1D6fm8-0006gI-W9
	for idn@ops.ietf.org; Thu, 03 Mar 2005 02:09:17 +0000
Received: (eyou send program); Thu, 03 Mar 2005 10:09:03 +0800
Message-ID: <309815743.24908@cnnic.cn>
X-EYOUMAIL-SMTPAUTH: ietf@cdnc.org
Received: from unknown (HELO cnnicyaojk) (159.226.6.18)
 by 159.226.7.151 with SMTP; Thu, 03 Mar 2005 10:09:03 +0800
Message-ID: <011401c51f95$fb449090$1206e29f@cnnicyaojk>
From: "Yao Jiankang" <ietf@cdnc.org>
To: "JFC \(Jefsey\) Morfin" <jefsey@jefsey.com>
Cc: <idn@ops.ietf.org>, "John C Klensin" <klensin@jck.com>
Subject: RE: [idn] Re: character tables
Date: Thu, 3 Mar 2005 10:09:07 +0800
MIME-Version: 1.0
Content-Type: text/plain;
	charset="iso-8859-1"
Content-Transfer-Encoding: base64
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1478
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1478
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-0.7 required=5.0 tests=BAYES_00,MIME_BASE64_BLANKS,
	MIME_BASE64_TEXT,MSGID_FROM_MTA_HEADER,RCVD_BY_IP autolearn=no 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: base64

PiAtLS0tLSBPcmlnaW5hbCBNZXNzYWdlIC0tLS0tIA0KPiBGcm9tOiAiSkZDIChKZWZzZXkpIE1v
cmZpbiIgPGplZnNleUBqZWZzZXkuY29tPg0KPiBUbzogIkpvaG4gQyBLbGVuc2luIiA8a2xlbnNp
bkBqY2suY29tPg0KPiA+IFBsZWFzZSBzdG9wIGNvbnNpZGVyaW5nIHRoZSBzb2x1dGlvbiB0byB5
b3VyIG93biBwcm9ibGVtcy4gT3IgbGV0IHR1cm4gdGhlIA0KPiA+IEludGVybmV0IGVudGlyZWx5
IGluIENoaW5lc2UgYnkgZGVmYXVsdCwgYW5kIGxldCBoZWxwIHRoZSBJRVRGIHRvIGRvY3VtZW50
IA0KPiA+IHRoZSBiZXN0IHdheSB0byBhY2Nlc3MgcGFnZXMgd3JpdHRlbiBpbiBFbmdsaXNoLg0K
PiANCg0KIElmIHlvdSB0aGluayBzbyhvbmx5IGxldCBoZWxwIHRoZSBJRVRGIHRvIGRvY3VtZW50
ICB0aGUgYmVzdCB3YXkgdG8gYWNjZXNzIHBhZ2VzIHdyaXR0ZW4gaW4gRW5nbGlzaC4pLCBpdCBp
cyBub3Qgd2lzZS4gU2luY2Ugb25seSBpbiBtYWlubGFuZCBDaGluYSB0aGVyZSBhcmUgbW9yZSA5
MCBtaWxsaW9uIGludGVybmV0IHVzZXJzIHdoaWNoIGFsbW9zdCBvY2N1cHkgMTAlIG9mIHRoZSB3
b3JsZCBpbnRlcm5ldCBwb3B1bGF0aW9uLiBJZiB5b3UgbmVnbGVjdCB0aGUgQ2hpbmVzZSBpbnRl
cm5ldCBjb21tdW5pdHksIGl0J3MgbGlrZSB5b3UgaGF2ZSBhIDEwJSBibGFja2hvbGUgaW4geW91
ciBzeXN0ZW0sIHNhaWRlZCBieSBKYW1lcyBTZW5nKFNHTklDKS4NCiBTbyB3ZSBtdXN0IGNvbnNp
ZGVyIHRoZSBiZXN0IHdheSB0byBhY2Nlc3MgcGFnZXMgd3JpdHRlbiBpbiBub3Qgb25seSBFbmds
aXNoLCBidXQgYWxzbyBDaGluZXNlLg0KDQpZYW8gSmlhbmthbmc=





From owner-idn@ops.ietf.org  Thu Mar  3 01:41:48 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id BAA18719
	for <idn-archive@lists.ietf.org>; Thu, 3 Mar 2005 01:41:48 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6jtR-000GSX-So
	for idn-data@psg.com; Thu, 03 Mar 2005 06:33:05 +0000
Received: from [128.32.132.165] (helo=nicemice.net)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1D6jtO-000GS1-M1
	for idn@ops.ietf.org; Thu, 03 Mar 2005 06:33:02 +0000
Received: from amc by nicemice.net with local (Exim 3.35 #1 (Debian))
	id 1D6jtL-0000lt-00
	for <idn@ops.ietf.org>; Wed, 02 Mar 2005 22:32:59 -0800
Date: Thu, 3 Mar 2005 06:32:58 +0000
From: "Adam M. Costello" <idn.amc+0@nicemice.net.RemoveThisWord.cnri.reston.va.us>
To: idn@ops.ietf.org
Subject: Re: [idn] Re: character tables
Message-ID: <20050303063258.GA2271~@nicemice.net>
Reply-To: IETF idn working group <idn@ops.ietf.org>
References: <421FCBD7.8000805@vanderpoel.org> <42227EBF.9040703@vanderpoel.org> <45781B7428C6AA07C3B283BD@scan.jck.com> <42229BBC.8020608@vanderpoel.org> <p0621021ebe484f52c0c5@[10.20.30.249]> <4225ABAB.60002@mozilla.org> <p0621022dbe4ab4b8a3fa@[10.20.30.249]> <42251B80.5050503@vanderpoel.org> <Pine.LNX.4.61.0503020759240.17184@nic.museum> <42261AC2.3020004@vanderpoel.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <42261AC2.3020004@vanderpoel.org>
User-Agent: Mutt/1.5.6+20040722i
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Erik van der Poel <erik@vanderpoel.org> wrote:

> Other communities have other needs. I've been told that some
> communities use a set of letters that are currently encoded in two
> different ranges of the Unicode space (e.g. Latin and Cyrillic).
> Today, my idea is that these communities can "occupy" their "own" part
> of the DNS space, for example a .tld or a .2ld.tld.  They can publish
> the rules that they enforce in their registries, and then the browsers
> can either allow any character sequence in those labels or check them
> to see if the rules were indeed followed.

I've also thought along these lines, but I rejected this approach.  The
domain hierarchy is ultimately based on delegation of naming authority,
and trying to use it for any other purpose will run into conflicting
constraints.  Suppose country X wants to support language Y, which is
used in many countries around the world.  Who would be the registry for
the Y domain, and how would you get worldwide agreement on that?  Would
country X be delegated a subdomain of Y?  Would registrants accept X.Y
as a legitimate country X domain, or would they demand to be in an X
top-level domain?  Would users of language Y not get annoyed at seeing Y
at the end of almost every domain name they use?  It's bad enough that
so many domains end in .com, imagine if they all ended in .com.lat (for
"Latin").

I still like the idea of allowing every TLD to have one synonym-TLD per
script, although we might need to recognize some scripts in addition to
the Unicode scripts, for example, the subset-of-(Latin-plus-Cyrillic)
script that you allude to.

AMC



From owner-idn@ops.ietf.org  Thu Mar  3 02:17:40 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id CAA08094
	for <idn-archive@lists.ietf.org>; Thu, 3 Mar 2005 02:17:40 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6kWy-000NLc-DL
	for idn-data@psg.com; Thu, 03 Mar 2005 07:13:56 +0000
Received: from [159.226.7.151] (helo=cnnic.cn)
	by psg.com with smtp (Exim 4.44 (FreeBSD))
	id 1D6kWj-000NDd-T0
	for idn@ops.ietf.org; Thu, 03 Mar 2005 07:13:50 +0000
Received: (eyou send program); Thu, 03 Mar 2005 15:12:56 +0800
Message-ID: <309833976.04536@cnnic.cn>
X-EYOUMAIL-SMTPAUTH: ietf@cdnc.org
Received: from unknown (HELO cnnicyaojk) (159.226.6.18)
 by 159.226.7.151 with SMTP; Thu, 03 Mar 2005 15:12:56 +0800
Message-ID: <004801c51fc0$6eeaf140$1206e29f@cnnicyaojk>
From: "YAO Jiankang" <ietf@cdnc.org>
To: "IETF idn working group" <idn@ops.ietf.org>
References: <421FCBD7.8000805@vanderpoel.org> <42227EBF.9040703@vanderpoel.org> <45781B7428C6AA07C3B283BD@scan.jck.com> <42229BBC.8020608@vanderpoel.org> <p0621021ebe484f52c0c5@[10.20.30.249]> <4225ABAB.60002@mozilla.org> <p0621022dbe4ab4b8a3fa@[10.20.30.249]> <42251B80.5050503@vanderpoel.org> <Pine.LNX.4.61.0503020759240.17184@nic.museum> <42261AC2.3020004@vanderpoel.org> <309832028.23957@cnnic.cn>
Subject: Re: [idn] Re: character tables
Date: Thu, 3 Mar 2005 15:13:00 +0800
MIME-Version: 1.0
Content-Type: text/plain;
	charset="ISO-8859-1"
Content-Transfer-Encoding: base64
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1478
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1478
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-0.7 required=5.0 tests=AWL,BAYES_00,
	MAILTO_TO_REMOVE,MIME_BASE64_BLANKS,MIME_BASE64_TEXT,
	MSGID_FROM_MTA_HEADER,RCVD_BY_IP autolearn=no version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: base64

DQotLS0tLSBPcmlnaW5hbCBNZXNzYWdlIC0tLS0tIA0KRnJvbTogIkFkYW0gTS4gQ29zdGVsbG8i
IDxpZG4uYW1jKzBAbmljZW1pY2UubmV0LlJlbW92ZVRoaXNXb3JkPg0KVG86IDxpZG5Ab3BzLmll
dGYub3JnPg0KPiBJIHN0aWxsIGxpa2UgdGhlIGlkZWEgb2YgYWxsb3dpbmcgZXZlcnkgVExEIHRv
IGhhdmUgb25lIHN5bm9ueW0tVExEIHBlcg0KPiBzY3JpcHQsIGFsdGhvdWdoIHdlIG1pZ2h0IG5l
ZWQgdG8gcmVjb2duaXplIHNvbWUgc2NyaXB0cyBpbiBhZGRpdGlvbiB0bw0KPiB0aGUgVW5pY29k
ZSBzY3JpcHRzLCBmb3IgZXhhbXBsZSwgdGhlIHN1YnNldC1vZi0oTGF0aW4tcGx1cy1DeXJpbGxp
YykNCj4gc2NyaXB0IHRoYXQgeW91IGFsbHVkZSB0by4NCg0KICAgSSBhcHByZWNpYXRlIHRoaXMg
aWRlYSBvZiAgYWxsb3dpbmcgZXZlcnkgVExEIHRvIGhhdmUgb25lIHN5bm9ueW0tVExEIHBlcg0K
IHNjcmlwdCAgaW4gZ2VuZXJhbC4gaG93ZXZlciwgaW4gQ2hpbmEsIFNpbXBsZSBDaGluZXNlIENo
YXJhY3RlcnMgYW5kIFRyYWRpdG9uYWwgQ2hpbmVzZSBDaGFyYWN0ZXJzIGFyZSBlcXVhbGl0eS4g
U28gdGhlIFRMRHMgd2hpY2ggaGF2ZSBib3RoIFNpbXBsZSBDaGluZXNlIENoYXJhY3RlcnMgYW5k
IFRyYWRpdG9uYWwgQ2hpbmVzZSBDaGFyYWN0ZXJzIHNob3VsZCBiZSBhdXRob3JpemVkIHRvIHRo
ZSBzYW1lIG9yZ2FuaXphdGlvbi4NCg0KWUFPIEppYW5rYW5nDQoNCiANCg==





From owner-idn@ops.ietf.org  Thu Mar  3 02:29:32 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id BAA18720
	for <idn-archive@lists.ietf.org>; Thu, 3 Mar 2005 01:41:48 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6jti-000GTd-37
	for idn-data@psg.com; Thu, 03 Mar 2005 06:33:22 +0000
Received: from [203.117.75.22] (helo=mx1.allumer.com.au)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1D6jte-000GSj-71
	for idn@ops.ietf.org; Thu, 03 Mar 2005 06:33:20 +0000
Received: (qmail 69225 invoked by uid 0); 3 Mar 2005 14:36:08 +0800
Received: from wil@dready.org by allumer.com.au by uid 0 with qmail-scanner-1.22 
 (clamdscan: 0.74. spamassassin: 2.63.  Clear:RC:0(220.233.74.98):SA:0(?/?):. 
 Processed in 6.318587 secs); 03 Mar 2005 06:36:08 -0000
X-Qmail-Scanner-Mail-From: wil@dready.org via allumer.com.au
X-Qmail-Scanner: 1.22 (Clear:RC:0(220.233.74.98):SA:0(?/?):. Processed in 6.318587 secs)
Received: from unknown (HELO ?192.168.1.7?) (wil@dready.org@220.233.74.98)
  by mx1.allumer.com.au with RC4-MD5 encrypted SMTP; 3 Mar 2005 14:36:01 +0800
Message-ID: <4226AF7F.9010205@dready.org>
Date: Thu, 03 Mar 2005 17:32:31 +1100
From: William Tan <wil@dready.org>
User-Agent: Mozilla Thunderbird 1.0 (Windows/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Erik van der Poel <erik@vanderpoel.org>
CC: Cary Karp <ck@nic.museum>, idn@ops.ietf.org
Subject: Re: [idn] Re: character tables
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <421FA55B.9000308@vanderpoel.org> <421FCBD7.8000805@vanderpoel.org> <42227EBF.9040703@vanderpoel.org> <45781B7428C6AA07C3B283BD@scan.jck.com> <42229BBC.8020608@vanderpoel.org> <p0621021ebe484f52c0c5@[10.20.30.249]> <4225ABAB.60002@mozilla.org> <p0621022dbe4ab4b8a3fa@[10.20.30.249]> <42251B80.5050503@vanderpoel.org> <Pine.LNX.4.61.0503020759240.17184@nic.museum> <42261AC2.3020004@vanderpoel.org>
In-Reply-To: <42261AC2.3020004@vanderpoel.org>
X-Enigmail-Version: 0.89.5.0
X-Enigmail-Supports: pgp-inline, pgp-mime
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit


> Other communities have other needs. I've been told that some 
> communities use a set of letters that are currently encoded in two 
> different ranges of the Unicode space (e.g. Latin and Cyrillic). 
> Today, my idea is that these communities can "occupy" their "own" part 
> of the DNS space, for example a .tld or a .2ld.tld. 

If by "community" you mean users of a certain language / culture group 
within a geographic region, yes. In fact, they already do. The Japanese 
already "occupy" .jp, Korean .kr, Chinese in PRC .cn, Chinese in Taiwan 
.tw, Chinese in Singapore .sg, etc.

I'm not sure what you are proposing here - are you saying to allocate 
new TLDs for each "community"?

> They can publish the rules that they enforce in their registries, ...

They already do. The rules are just not in a machine readable format, 
and John has already made the case against standardizing language 
tables, let alone other rules that may not be character-based (imagine 
the .th registry saying, allow both Thai and Latin digits, but not both 
in the same label/domain).

> and then the browsers can either allow any character sequence in those 
> labels or check them to see if the rules were indeed followed.

I'd vote against browsers trying to enforce rules set by various 
registries. This is the sort of thing you'd build into a specialized 
tool (as you mentioned) but not in a general application.

>
> Of course, it is much harder to come up with and enforce rules in a 
> "global" TLD like .com.

Don't forget countries who choose to honour multiple cultures within 
their society - .PL allows many different tables, including Cyrillic 
(but does not allow mixing of Cyrillic and Latin scripts, see Andrzej 
Bartosiewicz's draft.

> As a result, the browsers may simply blacklist .com in its entirety.

It looks like a reasonable interim solution, but I'm worried about 
whether .com can actually get off the list. Unlike DNSBL, if the list is 
hardcoded or statically included in the installation package, it's going 
to be difficult to get off that list.

Come to think of it, as an off-IETF solution, maintaining an IDNBL of 
sorts might be a good idea. I know, it didn't really work for mail 
abuses, the landscape is quite different for the problem at hand though. 
The IDNBL can ban an entire zone based on the reasoning that the zone 
administrator has shown to be negligent (".com"), or ban individual 
domains of known phishers, and can even be used to implement character 
blacklists instead of having them hard wired in the browser.

> Or maybe .com will eventually figure out some rules and actually 
> enforce them in the 2LDs, so that the browsers don't have to check the 
> 2LDs. 

I'm hopeful that this will happen.

> Indeed, in a perfect world, .com would even enforce rules in 3LDs, 
> 4LDs, etc, so that browsers would not have to check those either. 

It's not enforceable in 3LD and beyond. period.


wil.



From owner-idn@ops.ietf.org  Thu Mar  3 04:07:22 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id EAA24619
	for <idn-archive@lists.ietf.org>; Thu, 3 Mar 2005 04:07:21 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D6mEo-000FLn-CZ
	for idn-data@psg.com; Thu, 03 Mar 2005 09:03:18 +0000
Received: from [130.242.24.5] (helo=nic.museum)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D6mEc-000FKO-Gu
	for idn@ops.ietf.org; Thu, 03 Mar 2005 09:03:06 +0000
Received: from nic.museum (nic.museum [127.0.0.1])
	by nic.museum (8.13.1/8.13.1) with ESMTP
	id j2393YZP007051;
	Thu, 3 Mar 2005 10:03:34 +0100
Received: from localhost (ck@localhost)
	by nic.museum (8.13.1/8.13.1/Submit) with ESMTP id j2393YRd007048;
	Thu, 3 Mar 2005 10:03:34 +0100
Date: Thu, 3 Mar 2005 10:03:34 +0100 (CET)
From: Cary Karp <ck@nic.museum>
To: idn@ops.ietf.org
Subject: [idn] Re: character tables
In-Reply-To: <42261AC2.3020004@vanderpoel.org>
Message-ID: <Pine.LNX.4.61.0503030934580.6590@nic.museum>
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net>
 <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org>
 <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org>
 <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com>
 <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com>
 <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL>
 <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <421FA55B.9000308@vanderpoel.org>
 <421FCBD7.8000805@vanderpoel.org> <42227EBF.9040703@vanderpoel.org>
 <45781B7428C6AA07C3B283BD@scan.jck.com> <42229BBC.8020608@vanderpoel.org>
 <p0621021ebe484f52c0c5@[10.20.30.249]> <4225ABAB.60002@mozilla.org>
 <p0621022dbe4ab4b8a3fa@[10.20.30.249]> <42251B80.5050503@vanderpoel.org>
 <Pine.LNX.4.61.0503020759240.17184@nic.museum> <42261AC2.3020004@vanderpoel.org>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Quoting Erik van der Poel:

> I've been told that some communities use a set of letters that are 
> currently encode in two different ranges of the Unicode space 
> (e.g. Latin and Cyrillic). Today, my idea is that these 
> communities can "occupy" their "own" part of the DNS space, for 
> example a .tld or a .2ld.tld.

The community occupying 2ld.tld doesn't write the rules that 
determine the character repertoire available for use in .tld, and 
can therefore not necessarily represent even its own name as it 
might ideally prefer. The 2ld.tld folks do get to make the 
corresponding decision for 3ld.2ld.tld (if permitted in .tld 
policy). In the reasonably commonplace situation where all 
subdomains under 2ld.tld are operated by a single entity, coherent 
rules can be applied throughout. This situation is, however, by no 
means the only one that pertains, and it certainly does not apply to 
the point of delegation under a TLD.

Most people would probably use the term 'language' to designate the 
attribute of community identity that is expressed by its use of a 
certain set of letters. A community wishing to project that identity 
into the domain namespace will therefore need either to locate a 
parent domain that accepts the registration of names including the 
needed characters, or convince what would otherwise be the most 
desirable parent to implement that support. Languages are, however, 
frequently shared by numerous communities without any other aspect 
of shared identity, and identical sets of letters often appear in 
more than one language. (This is one of the reasons why gTLDs so 
prominently appear in the present discussion.)

> I have an idea for the Guidelines. As Paul has indicated, the 
> various communities around the world have different needs, and 
> some have already started writing down the rules that they are 
> following in their registries. The JET community comes to mind:

Both the JET and the ICANN guidelines are intended to assist TLD 
operators in establishing safe and responsible IDN policies that 
will prove useful to the broadest number of nameholder communities. 
The JET action addresses the needs of three languages but I doubt 
that the people who use those languages perceive the slightest 
additional sense of 'JET community'. And, as an uncomfortable matter 
of fact, the extent to which the genuinely excellent JET Guidelines 
will be accepted by the target language groups remains to be 
determined.

> Of course, it is much harder to come up with and enforce rules in 
> a "global" TLD like .com

One might think the situation to be straightforward in a ccTLD, but 
there are clear current trends in ccTLD policy development toward 
removing the entry-level requirement for national nexus, and 
permitting the use of more extensive character repertoires than 
would normally be associated with the nominal TLD designation. It is 
by no means uncommon for a country to have more than one official 
language and an even larger number of officially recognized minority 
languages. It is also common for countries to belong to 
multinational alliances, with member states recognizing all of the 
languages used within that union. All this needs to be reflected in 
a ccTLD's IDN policies, which will often require every bit as artful 
juggling of a range of scripts and languages as would be needed in a 
gTLD, with a heavy further amount of political intricacy that a gTLD 
might be able to avoid.

It is true, nonetheless, that a ccTLD operator will generally be in 
a better position to produce an authoritative statement of the 
character repertoire necessary for the IDN representation of one of 
'its' languages, than would the operator of a gTLD serving the same 
language community. For this reason, many gTLDs introduce IDN 
support for a given language first subsequent to a ccTLD clearly 
associated with that language having described its requirements, or 
when a similar statement has been produced by some other obviously 
authoritative group.

Please also keep in mind that the geographic permimeters within 
which many languages are used do not coincide with national 
boundaries, and that many communities do not associate their 
language identities with the national identities of the countries in 
which they reside. IDN provides unprecedented means for such things 
as allowing a diaspora to maintain it sense of cultural cohesion, or 
furthering the cause of a group struggling to have its language 
officially recognized or attempting to reverse threats to its 
survival. In such contexts the national implication of a cc label 
may be undesired, which is another of the reasons why gTLDs so 
prominently appear in the present discussion.

> They can publish the rules that they enforce in their registries, 
> and then the browsers can either allow any character sequence in 
> those labels or check them to see if the rules were indeed 
> followed.

I am grateful that my only headache in this regard is anticipating 
the policy and technical requirements for supporting the thousand or 
so languages that some segment of the museum community may sooner or 
later express interest in representing via IDN in .museum. The same 
repertoire may also appear elsewhere in the TLD space and I 
certainly don't envy the people who intend to devise and implement 
the algorithmic underpinnings for the automation of that process or
the validation of its results :-)

/Cary



From owner-idn@ops.ietf.org  Fri Mar 11 18:51:38 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id SAA21317
	for <idn-archive@lists.ietf.org>; Fri, 11 Mar 2005 18:51:38 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1D9tmB-000ITm-3c
	for idn-data@psg.com; Fri, 11 Mar 2005 23:42:39 +0000
Received: from [207.115.63.101] (helo=pimout2-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1D9tm8-000ITI-Rl
	for idn@ops.ietf.org; Fri, 11 Mar 2005 23:42:37 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout2-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2BNgRMW350298;
	Fri, 11 Mar 2005 18:42:31 -0500
Message-ID: <42322CE2.4040509@vanderpoel.org>
Date: Fri, 11 Mar 2005 15:42:26 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: John C Klensin <klensin@jck.com>
CC: idn@ops.ietf.org
Subject: [idn] Unicode categories
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
In-Reply-To: <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-1.5 required=5.0 tests=AWL,BAYES_05 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

John C Klensin wrote:
> the view that, at the time, the Unicode
> classifications of characters were considered a little soft

FYI, I asked about Unicode category stability on the Unicode list, and 
received the following info:

From: "Andrew C. West" <andrewcwest@alumni.princeton.edu>

According to my calculations, the number of characters which changed 
their General Category from one version of Unicode to the next is :

1.1.5 -> 2.0.14 = 474 (1.384%)
2.0.14 -> 2.1.2 = 1 (0.0025%)
2.1.2 -> 2.1.5 = 16 (0.0410%)
2.1.5 -> 2.1.8 = 18 (0.0462%)
2.1.8 -> 2.1.9 = 3 (0.0077%)
2.1.9 -> 3.0.0 = 85 (0.2182%)
3.0.0 -> 3.0.1 = 0 (0%)
3.0.1 -> 3.1.0 = 3 (0.0061%)
3.1.0 -> 3.2.0 = 7 (0.0074%)
3.2.0 -> 4.0.0 = 16 (0.0168%)
4.0.0 -> 4.0.1 = 1 (0.0010%)
4.0.1 -> 4.1.0 = 12 (0.0124%)

I don't know what this tells you about the stability of the UCD data though.



From owner-idn@ops.ietf.org  Sat Mar 12 04:21:39 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id EAA19814
	for <idn-archive@lists.ietf.org>; Sat, 12 Mar 2005 04:21:38 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DA2i7-0001rp-Uj
	for idn-data@psg.com; Sat, 12 Mar 2005 09:15:03 +0000
Received: from [207.115.63.77] (helo=pimout1-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DA2hv-0001qX-Gk
	for idn@ops.ietf.org; Sat, 12 Mar 2005 09:14:51 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout1-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2C9EeLE137156;
	Sat, 12 Mar 2005 04:14:44 -0500
Message-ID: <4232B2FD.1080104@vanderpoel.org>
Date: Sat, 12 Mar 2005 01:14:37 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: John C Klensin <klensin@jck.com>, idn@ops.ietf.org
CC: Kenneth Whistler <kenw@sybase.com>
Subject: [idn] Re: Unicode categories
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <42322CE2.4040509@vanderpoel.org>
In-Reply-To: <42322CE2.4040509@vanderpoel.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

All,

Please do not draw any conclusions from the raw Unicode category 
stability data that I sent earlier. Ken Whistler, a Technical Director 
at the Unicode Consortium, was so kind to provide further information to 
put the data into their proper perspective. See below.

Sorry about that,

Erik

-------------------------------------------

Date: Fri, 11 Mar 2005 18:23:51 -0800 (PST)
From: Kenneth Whistler <kenw@sybase.com>
Subject: Re: UCD stability
To: erik@vanderpoel.org
Cc: unicode@unicode.org, kenw@sybase.com

Erik,

If you are going to do things like pass these raw calculations
along to the IDN list, ostensibly as some measure of stability
of the UCD data, then you should take into consideration another
metric.

The raw number of characters changing is less reflective of
stability than considering how many *decisions* to change
a property (of one or more characters) were taken.

I intersperse some notes to Andrew West's calculated numbers
below, to help put this in context.

 > Andrew C. West wrote:
 > > According to my calculations, the number of characters which 
changed their
 > > General Category from one version of Unicode to the next is :
 > >
 > > 1.1.5 -> 2.0.14 = 474 (1.384%)

Many, many, changes, since 1.1.5 was developed in house,
without general public review, and since 2.0.14 (the
data version corresponding to Unicode 2.0) was the first
public release of the data files.

 > > 2.0.14 -> 2.1.2 = 1 (0.0025%)

1 decision

 > > 2.1.2 -> 2.1.5 = 16 (0.0410%)

2 decisions: addition of Pi/Pf subcategories, and 1 fix for 8 Tibetan
characters

 > > 2.1.5 -> 2.1.8 = 18 (0.0462%)

1 decision: changes to converge identifier definitions

 > > 2.1.8 -> 2.1.9 = 3 (0.0077%)

2 decisions: fix for Greek numeral signs; fix for halfwidth forms light
vertical

 > > 2.1.9 -> 3.0.0 = 85 (0.2182%)

I'd have to dig further for this, but these were likely mostly
changes involved in nailing down normalization for Unicode 3.0.

 > > 3.0.0 -> 3.0.1 = 0 (0%)
 > > 3.0.1 -> 3.1.0 = 3 (0.0061%)

1 decision: 3 Runic golden numbers

 > > 3.1.0 -> 3.2.0 = 7 (0.0074%)

5 decisions: 2 fixes for Khmer signs, 1 for Tamil aytham, 1 for
Arabic end of ayah (architectural), 1 for the 3 Mongolian free
variation selectors

 > > 3.2.0 -> 4.0.0 = 16 (0.0168%)

2 decisions: 1 fix for 12 modifier letters, 1 fix for decimal digit
alignment

 > > 4.0.0 -> 4.0.1 = 1 (0.0010%)

1 decision: fix for ZWSP

 > > 4.0.1 -> 4.1.0 = 12 (0.0124%)

3 decisions: 1 fix for Ethiopic digits, 1 for 2 Katakana middle dots,
1 for Yi syllable wu

 > >
 > > I don't know what this tells you about the stability of the UCD 
data though.

The significant point of instability in General Category
assignments was in establishing Unicode 2.0 data files
(now more than 8 years in the past).

There was a significant hiccup for Unicode 3.0, at the point
when it became clear that normalization stability was going
to be a major issue, and when the data was culled for
consistency under canonical and compatibility equivalence.

Since that time, the UTC has been very conservative, indeed,
in approving any General Category change for an existing
character. The types of changes have been limited to:

   A. Clarification regarding obscure characters for which
      insufficient information was available earlier.

   B. Establishment of further data consistency constraints
      (this impacted some numeric categories, and also
      explains the change for the Katakana middle dot)

   C. Implementation issues with a few format characters
      (ZWSP, Arabic end of ayah, Mongolian free variation selectors)

Since the publication of Unicode 3.0 in 2000, the only
significantly common-use characters that had any General
Category change were:

    U+0B83 TAMIL SIGN VISARGA (=aytham, Tamil data)
    U+200B ZERO WIDTH SPACE  (mostly relevant to Thai data)
    U+30FB KATAKANA MIDDLE DOT  (Japanese)

Of those 3, only U+30FB would exist in any commonly
interchanged character set other than Unicode, and
*that* change was merely to
change a punctuation subclass (gc=Pc --> gc=Po) -- and
was additionally a *reversion* to the General Category
assignment that U+30FB had in 2.1.5 and earlier.

--Ken



From owner-idn@ops.ietf.org  Sat Mar 12 04:49:31 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id EAA21421
	for <idn-archive@lists.ietf.org>; Sat, 12 Mar 2005 04:49:31 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DA3C9-0004JH-SA
	for idn-data@psg.com; Sat, 12 Mar 2005 09:46:05 +0000
Received: from [207.115.63.102] (helo=pimout3-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DA3C7-0004J2-QS
	for idn@ops.ietf.org; Sat, 12 Mar 2005 09:46:04 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout3-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2C9jw9N374232;
	Sat, 12 Mar 2005 04:45:59 -0500
Message-ID: <4232BA56.5090001@vanderpoel.org>
Date: Sat, 12 Mar 2005 01:45:58 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: idn@ops.ietf.org
Subject: [idn] stability
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>
In-Reply-To: <4232B2FD.1080104@vanderpoel.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

All,

This is probably well known to most of you, but the General Category 
Value in the Unicode Character Database and the stability of that value 
are not very relevant to IDNA, which does not depend on the Unicode 
Categories.

IDNA depends on the Unicode Normalization Form KC table, and there have 
been very few changes indeed in this table:

http://www.unicode.org/Public/UNIDATA/NormalizationCorrections.txt

Also, IDNA apps depend on tables for converting from various non-Unicode 
encodings to Unicode. This is another place where instability could 
affect lookups, potentially even in dangerous ways. Stringprep and IDNA 
already mention this issue in their Security Considerations sections.

Erik



From owner-idn@ops.ietf.org  Sat Mar 12 07:14:50 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id HAA00502
	for <idn-archive@lists.ietf.org>; Sat, 12 Mar 2005 07:14:50 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DA5Qs-000JD6-Ki
	for idn-data@psg.com; Sat, 12 Mar 2005 12:09:26 +0000
Received: from [80.67.18.16] (helo=smtprelay04.ispgateway.de)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DA5Qq-000JBq-2s
	for idn@ops.ietf.org; Sat, 12 Mar 2005 12:09:24 +0000
Received: (qmail 1545 invoked from network); 12 Mar 2005 12:09:19 -0000
Received: from unknown (HELO [80.185.147.201]) (544451@[80.185.147.201])
          (envelope-sender <martin@v.loewis.de>)
          by smtprelay04.ispgateway.de (qmail-ldap-1.03) with AES256-SHA encrypted SMTP
          for <erik@vanderpoel.org>; 12 Mar 2005 12:09:19 -0000
Message-ID: <4232DBEE.3090601@v.loewis.de>
Date: Sat, 12 Mar 2005 13:09:18 +0100
From: =?ISO-8859-1?Q?=22Martin_v=2E_L=F6wis=22?= <martin@v.loewis.de>
User-Agent: Debian Thunderbird 1.0 (X11/20050116)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Erik van der Poel <erik@vanderpoel.org>
CC: idn@ops.ietf.org
Subject: Re: [idn] stability
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org>
In-Reply-To: <4232BA56.5090001@vanderpoel.org>
X-Enigmail-Version: 0.90.0.0
X-Enigmail-Supports: pgp-inline, pgp-mime
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Erik van der Poel wrote:
> Also, IDNA apps depend on tables for converting from various non-Unicode 
> encodings to Unicode. This is another place where instability could 
> affect lookups, potentially even in dangerous ways. Stringprep and IDNA 
> already mention this issue in their Security Considerations sections.

I think an evaluation of whether something is potentially dangerous
should take linguistic research into account.

As a layman, I recognize that these are all compatibility characters
(and all for CJK encodings). For example, F951 is, according to my
Linux /usr/share/i18n/charmaps, part of CP 949, EUC-KR, and JOHAB.
Looking at the character tables privided by the Unicode consortium,
it seems obvious that it is correctly mapped to 964B and not 96FB
(but it could be that the font tables were explicitly designed to
show the same glyph).

According to Unicode corrigendum 3,

http://www.unicode.org/versions/corrigendum3.html

this character is only used for Korean encodings, to support
a different pronounciation (so the character was duplicated
in the Korean standard also). The corrigendum also asserts
that the character will not readily be recognized by most Korean
speakers (Chinese speakers recognize the character, but they
won't use the compatibility character).

So in practical life, it appears that this normalization change
is unlikely to occur, so it is hard to see how it could cause
danger. I believe the same is true for all the other cases where
the normalization has changed.

The real danger is to judge other people's work inadequately,
and to believe one can do better than them. The people who
created these tables are experts in their field (linguistics
and scripts), if they make mistakes, then likely because the
subject matter is so obscure that "normal people" never
encounter the issue at hand.

I'm not concerned about stability of IDN.

Regards,
Martin



From owner-idn@ops.ietf.org  Sat Mar 12 11:48:19 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id LAA20702
	for <idn-archive@lists.ietf.org>; Sat, 12 Mar 2005 11:48:18 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DA9fC-000Kvw-TH
	for idn-data@psg.com; Sat, 12 Mar 2005 16:40:30 +0000
Received: from [209.187.148.211] (helo=bs.jck.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DA9fA-000Kvh-LZ
	for idn@ops.ietf.org; Sat, 12 Mar 2005 16:40:28 +0000
Received: from [209.187.148.215] (helo=scan.jck.com)
	by bs.jck.com with esmtp (Exim 4.34)
	id 1DA9f8-0004fB-TU; Sat, 12 Mar 2005 11:40:26 -0500
Date: Sat, 12 Mar 2005 11:40:26 -0500
From: John C Klensin <klensin@jck.com>
To: Erik van der Poel <erik@vanderpoel.org>, idn@ops.ietf.org
cc: Kenneth Whistler <kenw@sybase.com>
Subject: [idn] Re: Unicode categories
Message-ID: <59DD38FB83B7216C06E61E59@scan.jck.com>
In-Reply-To: <4232B2FD.1080104@vanderpoel.org>
References: <421B8484.3070802@vanderpoel.org>
 <20050223072837.GA21463~@nicemice.net>
 <D872CCF059514053ECF8A198@scan.jck.com>
 <421D8411.9030006@vanderpoel.org>
 <p06210208be4390618c81@[192.168.0.101]>
 <421E0D0C.2000309@vanderpoel.org>
 <p06210202be43c3888991@[192.168.0.101]>
 <E07CE813AD23B2D95DA0C740@scan.jck.com>
 <421E30F2.1040408@vanderpoel.org>
 <0E7F74C71945B923C52211F3@scan.jck.com>
 <421EA0C9.1010500@vanderpoel.org>
 <00a401c51af3$7863aae0$030aa8c0@DEWELL>
 <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
 <42322CE2.4040509@vanderpoel.org>
 <4232B2FD.1080104@vanderpoel.org>
X-Mailer: Mulberry/3.1.6 (Win32)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit



--On Saturday, 12 March, 2005 01:14 -0800 Erik van der Poel
<erik@vanderpoel.org> wrote:

> All,
> 
> Please do not draw any conclusions from the raw Unicode
> category stability data that I sent earlier. Ken Whistler, a
> Technical Director at the Unicode Consortium, was so kind to
> provide further information to put the data into their proper
> perspective. See below.
>...

Erik, Ken, and others,

The difficulty here is not, IMO, the specific numbers or
percentages.  It is an important difference in perspective.
>From the standpoint of UTC, these changes are few, minor, and
corrections to obscure errors.  That is a perfectly sensible
position.  

>From the standpoint of the IETF, or anyone else worried about a
piece of protocol that must support many applications, the
problem is a little different.  Some of the recent developments
in automatic updating tools notwithstanding, IDNA (and its
supporting tables) are designed to be embedded in and used from
clients.  Many of those clients, and the associated operating
systems, have been historically updated only when the machine in
which they run is replaced.   That argues for an extremely
conservative view of protocol design and compatibility, with
very high thresholds for justifying incompatible changes of any
sort.  From that viewpoint, the differences between 0.01%
changes and 5% changes is like measures of being partially
pregnant: perhaps helpful in some types of risk assessment, but
less so in making the next design decision.  

      john





From owner-idn@ops.ietf.org  Sat Mar 12 13:18:34 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id NAA26867
	for <idn-archive@lists.ietf.org>; Sat, 12 Mar 2005 13:18:34 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DAB7n-0005w3-OR
	for idn-data@psg.com; Sat, 12 Mar 2005 18:14:07 +0000
Received: from [80.67.18.16] (helo=smtprelay04.ispgateway.de)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DAB7m-0005vg-AT
	for idn@ops.ietf.org; Sat, 12 Mar 2005 18:14:06 +0000
Received: (qmail 8721 invoked from network); 12 Mar 2005 18:14:03 -0000
Received: from unknown (HELO [80.185.147.201]) (544451@[80.185.147.201])
          (envelope-sender <martin@v.loewis.de>)
          by smtprelay04.ispgateway.de (qmail-ldap-1.03) with AES256-SHA encrypted SMTP
          for <klensin@jck.com>; 12 Mar 2005 18:14:03 -0000
Message-ID: <4233316A.7060101@v.loewis.de>
Date: Sat, 12 Mar 2005 19:14:02 +0100
From: =?ISO-8859-1?Q?=22Martin_v=2E_L=F6wis=22?= <martin@v.loewis.de>
User-Agent: Debian Thunderbird 1.0 (X11/20050116)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: John C Klensin <klensin@jck.com>
CC: Erik van der Poel <erik@vanderpoel.org>, idn@ops.ietf.org,
        Kenneth Whistler <kenw@sybase.com>
Subject: Re: [idn] Re: Unicode categories
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org> <59DD38FB83B7216C06E61E59@scan.jck.com>
In-Reply-To: <59DD38FB83B7216C06E61E59@scan.jck.com>
X-Enigmail-Version: 0.90.0.0
X-Enigmail-Supports: pgp-inline, pgp-mime
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

John C Klensin wrote:
>>From the standpoint of the IETF, or anyone else worried about a
> piece of protocol that must support many applications, the
> problem is a little different.  Some of the recent developments
> in automatic updating tools notwithstanding, IDNA (and its
> supporting tables) are designed to be embedded in and used from
> clients.  Many of those clients, and the associated operating
> systems, have been historically updated only when the machine in
> which they run is replaced.   That argues for an extremely
> conservative view of protocol design and compatibility, with
> very high thresholds for justifying incompatible changes of any
> sort.  From that viewpoint, the differences between 0.01%
> changes and 5% changes is like measures of being partially
> pregnant: perhaps helpful in some types of risk assessment, but
> less so in making the next design decision.  

While the facts are all true (clients only updated rarely, and
protocol stability being important), I somewhat disagree with the
conclusion. Design decisions need to take all these things into
account, but on a factual basis, not a moral one. E.g. if a protocol
change is known to potentially break existing clients, but the
number of actual clients being broken is also known to be small,
the protocol change might still be acceptable. Likewise if the
impact of "breakage" would be "small".

In the context of IDNA, I would conclude that upgrading to a
newer Unicode version in IDNA would do no significant harm, even
if it is, strictly speaking, an incompatible protocol change.
Existing clients must be considered, but in doing so, the effects
of a proposed change to such clients must also be considered -
not in a theoretical way, but trying the changes on a real
existing client. For IDNA, it seems likely that the existing
clients would not change in any user-visible way, and that
the behaviour change in artificial cases should be considered
acceptable.

That said, I also believe that upgrading to a newer Unicode
version would do little good. Additional characters are likely
of little use to the broad masses, as font support etc. is still
lacking. If certain new characters are of high interest to IDNA
users, I expect registrars to weaken the "AllowUnassigned"
setting of "false" to, say, "AllowUnassignedAsPerLatestUnicodeSpec" -
independent of what any RFC says.

Regards,
Martin



From owner-idn@ops.ietf.org  Sat Mar 12 13:24:10 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id NAA27251
	for <idn-archive@lists.ietf.org>; Sat, 12 Mar 2005 13:24:09 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DABDx-0006TD-Hu
	for idn-data@psg.com; Sat, 12 Mar 2005 18:20:29 +0000
Received: from [32.97.110.130] (helo=e32.co.us.ibm.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DABDu-0006SE-90
	for idn@ops.ietf.org; Sat, 12 Mar 2005 18:20:26 +0000
Received: from d03relay04.boulder.ibm.com (d03relay04.boulder.ibm.com [9.17.195.106])
	by e32.co.us.ibm.com (8.12.10/8.12.9) with ESMTP id j2CIKP5j328886
	for <idn@ops.ietf.org>; Sat, 12 Mar 2005 13:20:25 -0500
Received: from d03av04.boulder.ibm.com (d03av04.boulder.ibm.com [9.17.195.170])
	by d03relay04.boulder.ibm.com (8.12.10/NCO/VER6.6) with ESMTP id j2CIKO3A185374
	for <idn@ops.ietf.org>; Sat, 12 Mar 2005 11:20:24 -0700
Received: from d03av04.boulder.ibm.com (loopback [127.0.0.1])
	by d03av04.boulder.ibm.com (8.12.11/8.12.11) with ESMTP id j2CIKOFW020688
	for <idn@ops.ietf.org>; Sat, 12 Mar 2005 11:20:24 -0700
Received: from markdavis (sig-9-48-112-114.mts.ibm.com [9.48.112.114])
	by d03av04.boulder.ibm.com (8.12.11/8.12.11) with SMTP id j2CIKM9P020620;
	Sat, 12 Mar 2005 11:20:22 -0700
Message-ID: <003801c52730$2660d1c0$72703009@sanjose.ibm.com>
From: "Mark Davis" <mark.davis@jtcsv.com>
To: "John C Klensin" <klensin@jck.com>,
        "Erik van der Poel" <erik@vanderpoel.org>, <idn@ops.ietf.org>
Cc: "Kenneth Whistler" <kenw@sybase.com>
References: <421B8484.3070802@vanderpoel.org> <20050223072837.GA21463~@nicemice.net> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org> <59DD38FB83B7216C06E61E59@scan.jck.com>
Subject: Re: [idn] Re: Unicode categories
Date: Sat, 12 Mar 2005 10:15:18 -0800
MIME-Version: 1.0
Content-Type: text/plain;
	charset="utf-8"
Content-Transfer-Encoding: 8bit
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1437
X-MIMEOLE: Produced By Microsoft MimeOLE V6.00.2800.1441
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 8bit

We do not make any absolute guarantees of stability for the general category
and many other properties, because a miscategorized character would cause
incorrect behavior in computers for the languages that use it. And as new,
increasingly obscure characters are added to the standard, it may take some
time to get really accurate information.

However, I do want to call attention to certain properties of the Unicode
Standard that may be relevant -- characterizing identifer and pattern syntax
characters -- which do have strict requirements on stability. There is a
draft of the newest specification on
http://www.unicode.org/reports/tr31/tr31-5.html. Programming identifiers
have a bit different requirements from IDN, but they are related enough that
the information may be useful.

The data for Pattern_Syntax and Pattern_White_Space is in
http://www.unicode.org/Public/4.1.0/ucd/PropList-4.1.0d12.txt. For XID_Start
and XID_Continue, it is in
http://www.unicode.org/Public/4.1.0/ucd/DerivedCoreProperties-4.1.0d12.txt

All of these will be finalized and released as part of Unicode 4.1.0.

â€ŽMark

----- Original Message ----- 
From: "John C Klensin" <klensin@jck.com>
To: "Erik van der Poel" <erik@vanderpoel.org>; <idn@ops.ietf.org>
Cc: "Kenneth Whistler" <kenw@sybase.com>
Sent: Saturday, March 12, 2005 08:40
Subject: [idn] Re: Unicode categories


>
>
> --On Saturday, 12 March, 2005 01:14 -0800 Erik van der Poel
> <erik@vanderpoel.org> wrote:
>
> > All,
> >
> > Please do not draw any conclusions from the raw Unicode
> > category stability data that I sent earlier. Ken Whistler, a
> > Technical Director at the Unicode Consortium, was so kind to
> > provide further information to put the data into their proper
> > perspective. See below.
> >...
>
> Erik, Ken, and others,
>
> The difficulty here is not, IMO, the specific numbers or
> percentages.  It is an important difference in perspective.
> >From the standpoint of UTC, these changes are few, minor, and
> corrections to obscure errors.  That is a perfectly sensible
> position.
>
> >From the standpoint of the IETF, or anyone else worried about a
> piece of protocol that must support many applications, the
> problem is a little different.  Some of the recent developments
> in automatic updating tools notwithstanding, IDNA (and its
> supporting tables) are designed to be embedded in and used from
> clients.  Many of those clients, and the associated operating
> systems, have been historically updated only when the machine in
> which they run is replaced.   That argues for an extremely
> conservative view of protocol design and compatibility, with
> very high thresholds for justifying incompatible changes of any
> sort.  From that viewpoint, the differences between 0.01%
> changes and 5% changes is like measures of being partially
> pregnant: perhaps helpful in some types of risk assessment, but
> less so in making the next design decision.
>
>       john
>
>
>
>




From owner-idn@ops.ietf.org  Sun Mar 13 11:27:36 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id LAA21632
	for <idn-archive@lists.ietf.org>; Sun, 13 Mar 2005 11:27:36 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DAVom-000AC6-B8
	for idn-data@psg.com; Sun, 13 Mar 2005 16:19:52 +0000
Received: from [217.13.230.178] (helo=yxa.extundo.com)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DAVoj-000ABo-KO
	for idn@ops.ietf.org; Sun, 13 Mar 2005 16:19:50 +0000
Received: from latte.josefsson.org (c494102a.s-bi.bostream.se [217.215.27.65])
	(authenticated bits=0)
	by yxa.extundo.com (8.13.3/8.13.3/Debian-6) with ESMTP id j2DGJfAq004877
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK)
	for <idn@ops.ietf.org>; Sun, 13 Mar 2005 17:19:42 +0100
From: Simon Josefsson <jas@extundo.com>
To: Erik van der Poel <erik@vanderpoel.org>
Cc: idn@ops.ietf.org
Subject: [idn] Re: stability
References: <421B8484.3070802@vanderpoel.org>
	<20050223072837.GA21463~@nicemice.net>
	<D872CCF059514053ECF8A198@scan.jck.com>
	<421D8411.9030006@vanderpoel.org>
	<p06210208be4390618c81@[192.168.0.101]>
	<421E0D0C.2000309@vanderpoel.org>
	<p06210202be43c3888991@[192.168.0.101]>
	<E07CE813AD23B2D95DA0C740@scan.jck.com>
	<421E30F2.1040408@vanderpoel.org>
	<0E7F74C71945B923C52211F3@scan.jck.com>
	<421EA0C9.1010500@vanderpoel.org>
	<00a401c51af3$7863aae0$030aa8c0@DEWELL>
	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>
	<4232BA56.5090001@vanderpoel.org>
OpenPGP: id=B565716F; url=http://josefsson.org/key.txt
Blog: http://www.livejournal.com/users/jas4711/
X-Hashcash: 1:21:050312:erik@vanderpoel.org::xFGnZBQ2yaktCH5K:0c2F
X-Hashcash: 1:21:050312:idn@ops.ietf.org::sv+oSHFO3Ie9dXjT:6K+m
Date: Sat, 12 Mar 2005 12:04:36 +0100
In-Reply-To: <4232BA56.5090001@vanderpoel.org> (Erik van der Poel's message of
	"Sat, 12 Mar 2005 01:45:58 -0800")
Message-ID: <iluk6odazwb.fsf@latte.josefsson.org>
User-Agent: Gnus/5.110003 (No Gnus v0.3) Emacs/22.0.50 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Hashcash: 1:21:050313:idn@ops.ietf.org::qvtTv+LtgTgShyB+:021b
X-Virus-Scanned: ClamAV version 0.81, clamav-milter version 0.81b on yxa.extundo.com
X-Virus-Status: Clean
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Erik van der Poel <erik@vanderpoel.org> writes:

> All,
>
> This is probably well known to most of you, but the General Category 
> Value in the Unicode Character Database and the stability of that value 
> are not very relevant to IDNA, which does not depend on the Unicode 
> Categories.
>
> IDNA depends on the Unicode Normalization Form KC table, and there have 
> been very few changes indeed in this table:
>
> http://www.unicode.org/Public/UNIDATA/NormalizationCorrections.txt

Don't forget the normalization flaw in Unicode 3.2 NFKC discussed in:

http://www.unicode.org/review/pr-29.html

Apparently the recommendation will be applied to future Unicode
versions.

PR-29 doesn't merely affect a small set of code points, but rather a
class of strings.  The special strings are all unstable under NFKC3.2.

I think PR-29 is a useful example to consider when deciding how much
trust you should place in the UTC's stability guarantees.  The UTC's
track record in this area suggest to me that the guarantee is
worthless in practice.  I haven't seen an evaluation of alternative
solutions to the PR-29 problem.  Not even signs that alternative
approaches were considered.  I would have expected both.

> Also, IDNA apps depend on tables for converting from various non-Unicode 
> encodings to Unicode. This is another place where instability could 
> affect lookups, potentially even in dangerous ways. Stringprep and IDNA 
> already mention this issue in their Security Considerations sections.

Right.

Thanks,
Simon



From owner-idn@ops.ietf.org  Sun Mar 13 21:41:21 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id VAA03757
	for <idn-archive@lists.ietf.org>; Sun, 13 Mar 2005 21:41:21 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DAfN9-0007QT-DI
	for idn-data@psg.com; Mon, 14 Mar 2005 02:31:59 +0000
Received: from [63.247.76.195] (helo=montage.altserver.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DAfN5-0007QA-Td
	for idn@ops.ietf.org; Mon, 14 Mar 2005 02:31:56 +0000
Received: from lns-p19-19-idf-82-65-139-89.adsl.proxad.net ([82.65.139.89] helo=jfc.afrac.org)
	by montage.altserver.com with esmtpa (Exim 4.44)
	id 1DAfN3-0002Hm-Mz
	for idn@ops.ietf.org; Sun, 13 Mar 2005 18:31:54 -0800
Message-Id: <6.1.2.0.2.20050314015110.03f8ab80@mail.jefsey.com>
X-Sender: jefsey+jefsey.com@mail.jefsey.com
X-Mailer: QUALCOMM Windows Eudora Version 6.1.2.0
Date: Mon, 14 Mar 2005 03:31:44 +0100
To: idn@ops.ietf.org
From: "JFC (Jefsey) Morfin" <jefsey@jefsey.com>
Subject: Re: [idn] Re: stability
In-Reply-To: <iluk6odazwb.fsf@latte.josefsson.org>
References: <421B8484.3070802@vanderpoel.org>
 <20050223072837.GA21463~@nicemice.net>
 <D872CCF059514053ECF8A198@scan.jck.com>
 <421D8411.9030006@vanderpoel.org>
 <p06210208be4390618c81@[192.168.0.101]>
 <421E0D0C.2000309@vanderpoel.org>
 <p06210202be43c3888991@[192.168.0.101]>
 <E07CE813AD23B2D95DA0C740@scan.jck.com>
 <421E30F2.1040408@vanderpoel.org>
 <0E7F74C71945B923C52211F3@scan.jck.com>
 <421EA0C9.1010500@vanderpoel.org>
 <00a401c51af3$7863aae0$030aa8c0@DEWELL>
 <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
 <42322CE2.4040509@vanderpoel.org>
 <4232B2FD.1080104@vanderpoel.org>
 <4232BA56.5090001@vanderpoel.org>
 <iluk6odazwb.fsf@latte.josefsson.org>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"; format=flowed
X-AntiAbuse: This header was added to track abuse, please include it with any abuse report
X-AntiAbuse: Primary Hostname - montage.altserver.com
X-AntiAbuse: Original Domain - ops.ietf.org
X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12]
X-AntiAbuse: Sender Address Domain - jefsey.com
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

On 12:04 12/03/2005, Simon Josefsson said:
>I think PR-29 is a useful example to consider when deciding how much
>trust you should place in the UTC's stability guarantees.

> > Also, IDNA apps depend on tables for converting from various non-Unicode
> > encodings to Unicode. This is another place where instability could
> > affect lookups, potentially even in dangerous ways. Stringprep and IDNA
> > already mention this issue in their Security Considerations sections.

I try to understand the best way for ccTLDs to approach the variations in 
Unicode tables and a possible punycode update. I also try take into account 
the impact of the revision of BCP 047 (RFC 3066) engaged by the WG-ltru 
(which seems mainly motivated by W3C concerns).

1. the IDN Tables are in fact the list of Unicode points accepted by a 
Registry manager to form domain names in the "virtual zone" related to that 
table. This table may or may not be related to a language in the way RFC 
3066 means it. Let for example take ASCII 256, it does not include every 
French characters, but includes characters used in many European countries. 
I don't think any European ccTLD Registry Manager would object to support 
all the ASCII 256 characters and to add the missing ones which would not 
conflict - but would be faced with the problem of their ASCII equivalent 
(French "oe" as 2 characters instead of one, for example). The reason why 
is that there are/will be more and more words of European languages being 
accepted in other languages. Specially in commercial, cultural, societal 
areas which are a good source of domain name. Just let think about sport 
champions, singers, etc.

This means that the list of accepted characters would not relate to a 
determined language, while the IANA calls for its registration in 
documenting it with the language/script attributes which are those 
considered by the WG-ltru draft.

We therefore need another tag system for the IDN tables. This tag is 
attached to many management aspects, registrant support, homograph control, 
etc. It must also be clearly documented to the SLD zone managers if one 
want to push them to respect the same rules for 3+LD labels.

This could lead to a virtual zone management BCP (preferable?), or to an 
IDN Table support part in the WG-ltru Draft (my first idea, but I am less 
inclined to that now, unless we propose that a IDN Table is made of the 
addition of the language tables accepted by the TLD Registry Manager, but 
obviously IESG has not followed my suggestion of a more complete tag review 
permitting to document tag operations, like tag(eu)=sigma european language 
tags).

I think this does not create a problem for the European scripts. But I have 
no idea about the non Latin scripts?


2. the IDN Tables adopted by a ccTLD Manager (either code by code, or as 
the addition of IDN language tables) are contractual annexes to the IDN 
registration contracts. The ccTLD Manager should word in its terms and 
conditions what happens if the code supporting a character is changed, or 
if punycode is updated resulting in the same change. My understanding is 
that such a change will result in having the registered IDN to transcode in 
another ACE label.

- if this label does not exist the two versions should be registered for free.
- if the new label conflicts with an existing label, we have a problem - 
but I understand this is unlikely?
- I understand we should not have the case of a stringprep failure where 
there was none before? Or that this should then result in an update?

Then the ccTLD will have to document its new IDN Table. This means that she 
will add the new code to the table. But she will not be able to remove the 
former code since it is still used, but she should be able to mention that 
it cannot be used in requests of names - only in free CNAMEs.

Also a program should help the ccTLD Registry to parse her table to make 
sure all the listed codes are correct (last date of change).

Am I correct with this?

jfc


=====================================================
For your convenience:
Draft: 		http://www.inter-locale.com/ID/draft-ietf-ltru-registry-00.txt
Charter: 	http://ietf.org/html.charters/ltru-charter.html
gmane: 	http://dir.gmane.org/gmane.ietf.ltru
If you were Bcced for information and not familliar with the IETF process:
http://www.ietf.org/rfc/rfc2026.txt
http://www.ietf.org/rfc/rfc2418.txt
http://www.ietf.org/rfc/rfc3934.txt
http://www.ietf.org/rfc/rfc3669.txt
http://www.ietf.org/rfc/rfc3160.txt
http://www.ietf.org/internet-drafts/draft-hoffman-taobis-02.txt
=====================================================
Jon Postel (RFC 1591): "The IANA is not in the business of deciding
what is and what is not a country. The selection of the ISO 3166 list
  as a basis for country code top-level domain names was made with
  the knowledge that ISO has a procedure for determining which
entities should be and should not be on that list."
=====================================================
Brian Carpenter (RFC 1958/3.2): "If there are several ways of doing the
same thing, choose one. If a previous design, in the Internet context
or elsewhere, has successfully solved the same problem, choose the
same solution unless there is a good technical reason not to.
Duplication of the same protocol functionality should be avoided as far as
possible, without of course using this argument to reject improvements."
=====================================================
It seems that what works for countries and ISO 3166 since 1978 should
apply to languages and to ISO 693.
=====================================================




From owner-idn@ops.ietf.org  Mon Mar 14 10:28:16 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id KAA12629
	for <idn-archive@lists.ietf.org>; Mon, 14 Mar 2005 10:28:15 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DArHv-0002YT-Ll
	for idn-data@psg.com; Mon, 14 Mar 2005 15:15:23 +0000
Received: from [32.97.110.131] (helo=e33.co.us.ibm.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DArHl-0002Xk-Kx
	for idn@ops.ietf.org; Mon, 14 Mar 2005 15:15:13 +0000
Received: from d03relay05.boulder.ibm.com (d03relay05.boulder.ibm.com [9.17.195.107])
	by e33.co.us.ibm.com (8.12.10/8.12.9) with ESMTP id j2EFF84I505338
	for <idn@ops.ietf.org>; Mon, 14 Mar 2005 10:15:08 -0500
Received: from d03av03.boulder.ibm.com (d03av03.boulder.ibm.com [9.17.195.169])
	by d03relay05.boulder.ibm.com (8.12.10/NCO/VER6.6) with ESMTP id j2EFF7Uq161114
	for <idn@ops.ietf.org>; Mon, 14 Mar 2005 08:15:08 -0700
Received: from d03av03.boulder.ibm.com (loopback [127.0.0.1])
	by d03av03.boulder.ibm.com (8.12.11/8.12.11) with ESMTP id j2EFF7WR021170
	for <idn@ops.ietf.org>; Mon, 14 Mar 2005 08:15:07 -0700
Received: from markdavis (sig-9-48-123-179.mts.ibm.com [9.48.123.179])
	by d03av03.boulder.ibm.com (8.12.11/8.12.11) with SMTP id j2EFF63I021153;
	Mon, 14 Mar 2005 08:15:06 -0700
Message-ID: <00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>
From: "Mark Davis" <mark.davis@jtcsv.com>
To: "Simon Josefsson" <jas@extundo.com>,
        "Erik van der Poel" <erik@vanderpoel.org>
Cc: <idn@ops.ietf.org>
References: <421B8484.3070802@vanderpoel.org><20050223072837.GA21463~@nicemice.net><D872CCF059514053ECF8A198@scan.jck.com><421D8411.9030006@vanderpoel.org><p06210208be4390618c81@[192.168.0.101]><421E0D0C.2000309@vanderpoel.org><p06210202be43c3888991@[192.168.0.101]><E07CE813AD23B2D95DA0C740@scan.jck.com><421E30F2.1040408@vanderpoel.org><0E7F74C71945B923C52211F3@scan.jck.com><421EA0C9.1010500@vanderpoel.org><00a401c51af3$7863aae0$030aa8c0@DEWELL><A574CA1BE87BFDA3C2A1AC0E@scan.jck.com><42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org><4232BA56.5090001@vanderpoel.org> <iluk6odazwb.fsf@latte.josefsson.org>
Subject: Re: [idn] Re: stability
Date: Mon, 14 Mar 2005 07:15:04 -0800
MIME-Version: 1.0
Content-Type: text/plain;
	charset="utf-8"
Content-Transfer-Encoding: 8bit
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1437
X-MIMEOLE: Produced By Microsoft MimeOLE V6.00.2800.1441
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 8bit

You keep harping on that, but we really had no choice in that matter. The
definition of normalization in UAX #15 was internally inconsistent. Certain
implementations of the UAX algorithm would exhibit unacceptably aberrant
behavior, although only in a small number of degenerate cases, none of which
occurring in ordinary text. The problems are:

1. Broken Idempotency. A non-idempotent implementation by its very nature
cannot be stable, because repeated application of a non-idempotent
normalization could produce different results.The application of the
inconsistent interpretation therefore causes fundamental problems for
implementations as further outlined in PRI#29; briefly, these are
comparable to using a comparison function that isn't transitive when
sorting.

2. Broken Canonical Equivalence. The inconsistent interpretation of the
old UAX version could "normalize" some text to something that is not
canonically equivalent to the input -- it changes some text to some
completely different text.

3. Broken Canonical Order. Application of NFC[old UAX] or NFKC[old UAX]
produces output that is not only different text (not canonically
equivalent) but also not in canonical order. As a result, something
returned from a normalization function may not even pass the normalization
quick check: NFC_quick_check(NFC(string))=NO.

After carefully evaluating the nature and effects of this inconsistency
the UTC reached a decision to address these problems as follows:

The current version of UAX #15 in Unicode 4.1.0 addresses the internal
inconsistency. The changes do not affect any versions of UAX #15 prior to
Unicode 4.1.0 and therefore do not affect stringprep or IDN. No
backwards-compatibility problems will be introduced as a result of the
changes.

Stringprep and IDN rely on Unicode 3.2 version of UAX #15, which is:

http://www.unicode.org/unicode/reports/tr15/tr15-22.html

Implementations that claim conformance to Unicode 3.2 normalization may
not produce identical results in all cases, and may not produce *correct*
normalizations, because versions of UAX #15 prior to 4.1.0 have been
internally inconsistent. While normalization problems only happen in
degenerate cases, the inconsistency in the definition is significant enough
that UTC felt compelled to make the change. During deliberations, UTC did
discuss stability policies in the standard, and concluded that this
inconsistency itself is unstable; it led to demonstrably divergent
implementations, and could not stand without correction.

In addition to the new 4.1.0 version of UAX #15, the UTC decided to issue
a corrigendum which can be applied to other versions of Unicode. None of
the prior versions of the Unicode Standard or its annexes will be changed
in any way. Any implementation that claims conformance to Unicode 3.2 can
stay precisely the same. Only if an implementation claims conformance to
3.2 plus the new corrigendum, or to version 4.1.0 or later of Unicode,
would it change. So the current stringprep and IDN are not affected.

When it comes time to update stringprep to a new version of Unicode, such
as 4.1.0, there are two paths that IETF can take:

(a) simply update to the newer version, or
(b) specify a method which takes the previous algorithm and applies it to
the new Unicode data.

Option (a) sacrifices some compatibility, although (1) strings that have
already been stringprepped *once* with the old version will have the same
results under either version, and (2) the UTC does not expect any real data
to contain the degenerate cases that trigger the problem.

The UTC strongly recommends against Option (b). While it maintains
backwards compatibility It does not fix the underlying problems: two
successive applications of stringprep can still result in different
strings.

And if you look carefully at the stability requirements, you see "If a
string contains only characters from a given version of the Unicode Standard
(e.g., Unicode 3.1.1), and it is put into a normalized form in accordance
with that version of Unicode, then it will be in normalized form according
to any past or future versions of Unicode. " Which is true, even after
applying PRI #29.

It would also be interesting to me to see the level of stability that is
guaranteed by the other organizations. I know that there are W3C
Recommendations that do not maintain perfect stability. How about the IETF?
Is there a policy that any RFC that obsoletes another RFC is required to be
absolutely -- bug-for-bug -- backwards compatible?

â€ŽMark

----- Original Message ----- 
From: "Simon Josefsson" <jas@extundo.com>
To: "Erik van der Poel" <erik@vanderpoel.org>
Cc: <idn@ops.ietf.org>
Sent: Saturday, March 12, 2005 03:04
Subject: [idn] Re: stability


> Erik van der Poel <erik@vanderpoel.org> writes:
>
> > All,
> >
> > This is probably well known to most of you, but the General Category
> > Value in the Unicode Character Database and the stability of that value
> > are not very relevant to IDNA, which does not depend on the Unicode
> > Categories.
> >
> > IDNA depends on the Unicode Normalization Form KC table, and there have
> > been very few changes indeed in this table:
> >
> > http://www.unicode.org/Public/UNIDATA/NormalizationCorrections.txt
>
> Don't forget the normalization flaw in Unicode 3.2 NFKC discussed in:
>
> http://www.unicode.org/review/pr-29.html
>
> Apparently the recommendation will be applied to future Unicode
> versions.
>
> PR-29 doesn't merely affect a small set of code points, but rather a
> class of strings.  The special strings are all unstable under NFKC3.2.
>
> I think PR-29 is a useful example to consider when deciding how much
> trust you should place in the UTC's stability guarantees.  The UTC's
> track record in this area suggest to me that the guarantee is
> worthless in practice.  I haven't seen an evaluation of alternative
> solutions to the PR-29 problem.  Not even signs that alternative
> approaches were considered.  I would have expected both.
>
> > Also, IDNA apps depend on tables for converting from various non-Unicode
> > encodings to Unicode. This is another place where instability could
> > affect lookups, potentially even in dangerous ways. Stringprep and IDNA
> > already mention this issue in their Security Considerations sections.
>
> Right.
>
> Thanks,
> Simon
>
>




From owner-idn@ops.ietf.org  Mon Mar 14 10:46:01 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id KAA14495
	for <idn-archive@lists.ietf.org>; Mon, 14 Mar 2005 10:46:00 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DArdg-0005Mu-MG
	for idn-data@psg.com; Mon, 14 Mar 2005 15:37:52 +0000
Received: from [217.13.230.178] (helo=yxa.extundo.com)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DArdb-0005KF-B8
	for idn@ops.ietf.org; Mon, 14 Mar 2005 15:37:47 +0000
Received: from latte.josefsson.org (c494102a.s-bi.bostream.se [217.215.27.65])
	(authenticated bits=0)
	by yxa.extundo.com (8.13.3/8.13.3/Debian-6) with ESMTP id j2EFbaPa015128
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Mon, 14 Mar 2005 16:37:37 +0100
From: Simon Josefsson <jas@extundo.com>
To: "Mark Davis" <mark.davis@jtcsv.com>
Cc: "Erik van der Poel" <erik@vanderpoel.org>, <idn@ops.ietf.org>
Subject: [idn] Re: stability
References: <421B8484.3070802@vanderpoel.org>
	<20050223072837.GA21463~@nicemice.net>
	<D872CCF059514053ECF8A198@scan.jck.com>
	<421D8411.9030006@vanderpoel.org>
	<p06210208be4390618c81@[192.168.0.101]>
	<421E0D0C.2000309@vanderpoel.org>
	<p06210202be43c3888991@[192.168.0.101]>
	<E07CE813AD23B2D95DA0C740@scan.jck.com>
	<421E30F2.1040408@vanderpoel.org>
	<0E7F74C71945B923C52211F3@scan.jck.com>
	<421EA0C9.1010500@vanderpoel.org>
	<00a401c51af3$7863aae0$030aa8c0@DEWELL>
	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>
	<4232BA56.5090001@vanderpoel.org>
	<iluk6odazwb.fsf@latte.josefsson.org>
	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>
OpenPGP: id=B565716F; url=http://josefsson.org/key.txt
Blog: http://www.livejournal.com/users/jas4711/
X-Hashcash: 1:21:050314:mark.davis@jtcsv.com::Y58rsObVjxMh4uZj:0feA
X-Hashcash: 1:21:050314:erik@vanderpoel.org::/7b2Ka/JrFk8gHUK:6xTD
X-Hashcash: 1:21:050314:idn@ops.ietf.org::HgRrDV8cMtdhDTYQ:7XZo
Date: Mon, 14 Mar 2005 16:37:18 +0100
In-Reply-To: <00e801c528a8$99ad37d0$72703009@sanjose.ibm.com> (Mark Davis's
	message of "Mon, 14 Mar 2005 07:15:04 -0800")
Message-ID: <ilull8qb5n5.fsf@latte.josefsson.org>
User-Agent: Gnus/5.110003 (No Gnus v0.3) Emacs/22.0.50 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Virus-Scanned: ClamAV version 0.81, clamav-milter version 0.81b on yxa.extundo.com
X-Virus-Status: Clean
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.1 required=5.0 tests=AWL,BAYES_00,URIBL_SBL 
	autolearn=no version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

"Mark Davis" <mark.davis@jtcsv.com> writes:

> Implementations that claim conformance to Unicode 3.2 normalization may
> not produce identical results in all cases, and may not produce *correct*
> normalizations, because versions of UAX #15 prior to 4.1.0 have been
> internally inconsistent.

We seem to disagree on this.  I believe Unicode 3.2 was consistent.
Only the non-normative sections was in conflict with the normative
text.  I admit an implementation would not meet some normalization
invariants discussed in the document.  But I don't believe the
invariants were discussed as requirements on the implementation.

> It would also be interesting to me to see the level of stability that is
> guaranteed by the other organizations. I know that there are W3C
> Recommendations that do not maintain perfect stability. How about the IETF?
> Is there a policy that any RFC that obsoletes another RFC is required to be
> absolutely -- bug-for-bug -- backwards compatible?

For the IETF, my understanding is that the policy is to make whatever
changes works best for people.  Including breaking backwards
compatibility when appropriate.  The stability guarantee place the UTC
in a different seat, though.

Thanks,
Simon



From owner-idn@ops.ietf.org  Tue Mar 15 01:15:28 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id BAA13417
	for <idn-archive@lists.ietf.org>; Tue, 15 Mar 2005 01:15:27 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DB5Cp-0007RY-V5
	for idn-data@psg.com; Tue, 15 Mar 2005 06:07:03 +0000
Received: from [207.115.63.102] (helo=pimout3-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DB5Cj-0007Qc-AP
	for idn@ops.ietf.org; Tue, 15 Mar 2005 06:07:02 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout3-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2F66S9N065464;
	Tue, 15 Mar 2005 01:06:32 -0500
Message-ID: <42367B63.6080300@vanderpoel.org>
Date: Mon, 14 Mar 2005 22:06:27 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Simon Josefsson <jas@extundo.com>, Mark Davis <mark.davis@jtcsv.com>
CC: idn@ops.ietf.org
Subject: Re: [idn] Re: stability
References: <421B8484.3070802@vanderpoel.org>	<20050223072837.GA21463~@nicemice.net>	<D872CCF059514053ECF8A198@scan.jck.com>	<421D8411.9030006@vanderpoel.org>	<p06210208be4390618c81@[192.168.0.101]>	<421E0D0C.2000309@vanderpoel.org>	<p06210202be43c3888991@[192.168.0.101]>	<E07CE813AD23B2D95DA0C740@scan.jck.com>	<421E30F2.1040408@vanderpoel.org>	<0E7F74C71945B923C52211F3@scan.jck.com>	<421EA0C9.1010500@vanderpoel.org>	<00a401c51af3$7863aae0$030aa8c0@DEWELL>	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>	<4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com> <ilull8qb5n5.fsf@latte.josefsson.org>
In-Reply-To: <ilull8qb5n5.fsf@latte.josefsson.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.1 required=5.0 tests=AWL,BAYES_00,URIBL_SBL 
	autolearn=no version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Simon Josefsson wrote:
> "Mark Davis" <mark.davis@jtcsv.com> writes:
>>Implementations that claim conformance to Unicode 3.2 normalization may
>>not produce identical results in all cases, and may not produce *correct*
>>normalizations, because versions of UAX #15 prior to 4.1.0 have been
>>internally inconsistent.
> 
> We seem to disagree on this.  I believe Unicode 3.2 was consistent.
> Only the non-normative sections was in conflict with the normative
> text.  I admit an implementation would not meet some normalization
> invariants discussed in the document.  But I don't believe the
> invariants were discussed as requirements on the implementation.

I read UAX #15 and PRI #29. It's quite unfortunate that such a mistake 
was made in the spec, and that several implementations have implemented 
that mistake so faithfully. Although I would normally feel that the IETF 
should just stick with the original normalization table and rules (to 
avoid DNS lookup failures or, heaven forbid, security breaches), in this 
case, it may be wiser to adopt the new UAX #15 rules, since the 
invariants are important to IDNA also. The idempotence invariant seems 
especially important.

I feel that we are still at the very beginning of the adoption of the 
particular Unicodes affected by this mistake. Most of them are for South 
Asian languages. Hangul is much further along, but not the particular 
Unicodes that are affected here (i.e. the Jamo). More importantly, this 
mistake only affects highly unusual, malformed data. I think that if 
IDNA decides not to follow Unicode's recommendation now or in the next 
couple of years, 10 or 20 years from now we would look back in time and 
regret this decision. If there is a time to break compatibility for 
something, it is now, for this.

The Korean IDN table at IANA does not contain the Jamo that are affected 
by this mistake. (They use the precomposed syllables, rather than the 
individual pieces.) I don't know anything about IDN in South Asia, but I 
doubt that any labels have been registered with this particular type of 
malformed data.

It is interesting that, in this case, Unicode seems to have implemented 
first and written the spec later, which is the way the IETF is supposed 
to do things too. It's just unfortunate that the Unicode spec was 
transcribed incorrectly from the implementation(s). On the other hand, 
IDNA seems to have done it in the opposite order. First, the spec was 
written, and now that we have deployed some implementations, we are 
finding serious problems with punctuation marks and symbols.

Erik



From owner-idn@ops.ietf.org  Tue Mar 15 14:12:19 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id OAA07258
	for <idn-archive@lists.ietf.org>; Tue, 15 Mar 2005 14:12:17 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBHLW-000K24-TR
	for idn-data@psg.com; Tue, 15 Mar 2005 19:04:50 +0000
Received: from [207.115.63.77] (helo=pimout1-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DBHLR-000K1P-8n
	for idn@ops.ietf.org; Tue, 15 Mar 2005 19:04:49 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout1-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2FJ4EKo131828;
	Tue, 15 Mar 2005 14:04:14 -0500
Message-ID: <423731AD.6060503@vanderpoel.org>
Date: Tue, 15 Mar 2005 11:04:13 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: idn@ops.ietf.org
CC: Simon Josefsson <jas@extundo.com>, Mark Davis <mark.davis@jtcsv.com>
Subject: Re: [idn] stability
References: <421B8484.3070802@vanderpoel.org>	<20050223072837.GA21463~@nicemice.net>	<D872CCF059514053ECF8A198@scan.jck.com>	<421D8411.9030006@vanderpoel.org>	<p06210208be4390618c81@[192.168.0.101]>	<421E0D0C.2000309@vanderpoel.org>	<p06210202be43c3888991@[192.168.0.101]>	<E07CE813AD23B2D95DA0C740@scan.jck.com>	<421E30F2.1040408@vanderpoel.org>	<0E7F74C71945B923C52211F3@scan.jck.com>	<421EA0C9.1010500@vanderpoel.org>	<00a401c51af3$7863aae0$030aa8c0@DEWELL>	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>	<4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com> <ilull8qb5n5.fsf@latte.josefsson.org> <42367B63.6080300@vanderpoel.org>
In-Reply-To: <42367B63.6080300@vanderpoel.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

It's very quiet on this mailing list...

> The idempotence invariant seems 
> especially important.

Keep in mind that IDNA requires Nameprep to be applied a 2nd time in 
order to determine whether a Punycode label may be displayed in its 
Unicode form.

> If there is a time to break compatibility for 
> something, it is now, for this.

Note that we wouldn't actually be "breaking compatibility" since it is 
highly unlikely that anyone would have created a domain label with such 
strange combinations of characters. Also, even though there are 
implementations out there that implement UAX #15 the "wrong" way, keep 
in mind that there are also implementations that implement it the other 
way. This, in itself, is sufficient grounds for IETF to not only show 
concern, but also take action.

> On the other hand, 
> IDNA seems to have done it in the opposite order. First, the spec was 
> written, and now that we have deployed some implementations, we are 
> finding serious problems with punctuation marks and symbols.

Nobody has bothered to point out that this remark was unfair, so I'll 
just say it myself. IDNA is at the Proposed Standard Maturity Level, so 
we still have the opportunity to improve the specs for the Draft 
Standard and Internet Standard Maturity Levels. This is not only 
possible, it is expected.

Erik



From owner-idn@ops.ietf.org  Tue Mar 15 15:36:54 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id PAA16470
	for <idn-archive@lists.ietf.org>; Tue, 15 Mar 2005 15:36:54 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBIcs-0000ap-T3
	for idn-data@psg.com; Tue, 15 Mar 2005 20:26:50 +0000
Received: from [80.67.18.15] (helo=smtprelay03.ispgateway.de)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DBIcr-0000aD-0u
	for idn@ops.ietf.org; Tue, 15 Mar 2005 20:26:49 +0000
Received: (qmail 20883 invoked from network); 15 Mar 2005 20:26:51 -0000
Received: from unknown (HELO [80.185.154.213]) (544451@[80.185.154.213])
          (envelope-sender <martin@v.loewis.de>)
          by smtprelay03.ispgateway.de (qmail-ldap-1.03) with AES256-SHA encrypted SMTP
          for <erik@vanderpoel.org>; 15 Mar 2005 20:26:51 -0000
Message-ID: <4237450A.9010901@v.loewis.de>
Date: Tue, 15 Mar 2005 21:26:50 +0100
From: =?ISO-8859-1?Q?=22Martin_v=2E_L=F6wis=22?= <martin@v.loewis.de>
User-Agent: Debian Thunderbird 1.0 (X11/20050116)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Erik van der Poel <erik@vanderpoel.org>
CC: Simon Josefsson <jas@extundo.com>, Mark Davis <mark.davis@jtcsv.com>,
        idn@ops.ietf.org
Subject: Re: [idn] Re: stability
References: <421B8484.3070802@vanderpoel.org>	<20050223072837.GA21463~@nicemice.net>	<D872CCF059514053ECF8A198@scan.jck.com>	<421D8411.9030006@vanderpoel.org>	<p06210208be4390618c81@[192.168.0.101]>	<421E0D0C.2000309@vanderpoel.org>	<p06210202be43c3888991@[192.168.0.101]>	<E07CE813AD23B2D95DA0C740@scan.jck.com>	<421E30F2.1040408@vanderpoel.org>	<0E7F74C71945B923C52211F3@scan.jck.com>	<421EA0C9.1010500@vanderpoel.org>	<00a401c51af3$7863aae0$030aa8c0@DEWELL>	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>	<4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com> <ilull8qb5n5.fsf@latte.josefsson.org> <42367B63.6080300@vanderpoel.org>
In-Reply-To: <42367B63.6080300@vanderpoel.org>
X-Enigmail-Version: 0.90.0.0
X-Enigmail-Supports: pgp-inline, pgp-mime
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Erik van der Poel wrote:
> I read UAX #15 and PRI #29. It's quite unfortunate that such a mistake 
> was made in the spec, and that several implementations have implemented 
> that mistake so faithfully.

It's also quite understandable. It is not at all obvious that the
correction is necessary; even know that I read it, and even though
I have implemented the algorithm myself (for Python), I found it very
difficult to understand the issue. Here is the problem:

In NFD, combining characters are sorted according to their combining
class, in increasing order. So you always have

starter small_combiner_A large_combiner_B next_start ...
(with A <= B)

The old text says that a combiner is blocked if it has the same
combining class, so

starter combiner_A other_combiner_B (with A==B; if starter
cannot be combined with combiner_A, then combiner_A blocks
combiner_B)

Now, the correction says that you should consider also the case

starter combiner_A combiner_B; with A > B ?!

How can that be? NFD should have sorted them so that combiner_B
comes *before* combiner_A, so it would not be blocked. Think about it.

The answer is this: This is *only* possible if combiner_B is a
starter, i.e. B==0. But if so, why could you possibly combine it
with the starter? Can you ever combine two starters? Think about it.

The answer is yes: for Hangul Jamo. They all have combining class 0,
yet they can be combined. There are also a few other characters which
have combining class 0 and still can be combined. However, it is not
at all obvious.

For the specific case of Python, it turns out that I special-cased
Hangul composition, so it won't apply the standard algorithm (of
looking for blockers); this means that all the examples in PR#29
apparently work "correctly" with Python. However, for the non-Hangul
cases, it is possible to produce the "bad" behaviour with Python 2.4.


> I feel that we are still at the very beginning of the adoption of the 
> particular Unicodes affected by this mistake. Most of them are for South 
> Asian languages. Hangul is much further along, but not the particular 
> Unicodes that are affected here (i.e. the Jamo).

It's not that easy. When you use the old algorithm, you get normal
Hangul syllables, which would be allowed in IDNA. It's only that the
sequence *before* the normalization should not be allowed.

> More importantly, this 
> mistake only affects highly unusual, malformed data. I think that if 
> IDNA decides not to follow Unicode's recommendation now or in the next 
> couple of years, 10 or 20 years from now we would look back in time and 
> regret this decision. 

I don't think so. "We" could still change the decision in 20 years, and
not a single registration would be affected. The sequences causing the
behaviour change are *really* unusual - I don't know if software can
visually render them in a meaningful way, and I guess a native speaker
would just consider them moji-bake. So it is unlikely that anybody would
try to use them as input to IDNA in the next 20 years in a reasonable
application.

> It is interesting that, in this case, Unicode seems to have implemented 
> first and written the spec later, which is the way the IETF is supposed 
> to do things too. It's just unfortunate that the Unicode spec was 
> transcribed incorrectly from the implementation(s). On the other hand, 
> IDNA seems to have done it in the opposite order. First, the spec was 
> written, and now that we have deployed some implementations, we are 
> finding serious problems with punctuation marks and symbols.

That's why IDNA is still a Proposed Standard Protocol (not even
a Draft Standard Protocol); see STD 1. It will advance to Draft
Standard if two independent and interoperable implementations
from different code bases have been developed, and sufficient
successful operational experience has been gained; see BCP 9.

It also *not* the case that it was specified first and implemented then.
All along the process, people have been implementing bits and pieces of
it, test beds have been run, and so on. You might not have been around,
but some people still remember.

Regards,
Martin



From owner-idn@ops.ietf.org  Tue Mar 15 16:42:35 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id QAA24120
	for <idn-archive@lists.ietf.org>; Tue, 15 Mar 2005 16:42:34 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBJhA-000A3q-1L
	for idn-data@psg.com; Tue, 15 Mar 2005 21:35:20 +0000
Received: from [207.115.63.102] (helo=pimout3-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DBJh3-000A3U-Og
	for idn@ops.ietf.org; Tue, 15 Mar 2005 21:35:18 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout3-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2FLYh9N268304;
	Tue, 15 Mar 2005 16:34:48 -0500
Message-ID: <423754F3.50405@vanderpoel.org>
Date: Tue, 15 Mar 2005 13:34:43 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: =?ISO-8859-1?Q?=22Martin_v=2E_L=F6wis=22?= <martin@v.loewis.de>
CC: Simon Josefsson <jas@extundo.com>, Mark Davis <mark.davis@jtcsv.com>,
        idn@ops.ietf.org
Subject: Re: [idn] Re: stability
References: <421B8484.3070802@vanderpoel.org>	<20050223072837.GA21463~@nicemice.net>	<D872CCF059514053ECF8A198@scan.jck.com>	<421D8411.9030006@vanderpoel.org>	<p06210208be4390618c81@[192.168.0.101]>	<421E0D0C.2000309@vanderpoel.org>	<p06210202be43c3888991@[192.168.0.101]>	<E07CE813AD23B2D95DA0C740@scan.jck.com>	<421E30F2.1040408@vanderpoel.org>	<0E7F74C71945B923C52211F3@scan.jck.com>	<421EA0C9.1010500@vanderpoel.org>	<00a401c51af3$7863aae0$030aa8c0@DEWELL>	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>	<4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com> <ilull8qb5n5.fsf@latte.josefsson.org> <42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>
In-Reply-To: <4237450A.9010901@v.loewis.de>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 8bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 8bit

Martin v. Löwis wrote:
> Erik van der Poel wrote:
>> I feel that we are still at the very beginning of the adoption of the 
>> particular Unicodes affected by this mistake. Most of them are for 
>> South Asian languages. Hangul is much further along, but not the 
>> particular Unicodes that are affected here (i.e. the Jamo).
> 
> It's not that easy. When you use the old algorithm, you get normal
> Hangul syllables, which would be allowed in IDNA. It's only that the
> sequence *before* the normalization should not be allowed.

No, these strange sequences should not be disallowed. The specs should 
be corrected so that the implementations can all treat these strange 
sequences the same way.

>> More importantly, this mistake only affects highly unusual, malformed 
>> data. I think that if IDNA decides not to follow Unicode's 
>> recommendation now or in the next couple of years, 10 or 20 years from 
>> now we would look back in time and regret this decision. 
> 
> I don't think so. "We" could still change the decision in 20 years, and
> not a single registration would be affected. The sequences causing the
> behaviour change are *really* unusual - I don't know if software can
> visually render them in a meaningful way, and I guess a native speaker
> would just consider them moji-bake. So it is unlikely that anybody would
> try to use them as input to IDNA in the next 20 years in a reasonable
> application.

If we do not correct the specs, more and more implementations will be 
created and deployed, some implementing it one way, the others the other 
way. It is hard to change something when a lot of implementations have 
been deployed. This is why we have to act now (or soon). We have to nip 
it in the bud.

Erik



From owner-idn@ops.ietf.org  Tue Mar 15 16:59:07 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id QAA25357
	for <idn-archive@lists.ietf.org>; Tue, 15 Mar 2005 16:59:06 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBJze-000CL7-Is
	for idn-data@psg.com; Tue, 15 Mar 2005 21:54:26 +0000
Received: from [217.13.230.178] (helo=yxa.extundo.com)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DBJzS-000CJ9-Mp
	for idn@ops.ietf.org; Tue, 15 Mar 2005 21:54:15 +0000
Received: from latte.josefsson.org (c494102a.s-bi.bostream.se [217.215.27.65])
	(authenticated bits=0)
	by yxa.extundo.com (8.13.3/8.13.3/Debian-6) with ESMTP id j2FLs3ib008879
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Tue, 15 Mar 2005 22:54:05 +0100
From: Simon Josefsson <jas@extundo.com>
To: Erik van der Poel <erik@vanderpoel.org>
Cc: Mark Davis <mark.davis@jtcsv.com>, idn@ops.ietf.org,
        =?iso-8859-1?Q?Martin_v=2E_L=F6wis?= <martin@v.loewis.de>
Subject: [idn] Re: stability
References: <421B8484.3070802@vanderpoel.org>
	<D872CCF059514053ECF8A198@scan.jck.com>
	<421D8411.9030006@vanderpoel.org>
	<p06210208be4390618c81@[192.168.0.101]>
	<421E0D0C.2000309@vanderpoel.org>
	<p06210202be43c3888991@[192.168.0.101]>
	<E07CE813AD23B2D95DA0C740@scan.jck.com>
	<421E30F2.1040408@vanderpoel.org>
	<0E7F74C71945B923C52211F3@scan.jck.com>
	<421EA0C9.1010500@vanderpoel.org>
	<00a401c51af3$7863aae0$030aa8c0@DEWELL>
	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>
	<4232BA56.5090001@vanderpoel.org>
	<iluk6odazwb.fsf@latte.josefsson.org>
	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>
	<ilull8qb5n5.fsf@latte.josefsson.org>
	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>
	<423754F3.50405@vanderpoel.org>
OpenPGP: id=B565716F; url=http://josefsson.org/key.txt
Blog: http://www.livejournal.com/users/jas4711/
X-Hashcash: 1:21:050315:martin@v.loewis.de::g9fbYied2bAw3vqe:0Nsu
X-Hashcash: 1:21:050315:idn@ops.ietf.org::NHRcOPwT7KQmLHuX:0MNQ
X-Hashcash: 1:21:050315:mark.davis@jtcsv.com::lb+dSFqyYnF1MXyX:Bsrg
X-Hashcash: 1:21:050315:erik@vanderpoel.org::01WwhjinQezDRSMz:KOrz
Date: Tue, 15 Mar 2005 22:53:43 +0100
In-Reply-To: <423754F3.50405@vanderpoel.org> (Erik van der Poel's message of
	"Tue, 15 Mar 2005 13:34:43 -0800")
Message-ID: <ilumzt47ezc.fsf@latte.josefsson.org>
User-Agent: Gnus/5.110003 (No Gnus v0.3) Emacs/22.0.50 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Virus-Scanned: ClamAV version 0.81, clamav-milter version 0.81b on yxa.extundo.com
X-Virus-Status: Clean
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Erik van der Poel <erik@vanderpoel.org> writes:

>>> More importantly, this mistake only affects highly unusual,
>>> malformed data. I think that if IDNA decides not to follow
>>> Unicode's recommendation now or in the next couple of years, 10 or
>>> 20 years from now we would look back in time and regret this
>>> decision. 
>> I don't think so. "We" could still change the decision in 20 years,
>> and
>> not a single registration would be affected. The sequences causing the
>> behaviour change are *really* unusual - I don't know if software can
>> visually render them in a meaningful way, and I guess a native speaker
>> would just consider them moji-bake. So it is unlikely that anybody would
>> try to use them as input to IDNA in the next 20 years in a reasonable
>> application.
>
> If we do not correct the specs, more and more implementations will be 
> created and deployed, some implementing it one way, the others the other 
> way. It is hard to change something when a lot of implementations have 
> been deployed. This is why we have to act now (or soon). We have to nip 
> it in the bud.

I think it may be too late to do a simple flag day and fix things.

I believe it would be useful to start thinking of the problem in terms
of a transition plan from what we have today and what we would like to
have tomorrow.  It is not clear to me exactly what we would like to
have tomorrow, so settling that would have to be part of the plan as
well.

Thanks,
Simon



From owner-idn@ops.ietf.org  Tue Mar 15 17:08:47 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id RAA25907
	for <idn-archive@lists.ietf.org>; Tue, 15 Mar 2005 17:08:46 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBK9o-000E9q-QF
	for idn-data@psg.com; Tue, 15 Mar 2005 22:04:56 +0000
Received: from [80.67.18.15] (helo=smtprelay03.ispgateway.de)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DBK9n-000E9Z-S7
	for idn@ops.ietf.org; Tue, 15 Mar 2005 22:04:56 +0000
Received: (qmail 4899 invoked from network); 15 Mar 2005 22:04:54 -0000
Received: from unknown (HELO [80.185.154.213]) (544451@[80.185.154.213])
          (envelope-sender <martin@v.loewis.de>)
          by smtprelay03.ispgateway.de (qmail-ldap-1.03) with AES256-SHA encrypted SMTP
          for <erik@vanderpoel.org>; 15 Mar 2005 22:04:54 -0000
Message-ID: <42375C05.1000204@v.loewis.de>
Date: Tue, 15 Mar 2005 23:04:53 +0100
From: =?ISO-8859-1?Q?=22Martin_v=2E_L=F6wis=22?= <martin@v.loewis.de>
User-Agent: Debian Thunderbird 1.0 (X11/20050116)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Erik van der Poel <erik@vanderpoel.org>
CC: Simon Josefsson <jas@extundo.com>, Mark Davis <mark.davis@jtcsv.com>,
        idn@ops.ietf.org
Subject: Re: [idn] Re: stability
References: <421B8484.3070802@vanderpoel.org>	<20050223072837.GA21463~@nicemice.net>	<D872CCF059514053ECF8A198@scan.jck.com>	<421D8411.9030006@vanderpoel.org>	<p06210208be4390618c81@[192.168.0.101]>	<421E0D0C.2000309@vanderpoel.org>	<p06210202be43c3888991@[192.168.0.101]>	<E07CE813AD23B2D95DA0C740@scan.jck.com>	<421E30F2.1040408@vanderpoel.org>	<0E7F74C71945B923C52211F3@scan.jck.com>	<421EA0C9.1010500@vanderpoel.org>	<00a401c51af3$7863aae0$030aa8c0@DEWELL>	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>	<4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com> <ilull8qb5n5.fsf@latte.josefsson.org> <42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de> <423754F3.50405@vanderpoel.org>
In-Reply-To: <423754F3.50405@vanderpoel.org>
X-Enigmail-Version: 0.90.0.0
X-Enigmail-Supports: pgp-inline, pgp-mime
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Erik van der Poel wrote:
> If we do not correct the specs, more and more implementations will be 
> created and deployed, some implementing it one way, the others the other 
> way. It is hard to change something when a lot of implementations have 
> been deployed. This is why we have to act now (or soon). We have to nip 
> it in the bud.

Not sure what aspect you are referring to, however, I doubt that the
majority of the implementations cares too much about what the RFC says.
So whether the RFC is changed or not in a minor aspect has little
impact on reality.

In the specific case of normalization, I think most IDNA implementations
will rely on a normalization implementation created elsewhere - few
IDNA implementations will come with their own normalization routines.
This is because normalization is difficult to implement, so you rather
reuse than reinvent. Then, when the underlying normalization routine
is changed, the IDNA implementation also changes - most likely without
the author of the IDNA implementation (let alone its user) even knowing.
In that scenario, the implementor of IDNA has little control over what
specific incarnation of normalization is used.

Regards,
Martin



From owner-idn@ops.ietf.org  Tue Mar 15 17:09:57 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id RAA25975
	for <idn-archive@lists.ietf.org>; Tue, 15 Mar 2005 17:09:57 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBKCI-000EeM-Rl
	for idn-data@psg.com; Tue, 15 Mar 2005 22:07:30 +0000
Received: from [80.67.18.14] (helo=smtprelay02.ispgateway.de)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DBKCG-000Eds-TF
	for idn@ops.ietf.org; Tue, 15 Mar 2005 22:07:29 +0000
Received: (qmail 20791 invoked from network); 15 Mar 2005 22:07:27 -0000
Received: from unknown (HELO [80.185.154.213]) (544451@[80.185.154.213])
          (envelope-sender <martin@v.loewis.de>)
          by smtprelay02.ispgateway.de (qmail-ldap-1.03) with AES256-SHA encrypted SMTP
          for <jas@extundo.com>; 15 Mar 2005 22:07:27 -0000
Message-ID: <42375C9E.8040001@v.loewis.de>
Date: Tue, 15 Mar 2005 23:07:26 +0100
From: =?ISO-8859-1?Q?=22Martin_v=2E_L=F6wis=22?= <martin@v.loewis.de>
User-Agent: Debian Thunderbird 1.0 (X11/20050116)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Simon Josefsson <jas@extundo.com>
CC: Erik van der Poel <erik@vanderpoel.org>, Mark Davis <mark.davis@jtcsv.com>,
        idn@ops.ietf.org
Subject: [idn] Re: stability
References: <421B8484.3070802@vanderpoel.org>	<D872CCF059514053ECF8A198@scan.jck.com>	<421D8411.9030006@vanderpoel.org>	<p06210208be4390618c81@[192.168.0.101]>	<421E0D0C.2000309@vanderpoel.org>	<p06210202be43c3888991@[192.168.0.101]>	<E07CE813AD23B2D95DA0C740@scan.jck.com>	<421E30F2.1040408@vanderpoel.org>	<0E7F74C71945B923C52211F3@scan.jck.com>	<421EA0C9.1010500@vanderpoel.org>	<00a401c51af3$7863aae0$030aa8c0@DEWELL>	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>	<4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>	<ilull8qb5n5.fsf@latte.josefsson.org>	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>
In-Reply-To: <ilumzt47ezc.fsf@latte.josefsson.org>
X-Enigmail-Version: 0.90.0.0
X-Enigmail-Supports: pgp-inline, pgp-mime
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Simon Josefsson wrote:
> I believe it would be useful to start thinking of the problem in terms
> of a transition plan from what we have today and what we would like to
> have tomorrow.  It is not clear to me exactly what we would like to
> have tomorrow, so settling that would have to be part of the plan as
> well.

Indeed. For IDNA, I think the current specification serves fine for
today and tomorrow, so nothing needs to change at all.

What is much more relevant is how further constraints in the registry
(beyond those imposed by IDNA) get implemented. Only when that is
sufficiently settled and deployed, considering *updates* to IDNA
should start.

Regards,
Martin



From owner-idn@ops.ietf.org  Tue Mar 15 19:59:39 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id TAA10398
	for <idn-archive@lists.ietf.org>; Tue, 15 Mar 2005 19:59:39 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBMlE-0003OM-GR
	for idn-data@psg.com; Wed, 16 Mar 2005 00:51:44 +0000
Received: from [207.115.63.98] (helo=pimout4-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DBMl5-0003Nc-Si
	for idn@ops.ietf.org; Wed, 16 Mar 2005 00:51:40 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout4-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2G0ov5K154456;
	Tue, 15 Mar 2005 19:51:03 -0500
Message-ID: <423782F0.60604@vanderpoel.org>
Date: Tue, 15 Mar 2005 16:50:56 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Simon Josefsson <jas@extundo.com>
CC: Mark Davis <mark.davis@jtcsv.com>, idn@ops.ietf.org,
        =?ISO-8859-1?Q?=22Martin_v=2E_L=F6wis=22?= <martin@v.loewis.de>
Subject: Re: [idn] stability
References: <421B8484.3070802@vanderpoel.org>	<D872CCF059514053ECF8A198@scan.jck.com>	<421D8411.9030006@vanderpoel.org>	<p06210208be4390618c81@[192.168.0.101]>	<421E0D0C.2000309@vanderpoel.org>	<p06210202be43c3888991@[192.168.0.101]>	<E07CE813AD23B2D95DA0C740@scan.jck.com>	<421E30F2.1040408@vanderpoel.org>	<0E7F74C71945B923C52211F3@scan.jck.com>	<421EA0C9.1010500@vanderpoel.org>	<00a401c51af3$7863aae0$030aa8c0@DEWELL>	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>	<4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>	<ilull8qb5n5.fsf@latte.josefsson.org>	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>
In-Reply-To: <ilumzt47ezc.fsf@latte.josefsson.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

> I think it may be too late to do a simple flag day and fix things.

Why? Do you believe that there may already be domain labels involving 
the relevant types of strange character sequences?

If we don't fix the specs and the implementations, then we may end up 
with interoperability problems in the future if some strange sequences 
start to appear or new characters are added to Unicode. PRI #29 already 
indicates that VeriSign's implementation does not need a change, while 
idnkit does. I believe Mozilla uses idnkit.

http://www.unicode.org/review/pr-29.html

> I believe it would be useful to start thinking of the problem in terms
> of a transition plan from what we have today and what we would like to
> have tomorrow.  It is not clear to me exactly what we would like to
> have tomorrow, so settling that would have to be part of the plan as
> well.

There may be other things to change in the IDNA RFCs, but as far as this 
normalization problem is concerned, it is pretty clear to me that we 
need to get the RFCs to point to a newer version of UAX #15, i.e. 
tracking number 24 or higher.

http://www.unicode.org/reports/tr15/tr15-24.html

Note that this spec does not require an implementation to update the 
normalization table itself to a newer version. If we believe there are 
good reasons for IDNA to keep the old table entries that changed in 
newer versions of Unicode, then we may be able to do so. Is that right, 
Mark? I.e. could IDNA upgrade to Unicode 4.1.0 while keeping the 
individual mappings indicated below at the older Unicode version?

http://www.unicode.org/Public/UNIDATA/NormalizationCorrections.txt

(Whether we would want to do this is a separate question.)

Erik



From owner-idn@ops.ietf.org  Tue Mar 15 20:25:26 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id UAA12145
	for <idn-archive@lists.ietf.org>; Tue, 15 Mar 2005 20:25:26 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBNCz-00072A-0U
	for idn-data@psg.com; Wed, 16 Mar 2005 01:20:25 +0000
Received: from [207.115.63.102] (helo=pimout3-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DBNCs-00071X-76
	for idn@ops.ietf.org; Wed, 16 Mar 2005 01:20:23 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout3-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2G1Jc9N249342;
	Tue, 15 Mar 2005 20:19:42 -0500
Message-ID: <423789AA.9010203@vanderpoel.org>
Date: Tue, 15 Mar 2005 17:19:38 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: =?ISO-8859-1?Q?=22Martin_v=2E_L=F6wis=22?= <martin@v.loewis.de>
CC: Simon Josefsson <jas@extundo.com>, Mark Davis <mark.davis@jtcsv.com>,
        idn@ops.ietf.org
Subject: Re: [idn] Re: stability
References: <421B8484.3070802@vanderpoel.org>	<20050223072837.GA21463~@nicemice.net>	<D872CCF059514053ECF8A198@scan.jck.com>	<421D8411.9030006@vanderpoel.org>	<p06210208be4390618c81@[192.168.0.101]>	<421E0D0C.2000309@vanderpoel.org>	<p06210202be43c3888991@[192.168.0.101]>	<E07CE813AD23B2D95DA0C740@scan.jck.com>	<421E30F2.1040408@vanderpoel.org>	<0E7F74C71945B923C52211F3@scan.jck.com>	<421EA0C9.1010500@vanderpoel.org>	<00a401c51af3$7863aae0$030aa8c0@DEWELL>	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>	<4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com> <ilull8qb5n5.fsf@latte.josefsson.org> <42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de> <423754F3.50405@vanderpoel.org> <42375C05.1000204@v.loewis.de>
In-Reply-To: <42375C05.1000204@v.loewis.de>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 8bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 8bit

Martin v. Löwis wrote:
> Erik van der Poel wrote:
>> If we do not correct the specs, more and more implementations will be 
>> created and deployed, some implementing it one way, the others the 
>> other way. It is hard to change something when a lot of 
>> implementations have been deployed. This is why we have to act now (or 
>> soon). We have to nip it in the bud.
> 
> Not sure what aspect you are referring to,

I was referring to the RFC that has a pointer to UAX #15, i.e. RFC 3454 
(Stringprep). The pointer should be updated to tracking number 24 or 
higher. Since this issue is hard to understand, it might also be a good 
idea to add an explanation in the new versions of Stringprep and the 
IDNA family.

http://www.unicode.org/reports/tr15/tr15-24.html

> however, I doubt that the
> majority of the implementations cares too much about what the RFC says.
> So whether the RFC is changed or not in a minor aspect has little
> impact on reality.

There may be some organizations that ignore some or all of the changes 
we make to the RFCs, but others are paying attention, and I'm pretty 
sure they will follow at least some parts of the new RFCs. Mozilla and 
Opera have already indicated that they believe the punctuation mark and 
symbol problem is a big problem, and that they would/will address this 
problem whether or not the RFCs do.

> In the specific case of normalization, I think most IDNA implementations
> will rely on a normalization implementation created elsewhere - few
> IDNA implementations will come with their own normalization routines.
> This is because normalization is difficult to implement, so you rather
> reuse than reinvent. Then, when the underlying normalization routine
> is changed, the IDNA implementation also changes - most likely without
> the author of the IDNA implementation (let alone its user) even knowing.
> In that scenario, the implementor of IDNA has little control over what
> specific incarnation of normalization is used.

This specific issue is already mentioned in RFC 3490 (IDNA) in the 
Security Considerations section. Of course, it is up to the implementors 
whether they will adhere to the letter of the specs, but the IETF tries 
to achieve a "rough consensus" among the parties discussing the matter, 
and the authors try to write clear specs that foster interoperability.

Erik



From owner-idn@ops.ietf.org  Tue Mar 15 21:04:34 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id VAA15341
	for <idn-archive@lists.ietf.org>; Tue, 15 Mar 2005 21:04:34 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBNjF-0001vg-54
	for idn-data@psg.com; Wed, 16 Mar 2005 01:53:45 +0000
Received: from [207.115.63.101] (helo=pimout2-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DBNj9-0001uw-Ld
	for idn@ops.ietf.org; Wed, 16 Mar 2005 01:53:44 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout2-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2G1r1MW405646;
	Tue, 15 Mar 2005 20:53:05 -0500
Message-ID: <4237917D.9080507@vanderpoel.org>
Date: Tue, 15 Mar 2005 17:53:01 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: =?ISO-8859-1?Q?=22Martin_v=2E_L=F6wis=22?= <martin@v.loewis.de>
CC: Simon Josefsson <jas@extundo.com>, Mark Davis <mark.davis@jtcsv.com>,
        idn@ops.ietf.org
Subject: Re: [idn] Re: stability
References: <421B8484.3070802@vanderpoel.org>	<D872CCF059514053ECF8A198@scan.jck.com>	<421D8411.9030006@vanderpoel.org>	<p06210208be4390618c81@[192.168.0.101]>	<421E0D0C.2000309@vanderpoel.org>	<p06210202be43c3888991@[192.168.0.101]>	<E07CE813AD23B2D95DA0C740@scan.jck.com>	<421E30F2.1040408@vanderpoel.org>	<0E7F74C71945B923C52211F3@scan.jck.com>	<421EA0C9.1010500@vanderpoel.org>	<00a401c51af3$7863aae0$030aa8c0@DEWELL>	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>	<4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>	<ilull8qb5n5.fsf@latte.josefsson.org>	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org> <42375C9E.8040001@v.loewis.de>
In-Reply-To: <42375C9E.8040001@v.loewis.de>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 8bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 8bit

Martin v. Löwis wrote:
> What is much more relevant is how further constraints in the registry
> (beyond those imposed by IDNA) get implemented. Only when that is
> sufficiently settled and deployed, considering *updates* to IDNA
> should start.

I disagree. The IETF should not wait for any of the registries to do 
anything before publishing new drafts or RFCs. The registries are not 
the only other players here. We have application developers and zone 
administrators depending on our work too.

Erik



From owner-idn@ops.ietf.org  Tue Mar 15 22:54:42 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id WAA22229
	for <idn-archive@lists.ietf.org>; Tue, 15 Mar 2005 22:54:41 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBPTc-000EcK-N3
	for idn-data@psg.com; Wed, 16 Mar 2005 03:45:44 +0000
Received: from [207.171.180.183] (helo=smtp-out-0102.amazon.com)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DBPTb-000Ec7-PE
	for idn@ops.ietf.org; Wed, 16 Mar 2005 03:45:43 +0000
X-Amazon-Corporate-Relay: smtp-out-0102.sea3.amazon.com
X-AMAZON-TRACK: idn@ops.ietf.org
Received: from smtp-in-1001.vdc.amazon.com by smtp-out-0102.amazon.com with ESMTP 
          (peer crosscheck: smtp-in-1001.vdc.amazon.com)
Received: from ex-mail-sea-03.ant.amazon.com (ex-mail-sea-03.ant.amazon.com [10.16.189.52])
	by smtp-in-1001.vdc.amazon.com (8.12.10/8.12.10) with ESMTP id j2G3iqYZ025041;
	Wed, 16 Mar 2005 03:45:28 GMT
Received: from mail pickup service by ex-mail-sea-03.ant.amazon.com with Microsoft SMTPSVC;
	 Tue, 15 Mar 2005 19:45:31 -0800
Received: from smtp-in-0102.sea3.amazon.com ([172.20.19.39]) by ex-mail-sea-03.ant.amazon.com with Microsoft SMTPSVC(6.0.3790.211);
	 Tue, 15 Mar 2005 13:42:04 -0800
Received: from mail-border-1006.vdc.amazon.com (mail-border-1006.vdc.amazon.com [10.133.8.58])
	by smtp-in-0102.sea3.amazon.com (8.12.10/8.12.10) with ESMTP id j2FLfdTf005559
	for <rebeccaw@mail-relay.amazon.com>; Tue, 15 Mar 2005 21:41:40 GMT
X-Amazon-Approved-Domain: no
X-Amazon-External-Source: yes
X-Amazon-External-Envelope-Sender: owner-idn@ops.ietf.org
Received: from iad2-svc-fw-2102.iad2.amazon.com (iad2-svc-fw-2102.iad2.amazon.com [10.5.48.13])
	by mail-border-1006.vdc.amazon.com (8.12.10/8.12.10) with ESMTP id j2FLfbbg004243
	for <rebeccaw@amazon.com>; Tue, 15 Mar 2005 21:41:38 GMT
Received: from psg.com ([147.28.0.62]) by iad2-svc-fw-2102.iad2.amazon.com
          via smtpd (for mail-border-1006.vdc.amazon.com [10.133.8.58]) with ESMTP; Tue, 15 Mar 2005 16:52:23 -0500
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBJhA-000A3q-1L
	for idn-data@psg.com; Tue, 15 Mar 2005 21:35:20 +0000
Received: from [207.115.63.102] (helo=pimout3-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DBJh3-000A3U-Og
	for idn@ops.ietf.org; Tue, 15 Mar 2005 21:35:18 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout3-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2FLYh9N268304;
	Tue, 15 Mar 2005 16:34:48 -0500
Message-ID: <423754F3.50405@vanderpoel.org>
Date: Tue, 15 Mar 2005 13:34:43 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: =?ISO-8859-1?Q?=22Martin_v=2E_L=F6wis=22?= <martin@v.loewis.de>
CC: Simon Josefsson <jas@extundo.com>, Mark Davis <mark.davis@jtcsv.com>,
        idn@ops.ietf.org
Subject: Re: [idn] Re: stability
References: <421B8484.3070802@vanderpoel.org>	<20050223072837.GA21463~@nicemice.net>	<D872CCF059514053ECF8A198@scan.jck.com>	<421D8411.9030006@vanderpoel.org>	<p06210208be4390618c81@[192.168.0.101]>	<421E0D0C.2000309@vanderpoel.org>	<p06210202be43c3888991@[192.168.0.101]>	<E07CE813AD23B2D95DA0C740@scan.jck.com>	<421E30F2.1040408@vanderpoel.org>	<0E7F74C71945B923C52211F3@scan.jck.com>	<421EA0C9.1010500@vanderpoel.org>	<00a401c51af3$7863aae0$030aa8c0@DEWELL>	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>	<4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com> <ilull8qb5n5.fsf@latte.josefsson.org> <42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>
In-Reply-To: <4237450A.9010901@v.loewis.de>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 8bit
X-PMX-Version: 4.7.0.111621, Antispam-Engine: 2.0.3.0, Antispam-Data: 2005.3.15.13
x-amazon-envelope-from: owner-idn@ops.ietf.org
x-amazon-envelope-to: rebeccaw@amazon.com
X-AMAZON-GAUGE: IIIIIII
X-OriginalArrivalTime: 15 Mar 2005 21:42:07.0012 (UTC) FILETIME=[D59E3640:01C529A7]
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 8bit

Martin v. Löwis wrote:
> Erik van der Poel wrote:
>> I feel that we are still at the very beginning of the adoption of the 
>> particular Unicodes affected by this mistake. Most of them are for 
>> South Asian languages. Hangul is much further along, but not the 
>> particular Unicodes that are affected here (i.e. the Jamo).
> 
> It's not that easy. When you use the old algorithm, you get normal
> Hangul syllables, which would be allowed in IDNA. It's only that the
> sequence *before* the normalization should not be allowed.

No, these strange sequences should not be disallowed. The specs should 
be corrected so that the implementations can all treat these strange 
sequences the same way.

>> More importantly, this mistake only affects highly unusual, malformed 
>> data. I think that if IDNA decides not to follow Unicode's 
>> recommendation now or in the next couple of years, 10 or 20 years from 
>> now we would look back in time and regret this decision. 
> 
> I don't think so. "We" could still change the decision in 20 years, and
> not a single registration would be affected. The sequences causing the
> behaviour change are *really* unusual - I don't know if software can
> visually render them in a meaningful way, and I guess a native speaker
> would just consider them moji-bake. So it is unlikely that anybody would
> try to use them as input to IDNA in the next 20 years in a reasonable
> application.

If we do not correct the specs, more and more implementations will be 
created and deployed, some implementing it one way, the others the other 
way. It is hard to change something when a lot of implementations have 
been deployed. This is why we have to act now (or soon). We have to nip 
it in the bud.

Erik




From owner-idn@ops.ietf.org  Wed Mar 16 04:20:34 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id EAA23054
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 04:20:34 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBUZ2-0009EM-Cy
	for idn-data@psg.com; Wed, 16 Mar 2005 09:11:40 +0000
Received: from [64.36.79.201] (helo=nicemice.net)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DBUYv-0009Dd-Ah
	for idn@ops.ietf.org; Wed, 16 Mar 2005 09:11:33 +0000
Received: from amc by nicemice.net with local (Exim 4.44)
	id 1DBUYp-0006Kq-5f
	for idn@ops.ietf.org; Wed, 16 Mar 2005 01:11:27 -0800
Date: Wed, 16 Mar 2005 09:11:27 +0000
From: "Adam M. Costello" <idn.amc+0@nicemice.net.RemoveThisWord.cnri.reston.va.us>
To: idn@ops.ietf.org
Subject: Re: [idn] Re: stability
Message-ID: <20050316091126.GA24254~@nicemice.net>
Reply-To: IETF idn working group <idn@ops.ietf.org>
References: <42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org> <iluk6odazwb.fsf@latte.josefsson.org> <00e801c528a8$99ad37d0$72703009@sanjose.ibm.com> <ilull8qb5n5.fsf@latte.josefsson.org> <42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de> <423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <423789AA.9010203@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>
User-Agent: Mutt/1.5.6+20040907i
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Erik van der Poel <erik@vanderpoel.org> wrote:

> I was referring to the RFC that has a pointer to UAX #15, i.e. RFC
> 3454 (Stringprep).  The pointer should be updated to tracking number
> 24 or higher.
>
> http://www.unicode.org/reports/tr15/tr15-24.html

I agree.  Right now there does not exist a correct implementation of
Unicode normalization anywhere.  Some implementations are wrong because
they deviate from the spec, and other implementations are wrong because
they adhere to the spec which itself is wrong (because it violates all
the fundamental properties that anything called a canonical form is
assumed to have).  It's an unfortunate situation, but the best thing to
do now is fix the spec and encourage all implementations to converge on
the fixed spec, which is what the Unicode Consortium is doing.  Our part
in this is to update our pointer, so that it points at a correct spec
rather than a wrong spec.

Simon Josefsson <jas@extundo.com> wrote:

> I believe it would be useful to start thinking of the problem in terms
> of a transition plan from what we have today and what we would like to
> have tomorrow.  It is not clear to me exactly what we would like to
> have tomorrow, so settling that would have to be part of the plan as
> well.

It's clear to me what we ought to have tomorrow: a canonical form
(that is, a function that selects a unique representative from every
equivalence class).  The Unicode Consortium is taking care of defining
that.

Do you have any ideas for a transition to that?

AMC



From owner-idn@ops.ietf.org  Wed Mar 16 04:44:39 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id EAA26765
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 04:44:39 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBUzD-000DPC-9N
	for idn-data@psg.com; Wed, 16 Mar 2005 09:38:43 +0000
Received: from [217.13.230.178] (helo=yxa.extundo.com)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DBUz9-000DO9-I0
	for idn@ops.ietf.org; Wed, 16 Mar 2005 09:38:39 +0000
Received: from latte.josefsson.org (c494102a.s-bi.bostream.se [217.215.27.65])
	(authenticated bits=0)
	by yxa.extundo.com (8.13.3/8.13.3/Debian-6) with ESMTP id j2G9cQuD012260
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Wed, 16 Mar 2005 10:38:27 +0100
From: Simon Josefsson <jas@extundo.com>
To: Erik van der Poel <erik@vanderpoel.org>
Cc: Mark Davis <mark.davis@jtcsv.com>, idn@ops.ietf.org,
        =?iso-8859-1?Q?Martin_v=2E_L=F6wis?= <martin@v.loewis.de>
Subject: [idn] Re: stability
References: <421B8484.3070802@vanderpoel.org>
	<p06210208be4390618c81@[192.168.0.101]>
	<421E0D0C.2000309@vanderpoel.org>
	<p06210202be43c3888991@[192.168.0.101]>
	<E07CE813AD23B2D95DA0C740@scan.jck.com>
	<421E30F2.1040408@vanderpoel.org>
	<0E7F74C71945B923C52211F3@scan.jck.com>
	<421EA0C9.1010500@vanderpoel.org>
	<00a401c51af3$7863aae0$030aa8c0@DEWELL>
	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>
	<4232BA56.5090001@vanderpoel.org>
	<iluk6odazwb.fsf@latte.josefsson.org>
	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>
	<ilull8qb5n5.fsf@latte.josefsson.org>
	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>
	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>
	<423782F0.60604@vanderpoel.org>
OpenPGP: id=B565716F; url=http://josefsson.org/key.txt
Blog: http://www.livejournal.com/users/jas4711/
X-Hashcash: 1:21:050316:idn@ops.ietf.org::14bTs80xYZ5b2w79:02qO
X-Hashcash: 1:21:050316:erik@vanderpoel.org::1nIs4MtuKENPXf/9:1ja5
X-Hashcash: 1:21:050316:mark.davis@jtcsv.com::b8CXp4biopxGYKjT:THmu
X-Hashcash: 1:21:050316:martin@v.loewis.de::l7crShAZG5nRt9H5:S63c
Date: Wed, 16 Mar 2005 10:38:07 +0100
In-Reply-To: <423782F0.60604@vanderpoel.org> (Erik van der Poel's message of
	"Tue, 15 Mar 2005 16:50:56 -0800")
Message-ID: <ilu7jk86idc.fsf@latte.josefsson.org>
User-Agent: Gnus/5.110003 (No Gnus v0.3) Emacs/22.0.50 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Virus-Scanned: ClamAV version 0.81, clamav-milter version 0.81b on yxa.extundo.com
X-Virus-Status: Clean
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Erik van der Poel <erik@vanderpoel.org> writes:

>> I think it may be too late to do a simple flag day and fix things.
>
> Why? Do you believe that there may already be domain labels involving 
> the relevant types of strange character sequences?

No, but I also don't think that should be the metric.  I believe the
RFCs are clear that Unicode 3.2, without the NFKC fix, is what is to
be used today...

> If we don't fix the specs and the implementations, then we may end up 
> with interoperability problems in the future if some strange sequences 
> start to appear or new characters are added to Unicode. PRI #29 already 
> indicates that VeriSign's implementation does not need a change, while 
> idnkit does. I believe Mozilla uses idnkit.
>
> http://www.unicode.org/review/pr-29.html

...so you can't just "fix" the implementations.  If you do, they are
not complying with the RFC's.  If VeriSign implement PR-29, I believe
it doesn't conform to the RFC's.

I think the "needs change" statements on the PR29 page are misleading,
and based on UTC's subjective position on the matter.

See the second mail in the following section for my response:

http://www.gnu.org/software/libidn/manual/libidn.html#PR29-discussion

The issue should be handled in an update of the StringPrep.  If the
PR-29 fix is incorporated, there must a good transition discussion in
the document.  The problem cannot only be discussed in the realm of
IDNA, since StringPrep is used for other purposes as well.  For me,
the most important use is SASLprep, because it is used to prepare
username and passwords.  Hence, it is used in security critical
application, where the requirements are different than from IDNA.  The
discussion must be wider than for only IDNA.

Thanks,
Simon



From owner-idn@ops.ietf.org  Wed Mar 16 05:10:56 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id FAA28524
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 05:10:55 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBVNo-000HVL-Ry
	for idn-data@psg.com; Wed, 16 Mar 2005 10:04:08 +0000
Received: from [217.13.230.178] (helo=yxa.extundo.com)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DBVNm-000HU0-4B
	for idn@ops.ietf.org; Wed, 16 Mar 2005 10:04:06 +0000
Received: from latte.josefsson.org (c494102a.s-bi.bostream.se [217.215.27.65])
	(authenticated bits=0)
	by yxa.extundo.com (8.13.3/8.13.3/Debian-6) with ESMTP id j2GA3vH1014100
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK)
	for <idn@ops.ietf.org>; Wed, 16 Mar 2005 11:03:59 +0100
From: Simon Josefsson <jas@extundo.com>
To: IETF idn working group <idn@ops.ietf.org>
Subject: [idn] Re: stability
References: <42322CE2.4040509@vanderpoel.org>
	<4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org>
	<iluk6odazwb.fsf@latte.josefsson.org>
	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>
	<ilull8qb5n5.fsf@latte.josefsson.org>
	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>
	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>
	<20050316091126.GA24254~@nicemice.net>
OpenPGP: id=B565716F; url=http://josefsson.org/key.txt
Blog: http://www.livejournal.com/users/jas4711/
X-Hashcash: 1:21:050316:idn@ops.ietf.org::lixvnT3fwS5UsJe7:R9GR
Date: Wed, 16 Mar 2005 11:03:38 +0100
In-Reply-To: <20050316091126.GA24254~@nicemice.net> (Adam M. Costello's
	message of "Wed, 16 Mar 2005 09:11:27 +0000")
Message-ID: <iluzmx36h6t.fsf@latte.josefsson.org>
User-Agent: Gnus/5.110003 (No Gnus v0.3) Emacs/22.0.50 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Virus-Scanned: ClamAV version 0.81, clamav-milter version 0.81b on yxa.extundo.com
X-Virus-Status: Clean
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.5 required=5.0 tests=AWL,BAYES_00,
	MAILTO_TO_REMOVE autolearn=ham version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

"Adam M. Costello" <idn.amc+0@nicemice.net.RemoveThisWord> writes:

> Erik van der Poel <erik@vanderpoel.org> wrote:
>
>> I was referring to the RFC that has a pointer to UAX #15, i.e. RFC
>> 3454 (Stringprep).  The pointer should be updated to tracking number
>> 24 or higher.
>>
>> http://www.unicode.org/reports/tr15/tr15-24.html
>
> I agree.  Right now there does not exist a correct implementation of
> Unicode normalization anywhere.  Some implementations are wrong because
> they deviate from the spec, and other implementations are wrong because
> they adhere to the spec which itself is wrong (because it violates all
> the fundamental properties that anything called a canonical form is
> assumed to have).  It's an unfortunate situation, but the best thing to
> do now is fix the spec and encourage all implementations to converge on
> the fixed spec, which is what the Unicode Consortium is doing.  Our part
> in this is to update our pointer, so that it points at a correct spec
> rather than a wrong spec.

I'm less certain that is the best thing.  I'd like to see alternatives
explored before making such confident statement.

There appears to me be a lot of decisions made out of subjective
opinions on how normalization "should" behave, or is "assumed" to
behave.  I'd like to see things focused on what the changes actually
will mean, technically, in practice.  Or perhaps I'm simply not
clued-in on the evaluations of different approaches.

>> I believe it would be useful to start thinking of the problem in terms
>> of a transition plan from what we have today and what we would like to
>> have tomorrow.  It is not clear to me exactly what we would like to
>> have tomorrow, so settling that would have to be part of the plan as
>> well.
>
> It's clear to me what we ought to have tomorrow: a canonical form
> (that is, a function that selects a unique representative from every
> equivalence class).  The Unicode Consortium is taking care of defining
> that.
>
> Do you have any ideas for a transition to that?

I think reaching that goal can be done in different ways.

One way is to incorporate the PR-29 fix, declare the earlier attempt
as buggy, and re-cycle at PROPOSED.  I suspect you prefer that way?  I
am hesitant about that approach, because we have already deployed the
old RFC and it is not clear what problems there will be in mixing the
old and the new code.  Both Kerberos and SASL appears to be going to
use the old StringPrep as well, so we will be seeing security critical
infrastructure based on the old interpretation.

Another way is to carry on with the Unicode 3.2 NFKC even though it
breaks some human's assumptions on what "normalization" means in a
theoretic setting.  Only a select few weird cases (the PR-29 problem
sequences) will be affected.  Machines will cope, they compute an
algorithm, they don't care if the output meet some unstated invariant
or not.

A third way, which is what I am deploying, is to use the Unicode 3.2
NFKC together with a filter to reject the PR-29 problem sequences.
This is in line with the RFC's, it solves problems related to PR-29
problem sequences, and is simple to implement.

Thanks,
Simon



From owner-idn@ops.ietf.org  Wed Mar 16 07:34:36 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id HAA13041
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 07:34:36 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBXeH-000BgL-Bo
	for idn-data@psg.com; Wed, 16 Mar 2005 12:29:17 +0000
Received: from [63.247.76.195] (helo=montage.altserver.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DBXeG-000Bg6-2x
	for idn@ops.ietf.org; Wed, 16 Mar 2005 12:29:16 +0000
Received: from lns-p19-19-idf-82-254-246-100.adsl.proxad.net ([82.254.246.100] helo=jfc.afrac.org)
	by montage.altserver.com with esmtpa (Exim 4.44)
	id 1DBXeE-0007HA-FF; Wed, 16 Mar 2005 04:29:14 -0800
Message-Id: <6.1.2.0.2.20050316131141.03590c50@mail.jefsey.com>
X-Sender: jefsey+jefsey.com@mail.jefsey.com
X-Mailer: QUALCOMM Windows Eudora Version 6.1.2.0
Date: Wed, 16 Mar 2005 13:28:22 +0100
To: Simon Josefsson <jas@extundo.com>
From: "JFC (Jefsey) Morfin" <jefsey@jefsey.com>
Subject: Re: [idn] Re: stability
Cc: idn@ops.ietf.org
In-Reply-To: <ilumzt47ezc.fsf@latte.josefsson.org>
References: <421B8484.3070802@vanderpoel.org>
 <D872CCF059514053ECF8A198@scan.jck.com>
 <421D8411.9030006@vanderpoel.org>
 <p06210208be4390618c81@[192.168.0.101]>
 <421E0D0C.2000309@vanderpoel.org>
 <p06210202be43c3888991@[192.168.0.101]>
 <E07CE813AD23B2D95DA0C740@scan.jck.com>
 <421E30F2.1040408@vanderpoel.org>
 <0E7F74C71945B923C52211F3@scan.jck.com>
 <421EA0C9.1010500@vanderpoel.org>
 <00a401c51af3$7863aae0$030aa8c0@DEWELL>
 <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
 <42322CE2.4040509@vanderpoel.org>
 <4232B2FD.1080104@vanderpoel.org>
 <4232BA56.5090001@vanderpoel.org>
 <iluk6odazwb.fsf@latte.josefsson.org>
 <00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>
 <ilull8qb5n5.fsf@latte.josefsson.org>
 <42367B63.6080300@vanderpoel.org>
 <4237450A.9010901@v.loewis.de>
 <423754F3.50405@vanderpoel.org>
 <ilumzt47ezc.fsf@latte.josefsson.org>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"; format=flowed
X-AntiAbuse: This header was added to track abuse, please include it with any abuse report
X-AntiAbuse: Primary Hostname - montage.altserver.com
X-AntiAbuse: Original Domain - ops.ietf.org
X-AntiAbuse: Originator/Caller UID/GID - [0 0] / [47 12]
X-AntiAbuse: Sender Address Domain - jefsey.com
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

On 22:53 15/03/2005, Simon Josefsson said:
>I believe it would be useful to start thinking of the problem in terms
>of a transition plan from what we have today and what we would like to
>have tomorrow.  It is not clear to me exactly what we would like to
>have tomorrow, so settling that would have to be part of the plan as
>well.

That part seems quite easy to address. We want to be PAD compatible, so the 
users have a single system. This means that we may have three systems:

Unicode to IP   tables
Unicode to DN tables
Unicode to lingual SLD to display as a lingual TLD tables

using NameScript tables listing the Unicode codes permitted throught out 
the FQMLDN to prevent homograph problems. Every label being an ACE label in 
an MLDN, ASCII in an ascii label.

The general construct being labels.table-indicator.tld. The table indicator 
being by default the table indicator of the TLD. This way existing ascii 
TLDs are label.ascii-indicator.tld (the ascii indicator is not necessary). 
The same for a Chinese TLD, chinese.chinese-indicator.tld: the chinese 
indicator is not necessary. Every label part of a MLDN is subject to a 
punycode translation and a nameprep removing the codes not compatible with 
its indicator.

This fully permits atypical domain names to be registered in using a 
no-filtered indicator, easy to underline in an application display.

This also permits table-indicator.TLD to be converted in the proper MLTLD 
display or from the MLTLD entry.

This is obvsiously fully compatible with the DNS and ask no complex special 
program, procedures, contract by Registries.  No need for lingual users to 
switch to Handles. It can even support phonetic, menu server, icon based 
vernacular names. This is also what is already in use.

This is what the initial demand was for.
jfc





From owner-idn@ops.ietf.org  Wed Mar 16 07:35:04 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id HAA13163
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 07:35:04 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBXeK-000Bge-Te
	for idn-data@psg.com; Wed, 16 Mar 2005 12:29:20 +0000
Received: from [63.247.76.195] (helo=montage.altserver.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DBXeJ-000BgR-TY
	for idn@ops.ietf.org; Wed, 16 Mar 2005 12:29:20 +0000
Received: from lns-p19-19-idf-82-254-246-100.adsl.proxad.net ([82.254.246.100] helo=jfc.afrac.org)
	by montage.altserver.com with esmtpa (Exim 4.44)
	id 1DBXeD-0007HA-73; Wed, 16 Mar 2005 04:29:13 -0800
Message-Id: <6.1.2.0.2.20050316125429.04464370@mail.jefsey.com>
X-Sender: jefsey+jefsey.com@mail.jefsey.com
X-Mailer: QUALCOMM Windows Eudora Version 6.1.2.0
Date: Wed, 16 Mar 2005 13:04:49 +0100
To: Erik van der Poel <erik@vanderpoel.org>,
        "Martin v. Löwis" <martin@v.loewis.de>
From: "JFC (Jefsey) Morfin" <jefsey@jefsey.com>
Subject: Re: [idn] Re: stability
Cc: Simon Josefsson <jas@extundo.com>, Mark Davis <mark.davis@jtcsv.com>,
        idn@ops.ietf.org
In-Reply-To: <4237917D.9080507@vanderpoel.org>
References: <421B8484.3070802@vanderpoel.org>
 <D872CCF059514053ECF8A198@scan.jck.com>
 <421D8411.9030006@vanderpoel.org>
 <p06210208be4390618c81@[192.168.0.101]>
 <421E0D0C.2000309@vanderpoel.org>
 <p06210202be43c3888991@[192.168.0.101]>
 <E07CE813AD23B2D95DA0C740@scan.jck.com>
 <421E30F2.1040408@vanderpoel.org>
 <0E7F74C71945B923C52211F3@scan.jck.com>
 <421EA0C9.1010500@vanderpoel.org>
 <00a401c51af3$7863aae0$030aa8c0@DEWELL>
 <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
 <42322CE2.4040509@vanderpoel.org>
 <4232B2FD.1080104@vanderpoel.org>
 <4232BA56.5090001@vanderpoel.org>
 <iluk6odazwb.fsf@latte.josefsson.org>
 <00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>
 <ilull8qb5n5.fsf@latte.josefsson.org>
 <42367B63.6080300@vanderpoel.org>
 <4237450A.9010901@v.loewis.de>
 <423754F3.50405@vanderpoel.org>
 <ilumzt47ezc.fsf@latte.josefsson.org>
 <42375C9E.8040001@v.loewis.de>
 <4237917D.9080507@vanderpoel.org>
Mime-Version: 1.0
Content-Type: text/plain; charset="iso-8859-1"; format=flowed
Content-Transfer-Encoding: 8bit
X-AntiAbuse: This header was added to track abuse, please include it with any abuse report
X-AntiAbuse: Primary Hostname - montage.altserver.com
X-AntiAbuse: Original Domain - ops.ietf.org
X-AntiAbuse: Originator/Caller UID/GID - [0 0] / [47 12]
X-AntiAbuse: Sender Address Domain - jefsey.com
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 8bit

At 02:53 16/03/2005, Erik van der Poel wrote:
>Martin v. Löwis wrote:
>>What is much more relevant is how further constraints in the registry
>>(beyond those imposed by IDNA) get implemented. Only when that is
>>sufficiently settled and deployed, considering *updates* to IDNA
>>should start.
>
>I disagree. The IETF should not wait for any of the registries to do 
>anything before publishing new drafts or RFCs. The registries are not the 
>only other players here. We have application developers and zone 
>administrators depending on our work too.

Fully true. But we are in a real world. If you propose anything again 
without the support of the Registries you will have a lack of 
understanding, adherence and support. Also what you will propose will be 
less reviewed from different point of view and will have more risks to have 
its own flaws. You will not be able to tell the Registries they shared in 
the mistake they have to share in the fix. A second blunder and the 
multilingual internet will disinterest itself from the IETF and work out 
its own solutions - I think we all know. Which means a split between ASCII 
Internet and Multilingual Internet. What we all want to avoid, I hope.

The first step is to permit the Registries to operate in this still debated 
environement. I have asked responses about that and got no answer. I can 
only infer from your position and of this lack of concern, that this debate 
is purely theoretical. IETF does not rule but advises.

What are the objections (and BTW were to find described the consquences for 
a Registry) to Adam and Simon positions?
jfc







From owner-idn@ops.ietf.org  Wed Mar 16 12:23:14 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id MAA12511
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 12:23:13 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBc8P-0002Es-Rg
	for idn-data@psg.com; Wed, 16 Mar 2005 17:16:41 +0000
Received: from [203.117.75.21] (helo=red-aura.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DBc8O-0002Ee-Et
	for idn@ops.ietf.org; Wed, 16 Mar 2005 17:16:40 +0000
Received: (qmail 10147 invoked from network); 16 Mar 2005 17:19:54 -0000
Received: from ip2.globalevents.iinet.com (HELO ?10.10.10.185?) (jseng@70.97.79.2)
  by red-aura.com with RC4-SHA encrypted SMTP; 16 Mar 2005 17:19:54 -0000
In-Reply-To: <6.1.2.0.2.20050316131141.03590c50@mail.jefsey.com>
References: <421B8484.3070802@vanderpoel.org> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org> <iluk6odazwb.fsf@latte.josefsson.org> <00e801c528a8$99ad37d0$72703009@sanjose.ibm.com> <ilull8qb5n5.fsf@latte.josefsson.org> <42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de> <423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org> <6.1.2.0.2.20050316131141.03590c50@mail.jefsey.com>
Mime-Version: 1.0 (Apple Message framework v619.2)
Content-Type: text/plain; charset=US-ASCII; format=flowed
Message-Id: <b188a9233091d865362598359fe6851c@seng.cc>
Content-Transfer-Encoding: 7bit
Cc: idn@ops.ietf.org, Simon Josefsson <jas@extundo.com>
From: James Seng <james@seng.cc>
Subject: Re: [idn] Re: stability
Date: Thu, 17 Mar 2005 01:16:20 +0800
To: "JFC (Jefsey) Morfin" <jefsey@jefsey.com>
X-Mailer: Apple Mail (2.619.2)
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-1.3 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Sorry, I wasn't able to decipher what JFC is trying to say with all the 
strange terminologies.

It is an important topic and I better don't pretend to know what he is 
talking about. Can someone help to translate this to English to me?

-James Seng

On 16-Mar-05, at PM 08:28, JFC (Jefsey) Morfin wrote:

> On 22:53 15/03/2005, Simon Josefsson said:
>> I believe it would be useful to start thinking of the problem in terms
>> of a transition plan from what we have today and what we would like to
>> have tomorrow.  It is not clear to me exactly what we would like to
>> have tomorrow, so settling that would have to be part of the plan as
>> well.
>
> That part seems quite easy to address. We want to be PAD compatible, 
> so the users have a single system. This means that we may have three 
> systems:
>
> Unicode to IP   tables
> Unicode to DN tables
> Unicode to lingual SLD to display as a lingual TLD tables
>
> using NameScript tables listing the Unicode codes permitted throught 
> out the FQMLDN to prevent homograph problems. Every label being an ACE 
> label in an MLDN, ASCII in an ascii label.
>
> The general construct being labels.table-indicator.tld. The table 
> indicator being by default the table indicator of the TLD. This way 
> existing ascii TLDs are label.ascii-indicator.tld (the ascii indicator 
> is not necessary). The same for a Chinese TLD, 
> chinese.chinese-indicator.tld: the chinese indicator is not necessary. 
> Every label part of a MLDN is subject to a punycode translation and a 
> nameprep removing the codes not compatible with its indicator.
>
> This fully permits atypical domain names to be registered in using a 
> no-filtered indicator, easy to underline in an application display.
>
> This also permits table-indicator.TLD to be converted in the proper 
> MLTLD display or from the MLTLD entry.
>
> This is obvsiously fully compatible with the DNS and ask no complex 
> special program, procedures, contract by Registries.  No need for 
> lingual users to switch to Handles. It can even support phonetic, menu 
> server, icon based vernacular names. This is also what is already in 
> use.
>
> This is what the initial demand was for.
> jfc
>
>
>




From owner-idn@ops.ietf.org  Wed Mar 16 12:45:54 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id MAA14668
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 12:45:54 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBcX3-0005Fg-VP
	for idn-data@psg.com; Wed, 16 Mar 2005 17:42:09 +0000
Received: from [209.187.148.211] (helo=bs.jck.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DBcX1-0005F9-MI
	for idn@ops.ietf.org; Wed, 16 Mar 2005 17:42:07 +0000
Received: from [127.0.0.1] (helo=p2)
	by bs.jck.com with esmtp (Exim 4.34)
	id 1DBcWg-0003Kg-6m; Wed, 16 Mar 2005 12:41:47 -0500
Date: Wed, 16 Mar 2005 11:37:52 -0500
From: John C Klensin <klensin@jck.com>
To: Erik van der Poel <erik@vanderpoel.org>,
        =?ISO-8859-1?Q?=22Martin_v=2E_L=F6wis=22?= <martin@v.loewis.de>
cc: Simon Josefsson <jas@extundo.com>, Mark Davis <mark.davis@jtcsv.com>,
        idn@ops.ietf.org
Subject: Re: [idn] Re: stability
Message-ID: <5A007C107F429B5660DD3265@7AD4D3FB4841A5E367CCF211>
In-Reply-To: <4237917D.9080507@vanderpoel.org>
References: <421B8484.3070802@vanderpoel.org>
 	<D872CCF059514053ECF8A198@scan.jck.com>
 	<421D8411.9030006@vanderpoel.org>
 	<p06210208be4390618c81@[192.168.0.101]>
 	<421E0D0C.2000309@vanderpoel.org>
 	<p06210202be43c3888991@[192.168.0.101]>
 	<E07CE813AD23B2D95DA0C740@scan.jck.com>
 	<421E30F2.1040408@vanderpoel.org>
 	<0E7F74C71945B923C52211F3@scan.jck.com>
 	<421EA0C9.1010500@vanderpoel.org>
 	<00a401c51af3$7863aae0$030aa8c0@DEWELL>
 	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
 	<42322CE2.4040509@vanderpoel.org>
 <4232B2FD.1080104@vanderpoel.org>
 	<4232BA56.5090001@vanderpoel.org>
 	<iluk6odazwb.fsf@latte.josefsson.org>
 	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>
 	<ilull8qb5n5.fsf@latte.josefsson.org>
 	<42367B63.6080300@vanderpoel.org>
 <4237450A.9010901@v.loewis.de>	<423754F3.50405@vanderpoel.org>
 <ilumzt47ezc.fsf@latte.josefsson.org>
 <42375C9E.8040001@v.loewis.de> <4237917D.9080507@vanderpoel.org>
X-Mailer: Mulberry/3.1.6 (Win32)
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1; format=flowed
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: quoted-printable



--On Tuesday, March 15, 2005 5:53 PM -0800 Erik van der Poel=20
<erik@vanderpoel.org> wrote:

> Martin v. L=F6wis wrote:
>> What is much more relevant is how further constraints in the
>> registry (beyond those imposed by IDNA) get implemented. Only
>> when that is sufficiently settled and deployed, considering
>> *updates* to IDNA should start.
>
> I disagree. The IETF should not wait for any of the registries
> to do anything before publishing new drafts or RFCs. The
> registries are not the only other players here. We have
> application developers and zone administrators depending on
> our work too.

Yes.

And let me add one observation.  At the moment, "the registries" =

(remember that there are around 275 of them) are going in every=20
direction possible.  ICANN's guidance, based to some extent on=20
the advice that IESG gave them, is so vague as to permit almost=20
any interpretation, clearly doesn't work for some important=20
cases (encouraging even more interpretations), and is being=20
outright ignored by some ccTLDs.   If we want the registries to=20
do something, we are going to need to provide some more specific =

guidance and we are going to need to document why it is a good=20
idea.  The same observation applies to application writers:=20
unless we actually change the standard (the algorithms or the=20
tables), all we are doing is offering advice.  That advice will=20
probably be taken if it is clear and well-reasoned and the=20
reasoning is well- explained justified.  And, in both cases, it=20
will be easier to persuade people to make changes before they=20
have an installed base that has to be forced to adjust to new=20
ways of doing things.  The more deployment occurs before we make =

suggestions or change things, the more likely whatever we do=20
will be ignored.

   john




From owner-idn@ops.ietf.org  Wed Mar 16 13:16:28 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id NAA17878
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 13:16:28 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBd0N-000Al0-Qp
	for idn-data@psg.com; Wed, 16 Mar 2005 18:12:27 +0000
Received: from [207.115.63.102] (helo=pimout3-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DBd0I-000AkY-4B
	for idn@ops.ietf.org; Wed, 16 Mar 2005 18:12:26 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout3-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2GIBU9N393712;
	Wed, 16 Mar 2005 13:11:34 -0500
Message-ID: <423876D2.2070809@vanderpoel.org>
Date: Wed, 16 Mar 2005 10:11:30 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: "JFC (Jefsey) Morfin" <jefsey@jefsey.com>
CC: =?ISO-8859-1?Q?=22Martin_v=2E_L=F6wis=22?= <martin@v.loewis.de>,
        Simon Josefsson <jas@extundo.com>, Mark Davis <mark.davis@jtcsv.com>,
        idn@ops.ietf.org
Subject: Re: [idn] Re: stability
References: <421B8484.3070802@vanderpoel.org> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org> <iluk6odazwb.fsf@latte.josefsson.org> <00e801c528a8$99ad37d0$72703009@sanjose.ibm.com> <ilull8qb5n5.fsf@latte.josefsson.org> <42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de> <423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org> <42375C9E.8040001@v.loewis.de> <4237917D.9080507@vanderpoel.org> <6.1.2.0.2.20050316125429.04464370@mail.jefsey.com>
In-Reply-To: <6.1.2.0.2.20050316125429.04464370@mail.jefsey.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 8bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 8bit

JFC (Jefsey) Morfin wrote:
> At 02:53 16/03/2005, Erik van der Poel wrote:
> 
>> Martin v. Löwis wrote:
>>
>>> What is much more relevant is how further constraints in the registry
>>> (beyond those imposed by IDNA) get implemented. Only when that is
>>> sufficiently settled and deployed, considering *updates* to IDNA
>>> should start.
>>
>> I disagree. The IETF should not wait for any of the registries to do 
>> anything before publishing new drafts or RFCs. The registries are not 
>> the only other players here. We have application developers and zone 
>> administrators depending on our work too.
> 
> Fully true. But we are in a real world. If you propose anything again 
> without the support of the Registries you will have a lack of 
> understanding, adherence and support. Also what you will propose will be 
> less reviewed from different point of view and will have more risks to 
> have its own flaws. You will not be able to tell the Registries they 
> shared in the mistake they have to share in the fix. 

I agree, and I can see why you react in this way to my email, but please 
look again at Martin's email. If we followed Martin's advice, we would 
wait quite a long time before even *considering* updates to IDNA. I 
think it's reasonable to *consider* changes and even to write drafts 
*before* the registries deploy further constraints.

Of course, we must involve the registries in the draft review process.

> The first step is to permit the Registries to operate in this still 
> debated environement.

I'm afraid I don't understand. The registry operators *are* already 
permitted to operate their registries.

> I have asked responses about that and got no 
> answer.

I find it very difficult to respond to your emails because you often 
bring up topics that I don't understand and seem somewhat unrelated, 
such as "PAD". Also, some of your emails seem to talk about a 
revolution, which is very difficult to bring about, and hence unlikely. 
I have made such proposals myself (e.g. displaying the domain name from 
left to right instead of right to left), but others have pointed out 
that such ideas are more in the theoretical realm than the practical 
one, and so I have stopped talking about them.

If you want to achieve consensus, you have to come closer to the rest of 
the group.

Of course, you may claim that this group is itself far removed from the 
real world, but I don't see much evidence of that.

> What are the objections (and BTW were to find described the consquences 
> for a Registry) to Adam and Simon positions?

It is too early to write a description of the consequences for the 
registries, since we haven't even reached a rough consensus on the 
changes to the specs.

Erik



From owner-idn@ops.ietf.org  Wed Mar 16 13:45:40 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id NAA21532
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 13:45:40 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBdSP-000FiA-JY
	for idn-data@psg.com; Wed, 16 Mar 2005 18:41:25 +0000
Received: from [207.115.63.98] (helo=pimout4-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DBdSJ-000Fg7-69
	for idn@ops.ietf.org; Wed, 16 Mar 2005 18:41:23 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout4-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2GIeV5K074638;
	Wed, 16 Mar 2005 13:40:36 -0500
Message-ID: <42387D9F.7030800@vanderpoel.org>
Date: Wed, 16 Mar 2005 10:40:31 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: "JFC (Jefsey) Morfin" <jefsey@jefsey.com>
CC: =?ISO-8859-1?Q?=22Martin_v=2E_L=F6wis=22?= <martin@v.loewis.de>,
        Simon Josefsson <jas@extundo.com>, Mark Davis <mark.davis@jtcsv.com>,
        idn@ops.ietf.org
Subject: Re: [idn] Re: stability
References: <421B8484.3070802@vanderpoel.org> <D872CCF059514053ECF8A198@scan.jck.com> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org> <iluk6odazwb.fsf@latte.josefsson.org> <00e801c528a8$99ad37d0$72703009@sanjose.ibm.com> <ilull8qb5n5.fsf@latte.josefsson.org> <42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de> <423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org> <42375C9E.8040001@v.loewis.de> <4237917D.9080507@vanderpoel.org> <6.1.2.0.2.20050316125429.04464370@mail.jefsey.com>
In-Reply-To: <6.1.2.0.2.20050316125429.04464370@mail.jefsey.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

JFC (Jefsey) Morfin wrote:
> What are the objections (and BTW were to find described the consquences 
> for a Registry) to Adam and Simon positions?

In order to reach a rough consensus on any changes we make to the specs 
to address PRI #29, we should consider the consequences for the 
registries. PRI #29 claims that only a handful of characters are 
involved, but we may wish to confirm that. It may also be a good idea to 
write a program that the registries could use to see whether any labels 
containing such character sequences might have been Nameprepped and 
registered.

Erik



From owner-idn@ops.ietf.org  Wed Mar 16 14:27:02 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id OAA27132
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 14:27:01 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBe6q-000NUy-ME
	for idn-data@psg.com; Wed, 16 Mar 2005 19:23:12 +0000
Received: from [207.115.63.101] (helo=pimout2-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DBe6n-000NTY-8w
	for idn@ops.ietf.org; Wed, 16 Mar 2005 19:23:09 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout2-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2GJMkMW067704;
	Wed, 16 Mar 2005 14:22:48 -0500
Message-ID: <42388785.2000102@vanderpoel.org>
Date: Wed, 16 Mar 2005 11:22:45 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Simon Josefsson <jas@extundo.com>
CC: IETF idn working group <idn@ops.ietf.org>,
        Kurt Zeilenga <Kurt@OpenLDAP.org>, Jeffrey Altman <jaltman@iamx.com>,
        Jeffrey Altman <jaltman@columbia.edu>
Subject: [idn] stringprep mailing list
References: <42322CE2.4040509@vanderpoel.org>	<4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>	<ilull8qb5n5.fsf@latte.josefsson.org>	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>	<20050316091126.GA24254~@nicemice.net> <iluzmx36h6t.fsf@latte.josefsson.org>
In-Reply-To: <iluzmx36h6t.fsf@latte.josefsson.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Simon Josefsson wrote:
> One way is to incorporate the PR-29 fix, declare the earlier attempt
> as buggy, and re-cycle at PROPOSED.  I suspect you prefer that way?  I
> am hesitant about that approach, because we have already deployed the
> old RFC and it is not clear what problems there will be in mixing the
> old and the new code.  Both Kerberos and SASL appears to be going to
> use the old StringPrep as well, so we will be seeing security critical
> infrastructure based on the old interpretation.

Even if Stringprep is not updated to address the PRI #29 problem, we 
must at least let the other Stringprep profile authors know about the 
situation, so that they can make their own decisions for their areas. 
The IDN mailing list seems to be dedicated to IDNA issues (including 
Nameprep). Is there a Stringprep mailing list?

http://www.unicode.org/review/pr-29.html
http://www.imc.org/idn/mail-archive/maillist.html

The IANA Stringprep registry has not been updated to point to the new 
SASLprep RFC:

http://www.iana.org/assignments/stringprep-profiles
ftp://ftp.rfc-editor.org/in-notes/rfc4013.txt

I am Cc'ing the author of RFC 4013 (Kurt Zeilenga) on this email.

I am also Cc'ing the author of the expired Internet Draft of the 
Kerberos profile of Stringprep (Jeffrey Altman). Kurt and Jeffrey may 
wish to take a look at the various things I've included URIs for in this 
email.

http://josefsson.org/cgi-bin/rfcmarkup?url=http://josefsson.org/cgi-bin/viewcvs.cgi/*checkout*/libidn/doc/specifications/draft-ietf-krb-wg-utf8-profile-01.txt

Erik



From owner-idn@ops.ietf.org  Wed Mar 16 17:10:44 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id RAA04171
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 17:10:43 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBgbr-0003OZ-OS
	for idn-data@psg.com; Wed, 16 Mar 2005 22:03:23 +0000
Received: from [217.13.230.178] (helo=yxa.extundo.com)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DBgbn-0003MH-AA
	for idn@ops.ietf.org; Wed, 16 Mar 2005 22:03:21 +0000
Received: from latte.josefsson.org (c494102a.s-bi.bostream.se [217.215.27.65])
	(authenticated bits=0)
	by yxa.extundo.com (8.13.3/8.13.3/Debian-6) with ESMTP id j2GM2jsH019622
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Wed, 16 Mar 2005 23:02:46 +0100
From: Simon Josefsson <jas@extundo.com>
To: Erik van der Poel <erik@vanderpoel.org>
Cc: IETF idn working group <idn@ops.ietf.org>,
        Kurt Zeilenga <Kurt@OpenLDAP.org>, Jeffrey Altman <jaltman@iamx.com>,
        Jeffrey Altman <jaltman@columbia.edu>
Subject: [idn] Re: stringprep mailing list
References: <42322CE2.4040509@vanderpoel.org>
	<4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org>
	<iluk6odazwb.fsf@latte.josefsson.org>
	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>
	<ilull8qb5n5.fsf@latte.josefsson.org>
	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>
	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>
	<20050316091126.GA24254~@nicemice.net>
	<iluzmx36h6t.fsf@latte.josefsson.org>
	<42388785.2000102@vanderpoel.org>
OpenPGP: id=B565716F; url=http://josefsson.org/key.txt
Blog: http://www.livejournal.com/users/jas4711/
X-Hashcash: 1:21:050316:kurt@openldap.org::Nub9Ae6Uv7SLsuBU:gT3
X-Hashcash: 1:21:050316:erik@vanderpoel.org::/rs/z0hpLjZ6Tx+Q:3WS1
X-Hashcash: 1:21:050316:idn@ops.ietf.org::cCzCWRhrLZOtYDgg:7vJ9
X-Hashcash: 1:21:050316:jaltman@columbia.edu::qkFB24RnCQ4alutB:DN2i
X-Hashcash: 1:21:050316:jaltman@iamx.com::5V0FilUkaQAaz5Li:Kg1G
X-Hashcash: 1:21:050316:kurt@openldap.org::97zQxAWeRZ+4cgHk:03m0
Date: Wed, 16 Mar 2005 23:02:26 +0100
In-Reply-To: <42388785.2000102@vanderpoel.org> (Erik van der Poel's message of
	"Wed, 16 Mar 2005 11:22:45 -0800")
Message-ID: <ilu8y4n5jwt.fsf@latte.josefsson.org>
User-Agent: Gnus/5.110003 (No Gnus v0.3) Emacs/22.0.50 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Virus-Scanned: ClamAV version 0.81, clamav-milter version 0.81b on yxa.extundo.com
X-Virus-Status: Clean
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Erik van der Poel <erik@vanderpoel.org> writes:

> Even if Stringprep is not updated to address the PRI #29 problem, we 
> must at least let the other Stringprep profile authors know about the 
> situation, so that they can make their own decisions for their areas. 
> The IDN mailing list seems to be dedicated to IDNA issues (including 
> Nameprep). Is there a Stringprep mailing list?

There was one ("ietf-stringprep"), but I believe it has been closed.

I suspect none of this is news to any author of a StringPrep profile.
RFC 4013 acknowledge the PR29 issue in the security consideration.

> I am also Cc'ing the author of the expired Internet Draft of the 
> Kerberos profile of Stringprep (Jeffrey Altman). Kurt and Jeffrey may 
> wish to take a look at the various things I've included URIs for in this 
> email.
>
> http://josefsson.org/cgi-bin/rfcmarkup?url=http://josefsson.org/cgi-bin/viewcvs.cgi/*checkout*/libidn/doc/specifications/draft-ietf-krb-wg-utf8-profile-01.txt

The Kerberos WG is using SASLprep, IIUC.

Thanks,
Simon



From owner-idn@ops.ietf.org  Wed Mar 16 17:19:19 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id RAA04724
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 17:19:19 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBglp-0005s5-No
	for idn-data@psg.com; Wed, 16 Mar 2005 22:13:41 +0000
Received: from [64.36.79.201] (helo=nicemice.net)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DBglo-0005q9-MK
	for idn@ops.ietf.org; Wed, 16 Mar 2005 22:13:40 +0000
Received: from amc by nicemice.net with local (Exim 4.44)
	id 1DBgll-0006i4-Kw
	for idn@ops.ietf.org; Wed, 16 Mar 2005 14:13:37 -0800
Date: Wed, 16 Mar 2005 22:13:37 +0000
From: "Adam M. Costello" <idn.amc+0@nicemice.net.RemoveThisWord.cnri.reston.va.us>
To: IETF idn working group <idn@ops.ietf.org>
Subject: [idn] IDNA section 3.1 requirement 3
Message-ID: <20050316221337.GB25580~@nicemice.net>
Reply-To: IETF idn working group <idn@ops.ietf.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
User-Agent: Mutt/1.5.6+20040907i
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Consider a domain name containing a slash-homograph.

As it stands, IDNA section 3.1 requirement 3 tells applications that
they "SHOULD" display the non-ACE form.  The security considerations
section, much later, "suggests" that applications provide visual
indications of various anomalies (from which one could extrapolate that
the slash-homograph would benefit from a visual indication).

I think we've seen that these security concerns need to be less buried,
that "visual indications" are too burdensome on implementations, and
that in some cases (like this one) the recommendation to display the
non-ACE form ought to be withdrawn, or even reversed (that is, recommend
the ASCII form).

There I propose a technical change to IDNA section 3.1 requirement 3.
For reference, here it is as it stands now in RFC-3490 (with one typo
corrected):

   3) ACE labels obtained from domain name slots SHOULD be hidden from
      users when it is known that the environment can handle the non-ACE
      form, except when the ACE form is explicitly requested.  When
      it is not known whether or not the environment can handle the
      non-ACE form, the application MAY use the non-ACE form (which
      might fail, such as by not being displayed properly), or it MAY
      use the ACE form (which will look unintelligible to the user).
      Given an internationalized domain name, an equivalent domain name
      containing no ACE labels can be obtained by applying the ToUnicode
      operation (see section 4) to each label.  When requirements 2 and
      3 both apply, requirement 2 takes precedence.

Here is my proposed replacement:

--begin--

   3) When a domain label occupying or obtained from a domain name
      slot is to be shown to a user, it SHOULD NOT simply be shown in
      whatever form it was found in; before being shown it SHOULD be
      forced into either ASCII form (which can be obtained by applying
      ToASCII) or non-ACE form (which can be obtained by applying
      ToUnicode, see section 4), according to the first applicable of
      the following rules:

      a) If requirements 2 and 3 both apply, requirement 2 takes
         precedence, and the ASCII form MUST be used.

      b) When the user has explicitly requested to see one form or the
         other, that form SHOULD be shown.

      c) When it is known that the environment cannot handle the non-ACE
         form, the ASCII form SHOULD be shown.

      d) If the non-ACE form contains any character outside Unicode
         categories L (letter), N (number), and M (mark), other than
         U+002D hyphen-minus, the ACE form SHOULD be shown.

      e) If the application determines that showing the non-ACE form
         would pose too great a risk of misleading the user, the ASCII
         form MAY be shown.  Applications MAY use complex heuristics to
         estimate this risk, but SHOULD try to minimize the negative
         impact on legitimate usage of internationalized domain names.

      f) When it is not known whether the environment can handle the
         non-ACE form, the application MAY show the non-ACE form (which
         might fail, such as by not being displayed properly), or it MAY
         show the ASCII form (which will look unintelligible to the user
         if it is an ACE).

      g) In general, when rules a-f do not apply, the non-ACE form
         SHOULD be shown.

      Rules c, d, and e above apply tests to "the" non-ACE form, but
      in fact there can be many non-ACE forms that differ only in
      capitalization and/or normalization.  If a given non-ACE label
      fails some test, it MAY be converted to an equivalent non-ACE
      label by applying the map and/or normalize steps of [NAMEPREP] (or
      all the steps), and then given another chance to pass the test.

--end--

Thoughts?

AMC



From owner-idn@ops.ietf.org  Wed Mar 16 18:35:09 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id SAA13578
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 18:35:09 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBhyh-000KuE-De
	for idn-data@psg.com; Wed, 16 Mar 2005 23:31:03 +0000
Received: from [208.184.76.39] (helo=above.proper.com)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DBhyg-000Ktx-E7
	for idn@ops.ietf.org; Wed, 16 Mar 2005 23:31:02 +0000
Received: from [10.20.30.249] (adsl-66-125-125-65.dsl.pltn13.pacbell.net [66.125.125.65])
	(authenticated bits=0)
	by above.proper.com (8.12.11/8.12.9) with ESMTP id j2GNV1CS025317
	for <idn@ops.ietf.org>; Wed, 16 Mar 2005 15:31:01 -0800 (PST)
	(envelope-from phoffman@imc.org)
Mime-Version: 1.0
Message-Id: <p06210260be5e6f4e2379@[10.20.30.249]>
In-Reply-To: <20050316221337.GB25580~@nicemice.net>
References: <20050316221337.GB25580~@nicemice.net>
Date: Wed, 16 Mar 2005 15:31:20 -0800
To: IETF idn working group <idn@ops.ietf.org>
From: Paul Hoffman <phoffman@imc.org>
Subject: Re: [idn] IDNA section 3.1 requirement 3
Content-Type: text/plain; charset="us-ascii" ; format="flowed"
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

At 10:13 PM +0000 3/16/05, Adam M. Costello wrote:
>Consider a domain name containing a slash-homograph.
>
>As it stands, IDNA section 3.1 requirement 3 tells applications that
>they "SHOULD" display the non-ACE form.  The security considerations
>section, much later, "suggests" that applications provide visual
>indications of various anomalies (from which one could extrapolate that
>the slash-homograph would benefit from a visual indication).

Right.

>I think we've seen that these security concerns need to be less buried,

Fair point, but it's not like that if we had put them in section 3.1, 
all browser makers would have done anything about them. From the 
testing we did a while ago, it's clear that a fair number of browser 
makers didn't even read the normative parts of the spec.

>that "visual indications" are too burdensome on implementations,

Fully disagree. We haven't seen anyone actually try visual 
indications, and some have said that they are working on them. They 
may not want to do them, but most of them didn't want to do IDNs 
either.

>  and
>that in some cases (like this one) the recommendation to display the
>non-ACE form ought to be withdrawn, or even reversed (that is, recommend
>the ASCII form).

Question: when faced with an incomprehensible domain name with no 
visual indications, do you think that typical users will know what to 
do, or even what to be cautious of? Hint: think about what typical 
users do with SSL certificate warning dialogs.

We're trying to deal with a security issue: obscuring it won't make 
it useful to users, nor will it make them cautious, just confused.

>       d) If the non-ACE form contains any character outside Unicode
>          categories L (letter), N (number), and M (mark), other than
>          U+002D hyphen-minus, the ACE form SHOULD be shown.

This is quite a reasonable attempt at picking good characters. It 
won't eliminate homographs by any matter of means, but it is a 
reasonable narrowing.

>Thoughts?

At first glance, it is a reasonable way to choose between 
unadulterated Unicode and ACE display. However, it is based on a very 
unproven assumption, namely that there isn't any other visual 
assistance that we can suggest.

Adam: could you think more about it and see how it would look if 
thought visual assistance was an option?

--Paul Hoffman, Director
--Internet Mail Consortium



From owner-idn@ops.ietf.org  Wed Mar 16 20:42:04 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id UAA24384
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 20:42:04 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBjx3-000J2F-CZ
	for idn-data@psg.com; Thu, 17 Mar 2005 01:37:29 +0000
Received: from [209.187.148.211] (helo=bs.jck.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DBjx1-000J1d-U6
	for idn@ops.ietf.org; Thu, 17 Mar 2005 01:37:28 +0000
Received: from [127.0.0.1] (helo=p2)
	by bs.jck.com with esmtp (Exim 4.34)
	id 1DBjwu-0007o9-8E
	for idn@ops.ietf.org; Wed, 16 Mar 2005 20:37:27 -0500
Date: Wed, 16 Mar 2005 18:43:52 -0500
From: John C Klensin <klensin@jck.com>
To: IETF idn working group <idn@ops.ietf.org>
Subject: Re: [idn] IDNA section 3.1 requirement 3
Message-ID: <052C0407EAFFC3AC92D2D7D9@7AD4D3FB4841A5E367CCF211>
In-Reply-To: <20050316221337.GB25580~@nicemice.net>
References:  <20050316221337.GB25580~@nicemice.net>
X-Mailer: Mulberry/3.1.6 (Win32)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.5 required=5.0 tests=AWL,BAYES_00,
	MAILTO_TO_REMOVE autolearn=ham version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Adam,

I see where you are going here, but, to some considerable 
extent, I think it is a waste of time or worse.

Please take a step back from looking at coding, disclaimers, and 
this type of recommendation and put yourself into the place of 
the application developer who, other than the registrars and 
registries, is the market for the IDNA technology.  Those 
application developers, at least the ones who intend to survive, 
are quite sensitive to user reactions: users who are unhappy 
with user interfaces tend to have thoughts about going 
elsewhere.  The IETF has, for years, avoided getting involved 
with user interface design for many reasons; being the source of 
that unhappiness is one of the reasons.

You are now proposing to transform an IDNA rule that, given 
contemporary operating system and display designs, was 
essentially meaningless (but harmless) into a fairly complex set 
of rules.  If the current rule contracted the experience 
application designers wanted to deliver to their users, they 
would ignore it... and have been doing so.  If the new rule is 
at variance with the target experience, it, too, will be ignored.

Let's look at a few of the things we know about user behavior 
and reactions:

    * They do not like looking at punycode or similar "no
    obvious meaning" and/or "ugly" constructions.  If too much
    of it is displayed, they will be unhappy.

    * They don't like the unpredictable and unexpected.  If they
    are used to seeing native characters and punycode suddenly
    pops up, there had better be a good, and plausible, and
    immediately accessible explanation.

    * They get really irritated with repeated and intrusive
    warnings that they don't know how to interpret and what to
    do about.  With too many pop-up alerts, the usual response
    is to click "ok" every time and to go looking for a way to
    shut the alerts off.  Given that there are many legitimate
    cases that fall into your "display punycode" categories,
    especially in the vicinity of certain scripts and languages,
    the application would generate a lot of false positives and
    the user would learn to ignore whatever is written there.

Make whatever suggestions and recommendations you think 
appropriate, but wrapping them in conformance language about 
what SHOULD/MUST be done just brings discredit on the protocol/ 
algorithm core of IDNA.

Just my opinion.

     john

--On Wednesday, March 16, 2005 10:13 PM +0000 "Adam M. Costello" 
<idn.amc+0@nicemice.net.RemoveThisWord> wrote:

> Consider a domain name containing a slash-homograph.
>
> As it stands, IDNA section 3.1 requirement 3 tells
> applications that they "SHOULD" display the non-ACE form.  The
> security considerations section, much later, "suggests" that
> applications provide visual indications of various anomalies
> (from which one could extrapolate that the slash-homograph
> would benefit from a visual indication).
>
> I think we've seen that these security concerns need to be
> less buried, that "visual indications" are too burdensome on
> implementations, and that in some cases (like this one) the
> recommendation to display the non-ACE form ought to be
> withdrawn, or even reversed (that is, recommend the ASCII
> form).
>
> There I propose a technical change to IDNA section 3.1
> requirement 3. For reference, here it is as it stands now in
> RFC-3490 (with one typo corrected):
>
>    3) ACE labels obtained from domain name slots SHOULD be
> hidden from       users when it is known that the environment
> can handle the non-ACE       form, except when the ACE form is
> explicitly requested.  When       it is not known whether or
> not the environment can handle the       non-ACE form, the
> application MAY use the non-ACE form (which       might fail,
> such as by not being displayed properly), or it MAY       use
> the ACE form (which will look unintelligible to the user).
> Given an internationalized domain name, an equivalent domain
> name       containing no ACE labels can be obtained by
> applying the ToUnicode       operation (see section 4) to each
> label.  When requirements 2 and       3 both apply,
> requirement 2 takes precedence.
>
> Here is my proposed replacement:
>
> --begin--
>
>    3) When a domain label occupying or obtained from a domain
> name       slot is to be shown to a user, it SHOULD NOT simply
> be shown in       whatever form it was found in; before being
> shown it SHOULD be       forced into either ASCII form (which
> can be obtained by applying       ToASCII) or non-ACE form
> (which can be obtained by applying       ToUnicode, see
> section 4), according to the first applicable of       the
> following rules:
>
>       a) If requirements 2 and 3 both apply, requirement 2
> takes          precedence, and the ASCII form MUST be used.
>
>       b) When the user has explicitly requested to see one
> form or the          other, that form SHOULD be shown.
>
>       c) When it is known that the environment cannot handle
> the non-ACE          form, the ASCII form SHOULD be shown.
>
>       d) If the non-ACE form contains any character outside
> Unicode          categories L (letter), N (number), and M
> (mark), other than          U+002D hyphen-minus, the ACE form
> SHOULD be shown.
>
>       e) If the application determines that showing the
> non-ACE form          would pose too great a risk of
> misleading the user, the ASCII          form MAY be shown.
> Applications MAY use complex heuristics to          estimate
> this risk, but SHOULD try to minimize the negative
> impact on legitimate usage of internationalized domain names.
>
>       f) When it is not known whether the environment can
> handle the          non-ACE form, the application MAY show the
> non-ACE form (which          might fail, such as by not being
> displayed properly), or it MAY          show the ASCII form
> (which will look unintelligible to the user          if it is
> an ACE).
>
>       g) In general, when rules a-f do not apply, the non-ACE
> form          SHOULD be shown.
>
>       Rules c, d, and e above apply tests to "the" non-ACE
> form, but       in fact there can be many non-ACE forms that
> differ only in       capitalization and/or normalization.  If
> a given non-ACE label       fails some test, it MAY be
> converted to an equivalent non-ACE       label by applying the
> map and/or normalize steps of [NAMEPREP] (or       all the
> steps), and then given another chance to pass the test.
>
> --end--
>
> Thoughts?
>
> AMC
>
>







From owner-idn@ops.ietf.org  Wed Mar 16 22:23:12 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id WAA02247
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 22:23:11 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBlUo-0008xM-T2
	for idn-data@psg.com; Thu, 17 Mar 2005 03:16:26 +0000
Received: from [63.247.76.195] (helo=montage.altserver.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DBlUk-0008wh-HP
	for idn@ops.ietf.org; Thu, 17 Mar 2005 03:16:22 +0000
Received: from lns-p19-2-idf-82-251-149-205.adsl.proxad.net ([82.251.149.205] helo=jfc.afrac.org)
	by montage.altserver.com with esmtpa (Exim 4.44)
	id 1DBlUZ-0001wa-ES; Wed, 16 Mar 2005 19:16:12 -0800
Message-Id: <6.1.2.0.2.20050317033553.031631d0@mail.jefsey.com>
X-Sender: jefsey+jefsey.com@mail.jefsey.com
X-Mailer: QUALCOMM Windows Eudora Version 6.1.2.0
Date: Thu, 17 Mar 2005 04:16:08 +0100
To: Erik van der Poel <erik@vanderpoel.org>
From: "JFC (Jefsey) Morfin" <jefsey@jefsey.com>
Subject: Re: [idn] Re: stability
Cc: "Martin v. Löwis" <martin@v.loewis.de>, Simon Josefsson <jas@extundo.com>,
        Mark Davis <mark.davis@jtcsv.com>, idn@ops.ietf.org
In-Reply-To: <423876D2.2070809@vanderpoel.org>
References: <421B8484.3070802@vanderpoel.org>
 <D872CCF059514053ECF8A198@scan.jck.com>
 <421D8411.9030006@vanderpoel.org>
 <p06210208be4390618c81@[192.168.0.101]>
 <421E0D0C.2000309@vanderpoel.org>
 <p06210202be43c3888991@[192.168.0.101]>
 <E07CE813AD23B2D95DA0C740@scan.jck.com>
 <421E30F2.1040408@vanderpoel.org>
 <0E7F74C71945B923C52211F3@scan.jck.com>
 <421EA0C9.1010500@vanderpoel.org>
 <00a401c51af3$7863aae0$030aa8c0@DEWELL>
 <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
 <42322CE2.4040509@vanderpoel.org>
 <4232B2FD.1080104@vanderpoel.org>
 <4232BA56.5090001@vanderpoel.org>
 <iluk6odazwb.fsf@latte.josefsson.org>
 <00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>
 <ilull8qb5n5.fsf@latte.josefsson.org>
 <42367B63.6080300@vanderpoel.org>
 <4237450A.9010901@v.loewis.de>
 <423754F3.50405@vanderpoel.org>
 <ilumzt47ezc.fsf@latte.josefsson.org>
 <42375C9E.8040001@v.loewis.de>
 <4237917D.9080507@vanderpoel.org>
 <6.1.2.0.2.20050316125429.04464370@mail.jefsey.com>
 <423876D2.2070809@vanderpoel.org>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"; format=flowed
X-AntiAbuse: This header was added to track abuse, please include it with any abuse report
X-AntiAbuse: Primary Hostname - montage.altserver.com
X-AntiAbuse: Original Domain - ops.ietf.org
X-AntiAbuse: Originator/Caller UID/GID - [0 0] / [47 12]
X-AntiAbuse: Sender Address Domain - jefsey.com
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

At 19:11 16/03/2005, Erik van der Poel wrote:
>JFC (Jefsey) Morfin wrote:
>I agree, and I can see why you react in this way to my email, but please 
>look again at Martin's email. If we followed Martin's advice, we would 
>wait quite a long time before even *considering* updates to IDNA. I think 
>it's reasonable to *consider* changes and even to write drafts *before* 
>the registries deploy further constraints.

Dear Erik,
John documented what he sees of the Registries. This is already a mess he 
documents well. What he does not see is that the users are not renewing. 
They are not interested. Except possibly - but their ccTLDs do not talk too 
much of IDNs -  in Latin countries. The issue is easy to understand you 
need two keyboards to enter the IDNs and two languages to spell them on the 
phone - except when the ascii TLD can be typed.

So there is no real need to get excited about IDNA. Phishing was 
interesting. I will write the Draft on that.

>Of course, we must involve the registries in the draft review process.
>
>>The first step is to permit the Registries to operate in this still 
>>debated environement.
>
>I'm afraid I don't understand. The registry operators *are* already 
>permitted to operate their registries.

John described that. Registries understand nothing to the complex signals 
(or lack of) from the ICANN, IETF, market, etc. I am on the WG-IDN of the 
ccTLDs as a lingual organization (Eurolinc). I suppose there is one year I 
received the last mail. 2 mails in one year++ on ICANN IDN list. They even 
told me James Seng does not attend all the ICANN IDN meetings (James?) 
anymore.

James sold us something brillant in MdR2000. But the IETF delivered 
something else.

>>I have asked responses about that and got no answer.
>
>I find it very difficult to respond to your emails because you often bring 
>up topics that I don't understand and seem somewhat unrelated, such as "PAD".

PADs are obviously the core of the problem and a revolution. Handles could 
also be used.
In case you forgot about PAD I documented several times, it stands for 
Private Alias Directory. This is the Directory of the ML keywords or DN you 
can register in your own system to call an external host. This is a Quick 
and Dirty excellent solution when an IP address is available. What will be 
the case with IPv6 and that main sites can obviously already support.

>  Also, some of your emails seem to talk about a revolution, which is very 
> difficult to bring about, and hence unlikely.

There are several revolutions right now. Just look at the network, the 
behaviors and the people. A revolution does not mean an immediate tide. It 
means that something we did one way can be done another way, that it has 
started being used and that it will only grow. IDNA is not a revolution.

>  I have made such proposals myself (e.g. displaying the domain name from 
> left to right instead of right to left), but others have pointed out that 
> such ideas are more in the theoretical realm than the practical one, and 
> so I have stopped talking about them.

This is not a revolution. This is a strange idea :-). Naming was left to 
right first. ARPANET naming was flat and for practical reason became right 
to left. It stayed that way. Your proposal works. Left to right and / 
separators. I understand there are already 15 millions of them. Named handles.

A revolution is that less than 50% of the Internet connections still use 
the DNS, that handles develop, that PADs permits private keywords and 
ultimately billions of roots. And that IAB can issue another document for 
information on the matter or not, the trend is that way and we have to 
organize it or it will be a mess.

>If you want to achieve consensus, you have to come closer to the rest of 
>the group.
>Of course, you may claim that this group is itself far removed from the 
>real world, but I don't see much evidence of that.

This is may be that you should go into the real world :-)  I think that in 
this group I am the only one who happens to be there. This is why I keep 
poping in here, in the hope that some field information can go through and 
some great guy like you, Adam, Simon, Brian, John can give a good idea.

All "the rest of the group" are in IETF or SGs. You know, one think the 
things go slowly. That changes will never happen. And all the sudden one 
discovers that they did happen and we did not saw them. Reality is simple: 
IDNA did not really convinced. Some techies had fun implementing them, some 
Registrars tried to make money in calling and registering TMs and some 
cybersquatters lost some money there.

Just a question: when was that the last time you supported a registrant for 
his server to be accessed with the DN he just registered?
This do help to understand what the people want and do.

jfc







From owner-idn@ops.ietf.org  Wed Mar 16 23:57:08 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id XAA10967
	for <idn-archive@lists.ietf.org>; Wed, 16 Mar 2005 23:57:07 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBmzk-000LkR-Ua
	for idn-data@psg.com; Thu, 17 Mar 2005 04:52:28 +0000
Received: from [207.115.63.98] (helo=pimout4-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DBmze-000Ljg-4K
	for idn@ops.ietf.org; Thu, 17 Mar 2005 04:52:26 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout4-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2H4pS5K040970;
	Wed, 16 Mar 2005 23:51:32 -0500
Message-ID: <42390CCF.1030409@vanderpoel.org>
Date: Wed, 16 Mar 2005 20:51:27 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: "JFC (Jefsey) Morfin" <jefsey@jefsey.com>
CC: =?ISO-8859-1?Q?=22Martin_v=2E_L=F6wis=22?= <martin@v.loewis.de>,
        Simon Josefsson <jas@extundo.com>, Mark Davis <mark.davis@jtcsv.com>,
        idn@ops.ietf.org
Subject: Re: [idn] stability
References: <421B8484.3070802@vanderpoel.org> <421D8411.9030006@vanderpoel.org> <p06210208be4390618c81@[192.168.0.101]> <421E0D0C.2000309@vanderpoel.org> <p06210202be43c3888991@[192.168.0.101]> <E07CE813AD23B2D95DA0C740@scan.jck.com> <421E30F2.1040408@vanderpoel.org> <0E7F74C71945B923C52211F3@scan.jck.com> <421EA0C9.1010500@vanderpoel.org> <00a401c51af3$7863aae0$030aa8c0@DEWELL> <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com> <42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org> <iluk6odazwb.fsf@latte.josefsson.org> <00e801c528a8$99ad37d0$72703009@sanjose.ibm.com> <ilull8qb5n5.fsf@latte.josefsson.org> <42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de> <423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org> <42375C9E.8040001@v.loewis.de> <4237917D.9080507@vanderpoel.org> <6.1.2.0.2.20050316125429.04464370@mail.jefsey.com> <423876D2.2070809@vanderpoel.org> <6.1.2.0.2.20050317033553.031631d0@mail.jefsey.com>
In-Reply-To: <6.1.2.0.2.20050317033553.031631d0@mail.jefsey.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

JFC (Jefsey) Morfin wrote:
> The issue is easy to 
> understand you need two keyboards to enter the IDNs and two languages to 
> spell them on the phone - except when the ascii TLD can be typed.

Some countries have keyboards with both ASCII and local characters. 
Which countries are you talking about? In any case, we can't just jump 
from the current DNS to one that does not require typing some ASCII 
characters in one go. I think these things must evolve, over time.

> Registries understand nothing to the complex 
> signals (or lack of) from the ICANN, IETF, market, etc. I am on the 
> WG-IDN of the ccTLDs as a lingual organization (Eurolinc). I suppose 
> there is one year I received the last mail. 2 mails in one year++ on 
> ICANN IDN list. They even told me James Seng does not attend all the 
> ICANN IDN meetings (James?) anymore.

The ICANN guidelines for IDNs probably should be updated. People are 
talking about this. Hopefully it will happen quite soon.

> James sold us something brillant in MdR2000. But the IETF delivered 
> something else.

Are you talking about the following?

http://www.dnso.org/dnso/notes/20011112.ICANN-mdr-IDN-JamesSeng.ppt

> PADs are obviously the core of the problem and a revolution. Handles 
> could also be used.
> In case you forgot about PAD I documented several times, it stands for 
> Private Alias Directory. This is the Directory of the ML keywords or DN 
> you can register in your own system to call an external host. This is a 
> Quick and Dirty excellent solution when an IP address is available. What 
> will be the case with IPv6 and that main sites can obviously already 
> support.

Maybe people will manually create a few private aliases, but I doubt 
they would bother to do so for the many, many sites on the Internet. 
People visit many sites, one after the other, in quick succession. Maybe 
I'm misunderstanding you...

> There are several revolutions right now. Just look at the network, the 
> behaviors and the people. A revolution does not mean an immediate tide. 
> It means that something we did one way can be done another way, that it 
> has started being used and that it will only grow. IDNA is not a 
> revolution.

I don't see very many signs of a PAD revolution. Am I in the wrong 
country (USA)? The wrong mailing list?

> Naming was left to 
> right first. ARPANET naming was flat and for practical reason became 
> right to left. It stayed that way. Your proposal works. Left to right 
> and / separators. I understand there are already 15 millions of them. 
> Named handles.

I don't see them. Do people exchange handles via email? Please show me a 
handle.

> A revolution is that less than 50% of the Internet connections still use 
> the DNS,

Are you saying that less than 50% of the TCP connections on the 
"Internet" (open Internet or also behind the firewall?) are immediately 
preceded by a DNS lookup? Where did you get this number from? Please 
state your source.

> that handles develop, that PADs permits private keywords and 
> ultimately billions of roots.

Are there any specs for these handles and PADs? Are there any working 
groups?

> Just a question: when was that the last time you supported a registrant 
> for his server to be accessed with the DN he just registered?
> This do help to understand what the people want and do.

Do your registrants use PADs? Are they happy with them?

Erik



From owner-idn@ops.ietf.org  Thu Mar 17 01:41:45 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id BAA20028
	for <idn-archive@lists.ietf.org>; Thu, 17 Mar 2005 01:41:45 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBoad-0007z1-Rk
	for idn-data@psg.com; Thu, 17 Mar 2005 06:34:39 +0000
Received: from [64.36.79.201] (helo=nicemice.net)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DBoaa-0007yf-RX
	for idn@ops.ietf.org; Thu, 17 Mar 2005 06:34:36 +0000
Received: from amc by nicemice.net with local (Exim 4.44)
	id 1DBoaZ-0006pc-GR
	for idn@ops.ietf.org; Wed, 16 Mar 2005 22:34:35 -0800
Date: Thu, 17 Mar 2005 06:34:35 +0000
From: "Adam M. Costello" <idn.amc+0@nicemice.net.RemoveThisWord.cnri.reston.va.us>
To: IETF idn working group <idn@ops.ietf.org>
Subject: Re: [idn] IDNA section 3.1 requirement 3
Message-ID: <20050317063435.GA26106~@nicemice.net>
Reply-To: IETF idn working group <idn@ops.ietf.org>
References: <20050316221337.GB25580~@nicemice.net> <052C0407EAFFC3AC92D2D7D9@7AD4D3FB4841A5E367CCF211> <20050316221337.GB25580~@nicemice.net> <p06210260be5e6f4e2379@[10.20.30.249]>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <052C0407EAFFC3AC92D2D7D9@7AD4D3FB4841A5E367CCF211> <p06210260be5e6f4e2379@[10.20.30.249]>
User-Agent: Mutt/1.5.6+20040907i
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Paul Hoffman <phoffman@imc.org> wrote:

> Question: when faced with an incomprehensible domain name with no
> visual indications, do you think that typical users will know what to
> do, or even what to be cautious of?

No, but they don't need to do anything special or use any more caution
than they would with any domain name that they didn't recognize.  As
long as they don't see "paypal" or whatever, they're at least not being
misled.

> Adam: could you think more about it and see how it would look if
> thought visual assistance was an option?

Suspicious characters could be shown in red, or highlighted, or with
squiggly underlines.  But the risk with any such scheme is that the
misleading text is still visible, so if the user doesn't take the
hint, they might still be misled.  And these approaches would be
less effective or impossible on monochrome displays or in tty-based
applications.

Another option is to show the suspicious characters using the
replacement glyph (hollow rectangle), but then cut-and-paste might
break, unless it's really clever.

I proposed the show-ACE approach because it's simpler to implement and
it's obviously effective regardless of the display technology.

John C Klensin <klensin@jck.com> wrote:

> Let's look at a few of the things we know about user behavior 
> and reactions:
> 
>    * They do not like looking at punycode or similar "no
>    obvious meaning" and/or "ugly" constructions.  If too much
>    of it is displayed, they will be unhappy.

I agree.  If enough browsers implement the proposal, no one will have a
motive to use domain labels that would show as ACE, and therefore users
will see ACE very rarely.

> Given that there are many legitimate cases that fall into your
> "display punycode" categories, especially in the vicinity of certain
> scripts and languages, the application would generate a lot of false
> positives and the user would learn to ignore whatever is written
> there.

Same comment.

> Make whatever suggestions and recommendations you think appropriate,
> but wrapping them in conformance language about what SHOULD/MUST be
> done just brings discredit on the protocol/ algorithm core of IDNA.

IDNA already makes a recommendation regarding what form to display,
but maybe you'd prefer my proposal to demote the details to cited
suggestions.  For example:

   3) When a domain label occupying or obtained from a domain name
      slot is to be shown to a user, it SHOULD NOT simply be shown in
      whatever form it was found in; before being shown it SHOULD be
      forced into either ASCII form (which can be obtained by applying
      ToASCII) or non-ACE form (which can be obtained by applying
      ToUnicode, see section 4).  Implementors are encouraged to
      develop policies that balance the conflicting goals of hiding
      unintelligible ACE strings from users and hiding potentially
      misleading Unicode strings from users.  See appendix A for
      suggestions.  When requirementst 2 and 3 both apply, requirement 2
      takes precedence.

Then the rest of the proposal would go in appendix A, without the
SHOULD/MAY language.

AMC



From owner-idn@ops.ietf.org  Thu Mar 17 05:20:09 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id FAA04649
	for <idn-archive@lists.ietf.org>; Thu, 17 Mar 2005 05:20:09 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBs0V-000ARw-GF
	for idn-data@psg.com; Thu, 17 Mar 2005 10:13:35 +0000
Received: from [63.247.76.195] (helo=montage.altserver.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DBs0T-000ARg-0v
	for idn@ops.ietf.org; Thu, 17 Mar 2005 10:13:33 +0000
Received: from lns-p19-2-idf-82-251-145-54.adsl.proxad.net ([82.251.145.54] helo=jfc.afrac.org)
	by montage.altserver.com with esmtpa (Exim 4.44)
	id 1DBs0Q-0004aN-QD; Thu, 17 Mar 2005 02:13:31 -0800
Message-Id: <6.1.2.0.2.20050317074148.0326b670@mail.jefsey.com>
X-Sender: jefsey+jefsey.com@mail.jefsey.com
X-Mailer: QUALCOMM Windows Eudora Version 6.1.2.0
Date: Thu, 17 Mar 2005 08:19:38 +0100
To: Erik van der Poel <erik@vanderpoel.org>
From: "JFC (Jefsey) Morfin" <jefsey@jefsey.com>
Subject: Re: [idn] stability
Cc: idn@ops.ietf.org
In-Reply-To: <42390CCF.1030409@vanderpoel.org>
References: <421B8484.3070802@vanderpoel.org>
 <421D8411.9030006@vanderpoel.org>
 <p06210208be4390618c81@[192.168.0.101]>
 <421E0D0C.2000309@vanderpoel.org>
 <p06210202be43c3888991@[192.168.0.101]>
 <E07CE813AD23B2D95DA0C740@scan.jck.com>
 <421E30F2.1040408@vanderpoel.org>
 <0E7F74C71945B923C52211F3@scan.jck.com>
 <421EA0C9.1010500@vanderpoel.org>
 <00a401c51af3$7863aae0$030aa8c0@DEWELL>
 <A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>
 <42322CE2.4040509@vanderpoel.org>
 <4232B2FD.1080104@vanderpoel.org>
 <4232BA56.5090001@vanderpoel.org>
 <iluk6odazwb.fsf@latte.josefsson.org>
 <00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>
 <ilull8qb5n5.fsf@latte.josefsson.org>
 <42367B63.6080300@vanderpoel.org>
 <4237450A.9010901@v.loewis.de>
 <423754F3.50405@vanderpoel.org>
 <ilumzt47ezc.fsf@latte.josefsson.org>
 <42375C9E.8040001@v.loewis.de>
 <4237917D.9080507@vanderpoel.org>
 <6.1.2.0.2.20050316125429.04464370@mail.jefsey.com>
 <423876D2.2070809@vanderpoel.org>
 <6.1.2.0.2.20050317033553.031631d0@mail.jefsey.com>
 <42390CCF.1030409@vanderpoel.org>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"; format=flowed
X-AntiAbuse: This header was added to track abuse, please include it with any abuse report
X-AntiAbuse: Primary Hostname - montage.altserver.com
X-AntiAbuse: Original Domain - ops.ietf.org
X-AntiAbuse: Originator/Caller UID/GID - [0 0] / [47 12]
X-AntiAbuse: Sender Address Domain - jefsey.com
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

At 05:51 17/03/2005, Erik van der Poel wrote:
>JFC (Jefsey) Morfin wrote:
>>The issue is easy to understand you need two keyboards to enter the IDNs 
>>and two languages to spell them on the phone - except when the ascii TLD 
>>can be typed.
>
>Some countries have keyboards with both ASCII and local characters. Which 
>countries are you talking about? In any case, we can't just jump from the 
>current DNS to one that does not require typing some ASCII characters in 
>one go. I think these things must evolve, over time.

Dear Erik,
the "two keyboard" formula is a common nickname of the IDNs in non ASCII 
countries.

>>Registries understand nothing to the complex signals (or lack of) from 
>>the ICANN, IETF, market, etc. I am on the WG-IDN of the ccTLDs as a 
>>lingual organization (Eurolinc). I suppose there is one year I received 
>>the last mail. 2 mails in one year++ on ICANN IDN list. They even told me 
>>James Seng does not attend all the ICANN IDN meetings (James?) anymore.
>
>The ICANN guidelines for IDNs probably should be updated. People are 
>talking about this. Hopefully it will happen quite soon.
>
>>James sold us something brillant in MdR2000. But the IETF delivered 
>>something else.
>
>Are you talking about the following?
>
>http://www.dnso.org/dnso/notes/20011112.ICANN-mdr-IDN-JamesSeng.ppt

This looks 2001. I mean 2000. It was a great time when many things came to 
a decision.

>>PADs are obviously the core of the problem and a revolution. Handles 
>>could also be used.
>>In case you forgot about PAD I documented several times, it stands for 
>>Private Alias Directory. This is the Directory of the ML keywords or DN 
>>you can register in your own system to call an external host. This is a 
>>Quick and Dirty excellent solution when an IP address is available. What 
>>will be the case with IPv6 and that main sites can obviously already support.
>
>Maybe people will manually create a few private aliases, but I doubt they 
>would bother to do so for the many, many sites on the Internet. People 
>visit many sites, one after the other, in quick succession. Maybe I'm 
>misunderstanding you...

I am afraid you missed the point. I work on PADs, for security reason. Even 
if there is a DNS dysfunction you keep going through. For the time being 
this is used for security. I documented that at length in Nov. 2003 when 
preparing meetings on nations vulnerability to the Internet. When our tools 
are ready and tested we will have to release them. But I am sure nice kids 
will make them running before. Anyway, this will be like RSS tags on web 
pages. You click and you have the keyword entered in your PAD. This gives 
the site an edge on others: a free keyword in 7260 language, 20000 dialects 
and an infinity of nicknames. Far cheaper than Real Names.

The main problem is to keep them someway consistent with the other name 
space systems.

>>There are several revolutions right now. Just look at the network, the 
>>behaviors and the people. A revolution does not mean an immediate tide. 
>>It means that something we did one way can be done another way, that it 
>>has started being used and that it will only grow. IDNA is not a revolution.
>
>I don't see very many signs of a PAD revolution. Am I in the wrong country 
>(USA)? The wrong mailing list?

You could come on our mailing list. It is in French. But we will sell 
expertise and may be a product to pay for the study. ISP will offer the 
service. I suppose we will publish lists of PAD infos. But this comes to be 
interesting with IPv6. And competition about IP numbers. NRO will love it. 
NRO first provider of ML keywords :-)

>>Naming was left to right first. ARPANET naming was flat and for practical 
>>reason became right to left. It stayed that way. Your proposal works. 
>>Left to right and / separators. I understand there are already 15 
>>millions of them. Named handles.
>
>I don't see them. Do people exchange handles via email? Please show me a 
>handle.

Ask Library of Congress etc. This is Bob Khan's system.
RFC 3650, 3651, 3652. IMHO you are going to love it!

>>A revolution is that less than 50% of the Internet connections still use 
>>the DNS,
>
>Are you saying that less than 50% of the TCP connections on the "Internet" 
>(open Internet or also behind the firewall?) are immediately preceded by a 
>DNS lookup? Where did you get this number from? Please state your source.

Sorry come in the real network land, Europe :-)
This information is probably available everywhere. The authoritative source 
I have is the Chair of AFNIC using notes prepared by Stephane Bortzmeyer. I 
use to trust Stephane.

>>that handles develop, that PADs permits private keywords and ultimately 
>>billions of roots.
>
>Are there any specs for these handles and PADs? Are there any working groups?

Handles is CNRI. IESG expressed a comment which says "not IETF consensus, 
yet it works". Same for PAD, I will not bother writting a Draft, I will 
leave the market using it. Look what they did with our RFC 920 MoU :-)

>>Just a question: when was that the last time you supported a registrant 
>>for his server to be accessed with the DN he just registered?
>>This do help to understand what the people want and do.
>
>Do your registrants use PADs? Are they happy with them?

You kidding? PADs are free.
This is the problem for a Registry!

But this is also something users tend to like. Also that it works. Aslo 
that is simple. Even if Microsoft does not help the programing. But old 
Hosts.txt works well as a starter.
jfc





>Erik
>




From owner-idn@ops.ietf.org  Thu Mar 17 10:44:32 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id KAA14289
	for <idn-archive@lists.ietf.org>; Thu, 17 Mar 2005 10:44:32 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBx3o-00006B-VG
	for idn-data@psg.com; Thu, 17 Mar 2005 15:37:20 +0000
Received: from [32.97.110.132] (helo=e34.co.us.ibm.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DBx3j-000051-Av
	for idn@ops.ietf.org; Thu, 17 Mar 2005 15:37:15 +0000
Received: from westrelay02.boulder.ibm.com (westrelay02.boulder.ibm.com [9.17.195.11])
	by e34.co.us.ibm.com (8.12.10/8.12.9) with ESMTP id j2HFbDKN387968
	for <idn@ops.ietf.org>; Thu, 17 Mar 2005 10:37:13 -0500
Received: from d03av02.boulder.ibm.com (d03av02.boulder.ibm.com [9.17.195.168])
	by westrelay02.boulder.ibm.com (8.12.10/NCO/VER6.6) with ESMTP id j2HFbD8I242112
	for <idn@ops.ietf.org>; Thu, 17 Mar 2005 08:37:13 -0700
Received: from d03av02.boulder.ibm.com (loopback [127.0.0.1])
	by d03av02.boulder.ibm.com (8.12.11/8.12.11) with ESMTP id j2HFbCws008318
	for <idn@ops.ietf.org>; Thu, 17 Mar 2005 08:37:13 -0700
Received: from markdavis (sig-9-48-122-162.mts.ibm.com [9.48.122.162])
	by d03av02.boulder.ibm.com (8.12.11/8.12.11) with SMTP id j2HFbBsE008246;
	Thu, 17 Mar 2005 08:37:12 -0700
Message-ID: <33c401c52b07$3004e600$477d3009@sanjose.ibm.com>
From: "Mark Davis" <mark.davis@jtcsv.com>
To: "John C Klensin" <klensin@jck.com>,
        "IETF idn working group" <idn@ops.ietf.org>
References:  <20050316221337.GB25580~@nicemice.net> <052C0407EAFFC3AC92D2D7D9@7AD4D3FB4841A5E367CCF211>
Subject: Re: [idn] IDNA section 3.1 requirement 3
Date: Thu, 17 Mar 2005 07:37:11 -0800
MIME-Version: 1.0
Content-Type: text/plain;
	charset="utf-8"
Content-Transfer-Encoding: 8bit
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1437
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1441
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.5 required=5.0 tests=AWL,BAYES_00,
	MAILTO_TO_REMOVE autolearn=ham version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 8bit

I agree with John. Use of the raw punycode in place of the represented
characters will cause more user confusion, not less. User sees:

xn--tlralit-byabbe.fr versus xn--tlralit-byabb390f.fr

Presented with a collection of apparently random letters, eyes quickly glaze
over, and people really can't distinguish between two names in any sensible
fashion. Users are not going to memorize which gobbledygook is the one they
want. And this is, over course, vastly magnified once you are outside of
Latin script IDNs.

While I agree on the need to present some mechanism for distinguishing cases
(see tr36), raw punycode is not a good choice. It would even be better to
present raw IP addresses (not that I am really suggesting that).

â€ŽMark

----- Original Message ----- 
From: "John C Klensin" <klensin@jck.com>
To: "IETF idn working group" <idn@ops.ietf.org>
Sent: Wednesday, March 16, 2005 15:43
Subject: Re: [idn] IDNA section 3.1 requirement 3


> Adam,
>
> I see where you are going here, but, to some considerable
> extent, I think it is a waste of time or worse.
>
> Please take a step back from looking at coding, disclaimers, and
> this type of recommendation and put yourself into the place of
> the application developer who, other than the registrars and
> registries, is the market for the IDNA technology.  Those
> application developers, at least the ones who intend to survive,
> are quite sensitive to user reactions: users who are unhappy
> with user interfaces tend to have thoughts about going
> elsewhere.  The IETF has, for years, avoided getting involved
> with user interface design for many reasons; being the source of
> that unhappiness is one of the reasons.
>
> You are now proposing to transform an IDNA rule that, given
> contemporary operating system and display designs, was
> essentially meaningless (but harmless) into a fairly complex set
> of rules.  If the current rule contracted the experience
> application designers wanted to deliver to their users, they
> would ignore it... and have been doing so.  If the new rule is
> at variance with the target experience, it, too, will be ignored.
>
> Let's look at a few of the things we know about user behavior
> and reactions:
>
>     * They do not like looking at punycode or similar "no
>     obvious meaning" and/or "ugly" constructions.  If too much
>     of it is displayed, they will be unhappy.
>
>     * They don't like the unpredictable and unexpected.  If they
>     are used to seeing native characters and punycode suddenly
>     pops up, there had better be a good, and plausible, and
>     immediately accessible explanation.
>
>     * They get really irritated with repeated and intrusive
>     warnings that they don't know how to interpret and what to
>     do about.  With too many pop-up alerts, the usual response
>     is to click "ok" every time and to go looking for a way to
>     shut the alerts off.  Given that there are many legitimate
>     cases that fall into your "display punycode" categories,
>     especially in the vicinity of certain scripts and languages,
>     the application would generate a lot of false positives and
>     the user would learn to ignore whatever is written there.
>
> Make whatever suggestions and recommendations you think
> appropriate, but wrapping them in conformance language about
> what SHOULD/MUST be done just brings discredit on the protocol/
> algorithm core of IDNA.
>
> Just my opinion.
>
>      john
>
> --On Wednesday, March 16, 2005 10:13 PM +0000 "Adam M. Costello"
> <idn.amc+0@nicemice.net.RemoveThisWord> wrote:
>
> > Consider a domain name containing a slash-homograph.
> >
> > As it stands, IDNA section 3.1 requirement 3 tells
> > applications that they "SHOULD" display the non-ACE form.  The
> > security considerations section, much later, "suggests" that
> > applications provide visual indications of various anomalies
> > (from which one could extrapolate that the slash-homograph
> > would benefit from a visual indication).
> >
> > I think we've seen that these security concerns need to be
> > less buried, that "visual indications" are too burdensome on
> > implementations, and that in some cases (like this one) the
> > recommendation to display the non-ACE form ought to be
> > withdrawn, or even reversed (that is, recommend the ASCII
> > form).
> >
> > There I propose a technical change to IDNA section 3.1
> > requirement 3. For reference, here it is as it stands now in
> > RFC-3490 (with one typo corrected):
> >
> >    3) ACE labels obtained from domain name slots SHOULD be
> > hidden from       users when it is known that the environment
> > can handle the non-ACE       form, except when the ACE form is
> > explicitly requested.  When       it is not known whether or
> > not the environment can handle the       non-ACE form, the
> > application MAY use the non-ACE form (which       might fail,
> > such as by not being displayed properly), or it MAY       use
> > the ACE form (which will look unintelligible to the user).
> > Given an internationalized domain name, an equivalent domain
> > name       containing no ACE labels can be obtained by
> > applying the ToUnicode       operation (see section 4) to each
> > label.  When requirements 2 and       3 both apply,
> > requirement 2 takes precedence.
> >
> > Here is my proposed replacement:
> >
> > --begin--
> >
> >    3) When a domain label occupying or obtained from a domain
> > name       slot is to be shown to a user, it SHOULD NOT simply
> > be shown in       whatever form it was found in; before being
> > shown it SHOULD be       forced into either ASCII form (which
> > can be obtained by applying       ToASCII) or non-ACE form
> > (which can be obtained by applying       ToUnicode, see
> > section 4), according to the first applicable of       the
> > following rules:
> >
> >       a) If requirements 2 and 3 both apply, requirement 2
> > takes          precedence, and the ASCII form MUST be used.
> >
> >       b) When the user has explicitly requested to see one
> > form or the          other, that form SHOULD be shown.
> >
> >       c) When it is known that the environment cannot handle
> > the non-ACE          form, the ASCII form SHOULD be shown.
> >
> >       d) If the non-ACE form contains any character outside
> > Unicode          categories L (letter), N (number), and M
> > (mark), other than          U+002D hyphen-minus, the ACE form
> > SHOULD be shown.
> >
> >       e) If the application determines that showing the
> > non-ACE form          would pose too great a risk of
> > misleading the user, the ASCII          form MAY be shown.
> > Applications MAY use complex heuristics to          estimate
> > this risk, but SHOULD try to minimize the negative
> > impact on legitimate usage of internationalized domain names.
> >
> >       f) When it is not known whether the environment can
> > handle the          non-ACE form, the application MAY show the
> > non-ACE form (which          might fail, such as by not being
> > displayed properly), or it MAY          show the ASCII form
> > (which will look unintelligible to the user          if it is
> > an ACE).
> >
> >       g) In general, when rules a-f do not apply, the non-ACE
> > form          SHOULD be shown.
> >
> >       Rules c, d, and e above apply tests to "the" non-ACE
> > form, but       in fact there can be many non-ACE forms that
> > differ only in       capitalization and/or normalization.  If
> > a given non-ACE label       fails some test, it MAY be
> > converted to an equivalent non-ACE       label by applying the
> > map and/or normalize steps of [NAMEPREP] (or       all the
> > steps), and then given another chance to pass the test.
> >
> > --end--
> >
> > Thoughts?
> >
> > AMC
> >
> >
>
>
>
>
>
>




From owner-idn@ops.ietf.org  Thu Mar 17 12:56:52 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id MAA00212
	for <idn-archive@lists.ietf.org>; Thu, 17 Mar 2005 12:56:51 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DBzB5-000H46-7P
	for idn-data@psg.com; Thu, 17 Mar 2005 17:52:59 +0000
Received: from [208.184.76.39] (helo=above.proper.com)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DBzB3-000H3j-7w
	for idn@ops.ietf.org; Thu, 17 Mar 2005 17:52:57 +0000
Received: from [10.20.30.249] (dsl2-63-249-109-245.cruzio.com [63.249.109.245])
	(authenticated bits=0)
	by above.proper.com (8.12.11/8.12.9) with ESMTP id j2HHqt2l061224
	for <idn@ops.ietf.org>; Thu, 17 Mar 2005 09:52:56 -0800 (PST)
	(envelope-from phoffman@imc.org)
Mime-Version: 1.0
Message-Id: <p0621027abe5f6eaa4ccf@[10.20.30.249]>
In-Reply-To: <20050317063435.GA26106~@nicemice.net>
References: <20050316221337.GB25580~@nicemice.net>
 <052C0407EAFFC3AC92D2D7D9@7AD4D3FB4841A5E367CCF211>
 <20050316221337.GB25580~@nicemice.net>
 <p06210260be5e6f4e2379@[10.20.30.249]>
 <20050317063435.GA26106~@nicemice.net>
Date: Thu, 17 Mar 2005 09:53:15 -0800
To: IETF idn working group <idn@ops.ietf.org>
From: Paul Hoffman <phoffman@imc.org>
Subject: Re: [idn] IDNA section 3.1 requirement 3
Content-Type: text/plain; charset="us-ascii" ; format="flowed"
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

At 6:34 AM +0000 3/17/05, Adam M. Costello wrote:
>Paul Hoffman <phoffman@imc.org> wrote:
>
>>  Question: when faced with an incomprehensible domain name with no
>>  visual indications, do you think that typical users will know what to
>>  do, or even what to be cautious of?
>
>No, but they don't need to do anything special or use any more caution
>than they would with any domain name that they didn't recognize.  As
>long as they don't see "paypal" or whatever, they're at least not being
>misled.

The example given at the start of your message was the 
homograph-slash. A spoof domain name that has that character and 
"paypal" will *still* display "paypal" in the Punycode. It will only 
truly work for names where the base script is not ASCII. It also 
relies heavily on browser makers ability to decide which mixed-script 
combinations are OK, and which are not, without giving them any 
guidance.

>  > Adam: could you think more about it and see how it would look if
>>  thought visual assistance was an option?
>
>Suspicious characters could be shown in red, or highlighted, or with
>squiggly underlines.  But the risk with any such scheme is that the
>misleading text is still visible, so if the user doesn't take the
>hint, they might still be misled.

Of course. That is weighed against the user not being able to read 
what was presented at all.

For example, if a browser erroneously decided that Chinese was 
undisplayable on the device (option "c"), the user would only see 
something that didn't look like what the originator had used and 
would not be able to decide whether to accept it or not. This would 
force browser makers to check which characters were displayable each 
time it launched. Similarly, if the logic in option "e" is wrong, the 
user would never be able to view the legitimate name.

>   And these approaches would be
>less effective or impossible on monochrome displays or in tty-based
>applications.

Highlights and squiggly underlines show up fine in monochrome. 
TTY-based applications generally can't display IDNs faithfully anyway 
due to lack of sufficient pixels; developers on those systems need to 
make other design decisions anyhow.

>Another option is to show the suspicious characters using the
>replacement glyph (hollow rectangle), but then cut-and-paste might
>break, unless it's really clever.

As you remember from a few years ago, cut-and-paste often doesn't 
work reliably with non-ASCII characters even under good conditions. 
This seems like a red herring.

>I proposed the show-ACE approach because it's simpler to implement and
>it's obviously effective regardless of the display technology.

It is effective at making some IDNs unreadable. That helps in the 
case of spoofed IDNs, and hurts in the case of legitimate IDNs.

>John C Klensin <klensin@jck.com> wrote:
>
>>  Let's look at a few of the things we know about user behavior
>>  and reactions:
>>
>>     * They do not like looking at punycode or similar "no
>>     obvious meaning" and/or "ugly" constructions.  If too much
>>     of it is displayed, they will be unhappy.
>
>I agree.  If enough browsers implement the proposal, no one will have a
>motive to use domain labels that would show as ACE, and therefore users
>will see ACE very rarely.

That statement is predicated on browser makers across the world 
agreeing on how to implement option "e". That may be a tad 
optimistic. If you're wrong, it will cause IDNs in general to be 
useless due to their instability of viewing.

--Paul Hoffman, Director
--Internet Mail Consortium



From owner-idn@ops.ietf.org  Thu Mar 17 14:26:36 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id OAA10098
	for <idn-archive@lists.ietf.org>; Thu, 17 Mar 2005 14:26:36 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DC0ZY-0002Zc-OG
	for idn-data@psg.com; Thu, 17 Mar 2005 19:22:20 +0000
Received: from [209.187.148.211] (helo=bs.jck.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DC0ZU-0002YK-7w
	for idn@ops.ietf.org; Thu, 17 Mar 2005 19:22:16 +0000
Received: from [209.187.148.215] (helo=scan.jck.com)
	by bs.jck.com with esmtp (Exim 4.34)
	id 1DC0ZT-000HW1-1A; Thu, 17 Mar 2005 14:22:15 -0500
Date: Thu, 17 Mar 2005 14:22:14 -0500
From: John C Klensin <klensin@jck.com>
To: Mark Davis <mark.davis@jtcsv.com>,
        IETF idn working group <idn@ops.ietf.org>
Subject: Re: [idn] IDNA section 3.1 requirement 3
Message-ID: <DCA85A0719E37431D3C99DC8@scan.jck.com>
In-Reply-To: <33c401c52b07$3004e600$477d3009@sanjose.ibm.com>
References:  <20050316221337.GB25580~@nicemice.net>
 <052C0407EAFFC3AC92D2D7D9@7AD4D3FB4841A5E367CCF211>
 <33c401c52b07$3004e600$477d3009@sanjose.ibm.com>
X-Mailer: Mulberry/3.1.6 (Win32)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit



--On Thursday, 17 March, 2005 07:37 -0800 Mark Davis
<mark.davis@jtcsv.com> wrote:

> I agree with John. Use of the raw punycode in place of the
> represented characters will cause more user confusion, not
> less. User sees:
> 
> xn--tlralit-byabbe.fr versus xn--tlralit-byabb390f.fr
> 
> Presented with a collection of apparently random letters, eyes
> quickly glaze over, and people really can't distinguish
> between two names in any sensible fashion. Users are not going
> to memorize which gobbledygook is the one they want. And this
> is, over course, vastly magnified once you are outside of
> Latin script IDNs.
> 
> While I agree on the need to present some mechanism for
> distinguishing cases (see tr36), raw punycode is not a good
> choice. It would even be better to present raw IP addresses
> (not that I am really suggesting that).

I'm glad you are not, because it would cause harm and would be
unlikely to help much.  Even getting an address and
reverse-mapping wouldn't help a lot: the phishers would have
more difficulty getting hold of an appropriate reverse-mapping
delegation than the forward one, but probably not much more
difficulty.

It is probably worth noting that, in a UI context, the
punctuation problem (especially the "/" homograph version) may
not as severe as it appears.  Remembering that I don't believe
there are "solutions" to these problems, but only ways to chip
away at them, suppose that browsers and other applications that
process and present URIs (or IRIs) started parsing and coloring
them according to the parse.  No tricks about analysis of the
IDN -- just do it for everything.  And maybe color isn't the
right answer: perhaps we should borrow a note from publication
Algol and use a bold type.  So, for http://ops.ietf.org/idn, the
use would see "http://", and the "/" after "org", in bold and
the domain name and tail as normal text.  Once a user got used
to looking at that style of presentation, a homograph-"/" spoof
would stand out as highly unusual at best.  That certainly is
not a magic bullet.  It requires that users be reasonably alert
to the unusual, but that is the critical first line of defense
against phishing and similar attacks anyway.  It doesn't involve
warning messages or overwhelming the user with gibberish where
names are expected.  And maybe it is a little more in the
direction of the sort of things we should be thinking about.

best,
   john





From owner-idn@ops.ietf.org  Thu Mar 17 14:56:23 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id OAA13085
	for <idn-archive@lists.ietf.org>; Thu, 17 Mar 2005 14:56:22 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DC12e-0006PF-Ot
	for idn-data@psg.com; Thu, 17 Mar 2005 19:52:24 +0000
Received: from [32.97.110.129] (helo=e31.co.us.ibm.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DC12W-0006Ng-Bv
	for idn@ops.ietf.org; Thu, 17 Mar 2005 19:52:16 +0000
Received: from westrelay02.boulder.ibm.com (westrelay02.boulder.ibm.com [9.17.195.11])
	by e31.co.us.ibm.com (8.12.10/8.12.9) with ESMTP id j2HJqFua507782
	for <idn@ops.ietf.org>; Thu, 17 Mar 2005 14:52:15 -0500
Received: from d03av02.boulder.ibm.com (d03av02.boulder.ibm.com [9.17.195.168])
	by westrelay02.boulder.ibm.com (8.12.10/NCO/VER6.6) with ESMTP id j2HJqE8I197838
	for <idn@ops.ietf.org>; Thu, 17 Mar 2005 12:52:14 -0700
Received: from d03av02.boulder.ibm.com (loopback [127.0.0.1])
	by d03av02.boulder.ibm.com (8.12.11/8.12.11) with ESMTP id j2HJqDnQ022798
	for <idn@ops.ietf.org>; Thu, 17 Mar 2005 12:52:14 -0700
Received: from markdavis (sig-9-48-122-162.mts.ibm.com [9.48.122.162])
	by d03av02.boulder.ibm.com (8.12.11/8.12.11) with SMTP id j2HJqC5B022743;
	Thu, 17 Mar 2005 12:52:13 -0700
Message-ID: <34bc01c52b2a$d01efe00$477d3009@sanjose.ibm.com>
From: "Mark Davis" <mark.davis@jtcsv.com>
To: "John C Klensin" <klensin@jck.com>,
        "IETF idn working group" <idn@ops.ietf.org>
References:  <20050316221337.GB25580~@nicemice.net> <052C0407EAFFC3AC92D2D7D9@7AD4D3FB4841A5E367CCF211> <33c401c52b07$3004e600$477d3009@sanjose.ibm.com> <DCA85A0719E37431D3C99DC8@scan.jck.com>
Subject: Re: [idn] IDNA section 3.1 requirement 3
Date: Thu, 17 Mar 2005 11:52:12 -0800
MIME-Version: 1.0
Content-Type: text/plain;
	charset="utf-8"
Content-Transfer-Encoding: 8bit
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1437
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1441
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.1 required=5.0 tests=AWL,BAYES_00,URIBL_SBL 
	autolearn=no version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 8bit

I agree. See also http://www.unicode.org/reports/tr36/draft/, where there
was already something along those lines.

â€ŽMark

----- Original Message ----- 
From: "John C Klensin" <klensin@jck.com>
To: "Mark Davis" <mark.davis@jtcsv.com>; "IETF idn working group"
<idn@ops.ietf.org>
Sent: Thursday, March 17, 2005 11:22
Subject: Re: [idn] IDNA section 3.1 requirement 3


>
>
> --On Thursday, 17 March, 2005 07:37 -0800 Mark Davis
> <mark.davis@jtcsv.com> wrote:
>
> > I agree with John. Use of the raw punycode in place of the
> > represented characters will cause more user confusion, not
> > less. User sees:
> >
> > xn--tlralit-byabbe.fr versus xn--tlralit-byabb390f.fr
> >
> > Presented with a collection of apparently random letters, eyes
> > quickly glaze over, and people really can't distinguish
> > between two names in any sensible fashion. Users are not going
> > to memorize which gobbledygook is the one they want. And this
> > is, over course, vastly magnified once you are outside of
> > Latin script IDNs.
> >
> > While I agree on the need to present some mechanism for
> > distinguishing cases (see tr36), raw punycode is not a good
> > choice. It would even be better to present raw IP addresses
> > (not that I am really suggesting that).
>
> I'm glad you are not, because it would cause harm and would be
> unlikely to help much.  Even getting an address and
> reverse-mapping wouldn't help a lot: the phishers would have
> more difficulty getting hold of an appropriate reverse-mapping
> delegation than the forward one, but probably not much more
> difficulty.
>
> It is probably worth noting that, in a UI context, the
> punctuation problem (especially the "/" homograph version) may
> not as severe as it appears.  Remembering that I don't believe
> there are "solutions" to these problems, but only ways to chip
> away at them, suppose that browsers and other applications that
> process and present URIs (or IRIs) started parsing and coloring
> them according to the parse.  No tricks about analysis of the
> IDN -- just do it for everything.  And maybe color isn't the
> right answer: perhaps we should borrow a note from publication
> Algol and use a bold type.  So, for http://ops.ietf.org/idn, the
> use would see "http://", and the "/" after "org", in bold and
> the domain name and tail as normal text.  Once a user got used
> to looking at that style of presentation, a homograph-"/" spoof
> would stand out as highly unusual at best.  That certainly is
> not a magic bullet.  It requires that users be reasonably alert
> to the unusual, but that is the critical first line of defense
> against phishing and similar attacks anyway.  It doesn't involve
> warning messages or overwhelming the user with gibberish where
> names are expected.  And maybe it is a little more in the
> direction of the sort of things we should be thinking about.
>
> best,
>    john
>
>
>




From owner-idn@ops.ietf.org  Thu Mar 17 16:53:10 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id QAA24491
	for <idn-archive@lists.ietf.org>; Thu, 17 Mar 2005 16:53:09 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DC2pA-000JR8-6u
	for idn-data@psg.com; Thu, 17 Mar 2005 21:46:36 +0000
Received: from [203.117.75.21] (helo=red-aura.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DC2oT-000JMS-7X
	for idn@ops.ietf.org; Thu, 17 Mar 2005 21:45:53 +0000
Received: (qmail 43845 invoked from network); 17 Mar 2005 21:49:12 -0000
Received: from ip2.globalevents.iinet.com (HELO ?10.10.10.185?) (jseng@70.97.79.2)
  by red-aura.com with RC4-SHA encrypted SMTP; 17 Mar 2005 21:49:12 -0000
In-Reply-To: <33c401c52b07$3004e600$477d3009@sanjose.ibm.com>
References: <20050316221337.GB25580~@nicemice.net> <052C0407EAFFC3AC92D2D7D9@7AD4D3FB4841A5E367CCF211> <33c401c52b07$3004e600$477d3009@sanjose.ibm.com>
Mime-Version: 1.0 (Apple Message framework v619.2)
Content-Type: text/plain; charset=US-ASCII; format=flowed
Message-Id: <d2147318025fd1185c61ac26c8998ea3@seng.cc>
Content-Transfer-Encoding: 7bit
Cc: "IETF idn working group" <idn@ops.ietf.org>,
        "John C Klensin" <klensin@jck.com>
From: James Seng <james@seng.cc>
Subject: Re: [idn] IDNA section 3.1 requirement 3
Date: Fri, 18 Mar 2005 05:45:49 +0800
To: "Mark Davis" <mark.davis@jtcsv.com>
X-Mailer: Apple Mail (2.619.2)
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-1.9 required=5.0 tests=AWL,BAYES_00,
	MAILTO_TO_REMOVE autolearn=ham version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

I agree that that the discussion on how to represent the IDNs correctly 
to the users on the apps is very important given the recently spoofing 
attack.

I am also concern about "standardizing" how applications should flag 
out IDN or determine dangerous IDNs etc. I dont see why we need 
standardization in this area when we never really standardize the "lock 
icon" for https or etc. Instead, I think we should let market force 
work this out, and lets apps developers innovates on how to display 
these IDN properly.

OTOH, I think it is useful to document the considerations.

Does this confuse anyone?

-James Seng

On 17-Mar-05, at PM 11:37, Mark Davis wrote:

> I agree with John. Use of the raw punycode in place of the represented
> characters will cause more user confusion, not less. User sees:
>
> xn--tlralit-byabbe.fr versus xn--tlralit-byabb390f.fr
>
> Presented with a collection of apparently random letters, eyes quickly 
> glaze
> over, and people really can't distinguish between two names in any 
> sensible
> fashion. Users are not going to memorize which gobbledygook is the one 
> they
> want. And this is, over course, vastly magnified once you are outside 
> of
> Latin script IDNs.
>
> While I agree on the need to present some mechanism for distinguishing 
> cases
> (see tr36), raw punycode is not a good choice. It would even be better 
> to
> present raw IP addresses (not that I am really suggesting that).
>
> Mark
>
> ----- Original Message -----
> From: "John C Klensin" <klensin@jck.com>
> To: "IETF idn working group" <idn@ops.ietf.org>
> Sent: Wednesday, March 16, 2005 15:43
> Subject: Re: [idn] IDNA section 3.1 requirement 3
>
>
>> Adam,
>>
>> I see where you are going here, but, to some considerable
>> extent, I think it is a waste of time or worse.
>>
>> Please take a step back from looking at coding, disclaimers, and
>> this type of recommendation and put yourself into the place of
>> the application developer who, other than the registrars and
>> registries, is the market for the IDNA technology.  Those
>> application developers, at least the ones who intend to survive,
>> are quite sensitive to user reactions: users who are unhappy
>> with user interfaces tend to have thoughts about going
>> elsewhere.  The IETF has, for years, avoided getting involved
>> with user interface design for many reasons; being the source of
>> that unhappiness is one of the reasons.
>>
>> You are now proposing to transform an IDNA rule that, given
>> contemporary operating system and display designs, was
>> essentially meaningless (but harmless) into a fairly complex set
>> of rules.  If the current rule contracted the experience
>> application designers wanted to deliver to their users, they
>> would ignore it... and have been doing so.  If the new rule is
>> at variance with the target experience, it, too, will be ignored.
>>
>> Let's look at a few of the things we know about user behavior
>> and reactions:
>>
>>     * They do not like looking at punycode or similar "no
>>     obvious meaning" and/or "ugly" constructions.  If too much
>>     of it is displayed, they will be unhappy.
>>
>>     * They don't like the unpredictable and unexpected.  If they
>>     are used to seeing native characters and punycode suddenly
>>     pops up, there had better be a good, and plausible, and
>>     immediately accessible explanation.
>>
>>     * They get really irritated with repeated and intrusive
>>     warnings that they don't know how to interpret and what to
>>     do about.  With too many pop-up alerts, the usual response
>>     is to click "ok" every time and to go looking for a way to
>>     shut the alerts off.  Given that there are many legitimate
>>     cases that fall into your "display punycode" categories,
>>     especially in the vicinity of certain scripts and languages,
>>     the application would generate a lot of false positives and
>>     the user would learn to ignore whatever is written there.
>>
>> Make whatever suggestions and recommendations you think
>> appropriate, but wrapping them in conformance language about
>> what SHOULD/MUST be done just brings discredit on the protocol/
>> algorithm core of IDNA.
>>
>> Just my opinion.
>>
>>      john
>>
>> --On Wednesday, March 16, 2005 10:13 PM +0000 "Adam M. Costello"
>> <idn.amc+0@nicemice.net.RemoveThisWord> wrote:
>>
>>> Consider a domain name containing a slash-homograph.
>>>
>>> As it stands, IDNA section 3.1 requirement 3 tells
>>> applications that they "SHOULD" display the non-ACE form.  The
>>> security considerations section, much later, "suggests" that
>>> applications provide visual indications of various anomalies
>>> (from which one could extrapolate that the slash-homograph
>>> would benefit from a visual indication).
>>>
>>> I think we've seen that these security concerns need to be
>>> less buried, that "visual indications" are too burdensome on
>>> implementations, and that in some cases (like this one) the
>>> recommendation to display the non-ACE form ought to be
>>> withdrawn, or even reversed (that is, recommend the ASCII
>>> form).
>>>
>>> There I propose a technical change to IDNA section 3.1
>>> requirement 3. For reference, here it is as it stands now in
>>> RFC-3490 (with one typo corrected):
>>>
>>>    3) ACE labels obtained from domain name slots SHOULD be
>>> hidden from       users when it is known that the environment
>>> can handle the non-ACE       form, except when the ACE form is
>>> explicitly requested.  When       it is not known whether or
>>> not the environment can handle the       non-ACE form, the
>>> application MAY use the non-ACE form (which       might fail,
>>> such as by not being displayed properly), or it MAY       use
>>> the ACE form (which will look unintelligible to the user).
>>> Given an internationalized domain name, an equivalent domain
>>> name       containing no ACE labels can be obtained by
>>> applying the ToUnicode       operation (see section 4) to each
>>> label.  When requirements 2 and       3 both apply,
>>> requirement 2 takes precedence.
>>>
>>> Here is my proposed replacement:
>>>
>>> --begin--
>>>
>>>    3) When a domain label occupying or obtained from a domain
>>> name       slot is to be shown to a user, it SHOULD NOT simply
>>> be shown in       whatever form it was found in; before being
>>> shown it SHOULD be       forced into either ASCII form (which
>>> can be obtained by applying       ToASCII) or non-ACE form
>>> (which can be obtained by applying       ToUnicode, see
>>> section 4), according to the first applicable of       the
>>> following rules:
>>>
>>>       a) If requirements 2 and 3 both apply, requirement 2
>>> takes          precedence, and the ASCII form MUST be used.
>>>
>>>       b) When the user has explicitly requested to see one
>>> form or the          other, that form SHOULD be shown.
>>>
>>>       c) When it is known that the environment cannot handle
>>> the non-ACE          form, the ASCII form SHOULD be shown.
>>>
>>>       d) If the non-ACE form contains any character outside
>>> Unicode          categories L (letter), N (number), and M
>>> (mark), other than          U+002D hyphen-minus, the ACE form
>>> SHOULD be shown.
>>>
>>>       e) If the application determines that showing the
>>> non-ACE form          would pose too great a risk of
>>> misleading the user, the ASCII          form MAY be shown.
>>> Applications MAY use complex heuristics to          estimate
>>> this risk, but SHOULD try to minimize the negative
>>> impact on legitimate usage of internationalized domain names.
>>>
>>>       f) When it is not known whether the environment can
>>> handle the          non-ACE form, the application MAY show the
>>> non-ACE form (which          might fail, such as by not being
>>> displayed properly), or it MAY          show the ASCII form
>>> (which will look unintelligible to the user          if it is
>>> an ACE).
>>>
>>>       g) In general, when rules a-f do not apply, the non-ACE
>>> form          SHOULD be shown.
>>>
>>>       Rules c, d, and e above apply tests to "the" non-ACE
>>> form, but       in fact there can be many non-ACE forms that
>>> differ only in       capitalization and/or normalization.  If
>>> a given non-ACE label       fails some test, it MAY be
>>> converted to an equivalent non-ACE       label by applying the
>>> map and/or normalize steps of [NAMEPREP] (or       all the
>>> steps), and then given another chance to pass the test.
>>>
>>> --end--
>>>
>>> Thoughts?
>>>
>>> AMC
>>>
>>>
>>
>>
>>
>>
>>
>>
>
>




From owner-idn@ops.ietf.org  Thu Mar 17 19:18:28 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id TAA06964
	for <idn-archive@lists.ietf.org>; Thu, 17 Mar 2005 19:18:27 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DC568-0009f9-0s
	for idn-data@psg.com; Fri, 18 Mar 2005 00:12:16 +0000
Received: from [193.201.200.34] (helo=tuschin.blackcatnetworks.co.uk)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DC566-0009eg-Tn
	for idn@ops.ietf.org; Fri, 18 Mar 2005 00:12:15 +0000
Received: from grmarkham.plus.com ([80.229.30.161] helo=[192.168.1.100])
	by tuschin.blackcatnetworks.co.uk with asmtp (Exim 3.35 #1 (Debian))
	id 1DC52y-0002f6-00; Fri, 18 Mar 2005 00:09:01 +0000
Message-ID: <423A1C18.2020305@mozilla.org>
Date: Fri, 18 Mar 2005 00:08:56 +0000
From: Gervase Markham <gerv@mozilla.org>
Organization: mozilla.org
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: James Seng <james@seng.cc>
CC: Mark Davis <mark.davis@jtcsv.com>,
        IETF idn working group <idn@ops.ietf.org>,
        John C Klensin <klensin@jck.com>
Subject: Re: [idn] IDNA section 3.1 requirement 3
References: <20050316221337.GB25580~@nicemice.net> <052C0407EAFFC3AC92D2D7D9@7AD4D3FB4841A5E367CCF211> <33c401c52b07$3004e600$477d3009@sanjose.ibm.com> <d2147318025fd1185c61ac26c8998ea3@seng.cc>
In-Reply-To: <d2147318025fd1185c61ac26c8998ea3@seng.cc>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.3 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

James Seng wrote:
> I am also concern about "standardizing" how applications should flag out 
> IDN or determine dangerous IDNs etc. I dont see why we need 
> standardization in this area when we never really standardize the "lock 
> icon" for https or etc. Instead, I think we should let market force work 
> this out, and lets apps developers innovates on how to display these IDN 
> properly.

I'm afraid I disagree. I was having dinner with some Microsoft security 
guys only this evening where we agreed that having the lock as a 
standard image really helped, but now we need to move to a slightly more 
fine-grained model and it would be extremely useful if everyone used the 
same notations for the new trust states.

Having said that, I believe that if we get to a situation where we need 
to "flag out IDN", we've failed.

Gerv



From owner-idn@ops.ietf.org  Fri Mar 18 13:46:55 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id NAA09395
	for <idn-archive@lists.ietf.org>; Fri, 18 Mar 2005 13:46:55 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DCMNK-000Bdx-I7
	for idn-data@psg.com; Fri, 18 Mar 2005 18:39:10 +0000
Received: from [207.115.63.98] (helo=pimout4-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DCMNI-000BdT-Jj
	for idn@ops.ietf.org; Fri, 18 Mar 2005 18:39:08 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout4-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2IId35K131318;
	Fri, 18 Mar 2005 13:39:03 -0500
Message-ID: <423B2046.8060902@vanderpoel.org>
Date: Fri, 18 Mar 2005 10:39:02 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: idn@ops.ietf.org
Subject: [idn] list: productive discussion
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

All,

Apparently a mailing list called ietf-stringprep was started at one 
point, but there wasn't much discussion there, and most people just 
discussed it here (on the idn list) instead. Since there probably isn't 
enough interest in Stringprep to fork this list, I suppose I could 
continue discussing Stringprep here. In order to make it clear that I'm 
talking about Stringprep, I will insert "stringprep:" in the Subject 
header. Other insertions I will use are:

list: to discuss the use of the mailing list itself (like this email)

idna: to discuss IDNA and related topics (i.e. Nameprep, Punycode, 
registration/application/Unicode issues)

off-topic: to discuss other issues such as PAD, keywords, Real Names, 
Petnames, directories, searching, handles, etc

I will try not to talk about "off-topic" topics, since it is not a very 
productive use of this mailing list. The IDN Working Group has 
"concluded" and this mailing list is not moderated, so my Subject header 
insertions are purely a personal choice. It would be great if others 
used the same insertions, but of course that is a personal choice.

Thanks,

Erik



From owner-idn@ops.ietf.org  Fri Mar 18 14:39:25 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id OAA15398
	for <idn-archive@lists.ietf.org>; Fri, 18 Mar 2005 14:39:24 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DCNED-000JNx-TN
	for idn-data@psg.com; Fri, 18 Mar 2005 19:33:49 +0000
Received: from [207.115.63.102] (helo=pimout3-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DCNEA-000JNf-Pd
	for idn@ops.ietf.org; Fri, 18 Mar 2005 19:33:47 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout3-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2IJXROW219076;
	Fri, 18 Mar 2005 14:33:32 -0500
Message-ID: <423B2D07.90605@vanderpoel.org>
Date: Fri, 18 Mar 2005 11:33:27 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Simon Josefsson <jas@extundo.com>
CC: idn@ops.ietf.org
Subject: [idn] stringprep: existing profiles and string processing complexity
References: <421B8484.3070802@vanderpoel.org>	<p06210208be4390618c81@[192.168.0.101]>	<421E0D0C.2000309@vanderpoel.org>	<p06210202be43c3888991@[192.168.0.101]>	<E07CE813AD23B2D95DA0C740@scan.jck.com>	<421E30F2.1040408@vanderpoel.org>	<0E7F74C71945B923C52211F3@scan.jck.com>	<421EA0C9.1010500@vanderpoel.org>	<00a401c51af3$7863aae0$030aa8c0@DEWELL>	<A574CA1BE87BFDA3C2A1AC0E@scan.jck.com>	<42322CE2.4040509@vanderpoel.org> <4232B2FD.1080104@vanderpoel.org>	<4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>	<ilull8qb5n5.fsf@latte.josefsson.org>	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>	<423782F0.60604@vanderpoel.org> <ilu7jk86idc.fsf@latte.josefsson.org>
In-Reply-To: <ilu7jk86idc.fsf@latte.josefsson.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Simon Josefsson wrote:

> The issue should be handled in an update of the StringPrep.  If the
> PR-29 fix is incorporated, there must a good transition discussion in
> the document.  The problem cannot only be discussed in the realm of
> IDNA, since StringPrep is used for other purposes as well.  For me,
> the most important use is SASLprep, because it is used to prepare
> username and passwords.  Hence, it is used in security critical
> application, where the requirements are different than from IDNA.  The
> discussion must be wider than for only IDNA.

I downloaded all the RFCs and Internet Drafts and grepped for 
Stringprep. Some of the profiles specified in RFCs are not registered at 
IANA. There are 3 profiles in an NFS4 spec (RFC 3530) that have not been 
registered. It is not clear to me that profiles must be registered. I 
have started a table of profiles that shows which parts of Stringprep 
are being used. So far, I have only listed profiles found in RFCs (not 
Internet Drafts). This table was far easier to create in an HTML editor, 
and I didn't want to send HTML to this list, so it's on my Web site:

http://nameprep.org/stringprep.html

It's still rough and doesn't indicate all the details, but it's a start. 
As I read the profiles and text in their vicinity, it seems as though 
some may not be fully aware of some of the complexities of string 
processing in Unicode. (This is not a flaw in Unicode. There are various 
written languages in the world, and some of them have complex rules.)

For example, RFC 3530 says:

    If the case_preserving attribute is present and set to false, then
    the NFS version 4 server MUST use table B.2 to map case when
    processing utf8str_cs strings.  Whether the server maps from lower to
    upper case or the upper to lower case is an implementation
    dependency.

Stringprep's case mapping table is intended to be used only to map upper 
case to lower case. For example, here is a special case:

    00DF; 0073 0073; Case map

You can't really use this entry to go "backwards".

There are other RFCs and Internet Drafts with various issues like this, 
or that are so vague as to make you wonder whether interoperability is 
truly assured. The IETF community is of course full of networking 
experts, and the Unicode community is full of internationalization 
experts. Stringprep finds itself in the rather special position of being 
wedged between networking (specifically, string input and matching) and 
Unicode. It might be a good idea to collect the issues and try to 
increase understanding of international string processing among 
networking community members.

Erik



From owner-idn@ops.ietf.org  Sat Mar 19 21:11:27 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id VAA11179
	for <idn-archive@lists.ietf.org>; Sat, 19 Mar 2005 21:11:27 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DCpmi-000H1k-IG
	for idn-data@psg.com; Sun, 20 Mar 2005 02:03:20 +0000
Received: from [207.115.63.101] (helo=pimout2-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DCpmh-000H19-3h
	for idn@ops.ietf.org; Sun, 20 Mar 2005 02:03:19 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout2-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2K239MW214474;
	Sat, 19 Mar 2005 21:03:13 -0500
Message-ID: <423CD9DC.5080401@vanderpoel.org>
Date: Sat, 19 Mar 2005 18:03:08 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Simon Josefsson <jas@extundo.com>
CC: idn@ops.ietf.org
Subject: [idn] stringprep: PRI #29
References: <42322CE2.4040509@vanderpoel.org>	<4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>	<ilull8qb5n5.fsf@latte.josefsson.org>	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>	<20050316091126.GA24254~@nicemice.net> <iluzmx36h6t.fsf@latte.josefsson.org>
In-Reply-To: <iluzmx36h6t.fsf@latte.josefsson.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Simon Josefsson wrote:
> There appears to me be a lot of decisions made out of subjective
> opinions on how normalization "should" behave, or is "assumed" to
> behave.

I don't think it's subjective. The concept of normalization requires 
that it be idempotent.

> One way is to incorporate the PR-29 fix, declare the earlier attempt
> as buggy, and re-cycle at PROPOSED.  I suspect you prefer that way?  I
> am hesitant about that approach, because we have already deployed the
> old RFC and it is not clear what problems there will be in mixing the
> old and the new code.

We already have the situation where some implementations do it one way, 
and some do it the other way. It is quite clear what will happen when 
somebody uses a character sequence that is interpreted differently by 
these implementations. Keep in mind that Unicode may add new characters 
in the future that may also be affected.

> Both Kerberos and SASL appears to be going to
> use the old StringPrep as well, so we will be seeing security critical
> infrastructure based on the old interpretation.

You write "the old interpretation" as if there is only one 
interpretation of the old spec. That's not true. As we have seen, there 
are implementations that do it one way, and those that do it the other way.

> Another way is to carry on with the Unicode 3.2 NFKC even though it
> breaks some human's assumptions on what "normalization" means in a
> theoretic setting.

It's not just an "assumption", and it's not merely "theoretical". This 
is a very basic requirement for the normalization process.

> Machines will cope, they compute an
> algorithm, they don't care if the output meet some unstated invariant
> or not.

IDNA specifies that a Punycode label must be decoded and then 
Nameprepped and Punycoded again to make sure you get the same string 
back in order to decide what to display (Unicode vs Punycode). This, in 
itself, should make you realize that the process is supposed to be 
idempotent. So we *do* care how the machines compute this algorithm.

> A third way, which is what I am deploying, is to use the Unicode 3.2
> NFKC together with a filter to reject the PR-29 problem sequences.
> This is in line with the RFC's, it solves problems related to PR-29
> problem sequences, and is simple to implement.

I don't think this is in line with the RFCs. You are rejecting sequences 
that are not rejected by the RFCs.

More importantly, when you continue to ship your implementation as is, 
more and more installations of your popular library will occur, making 
it more difficult for the world to adjust if and when the affected types 
of character sequences are introduced, either with the current 
characters or new characters.

You are in a position to make a difference. You already have. Please 
reconsider.

Erik



From owner-idn@ops.ietf.org  Sun Mar 20 01:06:50 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id BAA27109
	for <idn-archive@lists.ietf.org>; Sun, 20 Mar 2005 01:06:50 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DCtWd-0001v7-R3
	for idn-data@psg.com; Sun, 20 Mar 2005 06:02:59 +0000
Received: from [207.115.63.101] (helo=pimout2-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DCtWc-0001ue-Mg
	for idn@ops.ietf.org; Sun, 20 Mar 2005 06:02:58 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout2-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2K62kMW441196;
	Sun, 20 Mar 2005 01:02:54 -0500
Message-ID: <423D1206.8020501@vanderpoel.org>
Date: Sat, 19 Mar 2005 22:02:46 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Simon Josefsson <jas@extundo.com>
CC: idn@ops.ietf.org
Subject: Re: [idn] stringprep: PRI #29
References: <42322CE2.4040509@vanderpoel.org>	<4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>	<ilull8qb5n5.fsf@latte.josefsson.org>	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>	<20050316091126.GA24254~@nicemice.net> <iluzmx36h6t.fsf@latte.josefsson.org> <423CD9DC.5080401@vanderpoel.org>
In-Reply-To: <423CD9DC.5080401@vanderpoel.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

> Keep in mind that Unicode may add new characters 
> in the future that may also be affected.

New characters are not recognized by old implementations, so they are 
less relevant. Sorry about that part. This relatively small mistake in 
my email should not diminish the overall argument, however.

>> Both Kerberos and SASL appears to be going to
>> use the old StringPrep as well, so we will be seeing security critical
>> infrastructure based on the old interpretation.

SASLprep is for user names and passwords. People sometimes put strange 
character sequences into passwords to make them harder to guess, but I 
don't know if apps make it easy to enter the strange sequences affected 
by PRI #29. Just a thought -- not particularly important.

Erik



From owner-idn@ops.ietf.org  Sun Mar 20 02:57:21 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id CAA23645
	for <idn-archive@lists.ietf.org>; Sun, 20 Mar 2005 02:57:21 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DCvDw-000MqU-Ee
	for idn-data@psg.com; Sun, 20 Mar 2005 07:51:48 +0000
Received: from [217.13.230.178] (helo=yxa.extundo.com)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DCvDt-000Mne-P0
	for idn@ops.ietf.org; Sun, 20 Mar 2005 07:51:46 +0000
Received: from latte.josefsson.org (c494102a.s-bi.bostream.se [217.215.27.65])
	(authenticated bits=0)
	by yxa.extundo.com (8.13.3/8.13.3/Debian-6) with ESMTP id j2K7pb4Y024541
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Sun, 20 Mar 2005 08:51:38 +0100
From: Simon Josefsson <jas@extundo.com>
To: Erik van der Poel <erik@vanderpoel.org>
Cc: idn@ops.ietf.org
Subject: [idn] Re: stringprep: PRI #29
References: <42322CE2.4040509@vanderpoel.org>
	<4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org>
	<iluk6odazwb.fsf@latte.josefsson.org>
	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>
	<ilull8qb5n5.fsf@latte.josefsson.org>
	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>
	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>
	<20050316091126.GA24254~@nicemice.net>
	<iluzmx36h6t.fsf@latte.josefsson.org>
	<423CD9DC.5080401@vanderpoel.org>
OpenPGP: id=B565716F; url=http://josefsson.org/key.txt
Blog: http://www.livejournal.com/users/jas4711/
X-Hashcash: 1:21:050320:idn@ops.ietf.org::U1ifJePn35qU4kOX:7C3G
X-Hashcash: 1:21:050320:erik@vanderpoel.org::UPmrvz3wt9GCc5Oq:CO23
Date: Sun, 20 Mar 2005 08:51:16 +0100
In-Reply-To: <423CD9DC.5080401@vanderpoel.org> (Erik van der Poel's message of
	"Sat, 19 Mar 2005 18:03:08 -0800")
Message-ID: <ilur7iaycuj.fsf@latte.josefsson.org>
User-Agent: Gnus/5.110003 (No Gnus v0.3) Emacs/22.0.50 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Virus-Scanned: ClamAV version 0.83, clamav-milter version 0.83 on yxa.extundo.com
X-Virus-Status: Clean
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Erik van der Poel <erik@vanderpoel.org> writes:

>> A third way, which is what I am deploying, is to use the Unicode 3.2
>> NFKC together with a filter to reject the PR-29 problem sequences.
>> This is in line with the RFC's, it solves problems related to PR-29
>> problem sequences, and is simple to implement.
>
> I don't think this is in line with the RFCs. You are rejecting sequences 
> that are not rejected by the RFCs.

I don't see how RFCs can force an implementation to accept strings
that may cause security problems.  My SASL implementation reject the
PR-29 sequences, as will my Kerberos implementation, and I suggest
that everyone implement similar precautions.

Until this problem is addressed in an update of RFC 3454, rejecting
the problem sequences appear to be the most conservative approach to
me.  What would you propose to do instead?

If the situation is as you claim, that there are multiple StringPrep
implementations out there that implement NFKC in different ways, it
seems hazardous to permit the strings through when you don't know how
other components will behave.  This is especially true if you perform
authentication or authorization on an internationalized authentication
or authorization identity, and then pass it on to another component
that may run another NFKC implementation on the string, before it is
used by a component that assume the identity has been properly
authenticated or authorized earlier.

> More importantly, when you continue to ship your implementation as is, 
> more and more installations of your popular library will occur, making 
> it more difficult for the world to adjust if and when the affected types 
> of character sequences are introduced, either with the current 
> characters or new characters.

The problem sequences doesn't normally occur in the wild, at least
that is what PR-29 says, so it is unlikely to ever be a practical
problem.  It remains a security concern though, and that concern won't
go away until the spec's are updated, regardless of what I do in my
implementation.

> You are in a position to make a difference. You already have. Please 
> reconsider.

This isn't up to individual implementors.  RFC 3454 need to be updated
to address the problem.  Everyone can submit their own update of RFC
3454 to the IETF and advocate for their proposal.  I don't care
strongly which solution is chosen, if there is a good migration plan
to the new idea.  Meanwhile, implementors will route around the damage
and pick their own solutions.

Regards,
Simon



From owner-idn@ops.ietf.org  Sun Mar 20 12:59:47 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id MAA05381
	for <idn-archive@lists.ietf.org>; Sun, 20 Mar 2005 12:59:46 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DD4c3-0006eS-VF
	for idn-data@psg.com; Sun, 20 Mar 2005 17:53:19 +0000
Received: from [207.115.63.77] (helo=pimout1-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DD4c2-0006eC-LY
	for idn@ops.ietf.org; Sun, 20 Mar 2005 17:53:18 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout1-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2KHr8Ko057422;
	Sun, 20 Mar 2005 12:53:13 -0500
Message-ID: <423DB883.1020408@vanderpoel.org>
Date: Sun, 20 Mar 2005 09:53:07 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Simon Josefsson <jas@extundo.com>
CC: idn@ops.ietf.org
Subject: [idn] Re: stringprep: PRI #29
References: <42322CE2.4040509@vanderpoel.org>	<4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>	<ilull8qb5n5.fsf@latte.josefsson.org>	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>	<20050316091126.GA24254~@nicemice.net>	<iluzmx36h6t.fsf@latte.josefsson.org>	<423CD9DC.5080401@vanderpoel.org> <ilur7iaycuj.fsf@latte.josefsson.org>
In-Reply-To: <ilur7iaycuj.fsf@latte.josefsson.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Hi Simon,

Thanks for taking the time to reply to my email.

Simon Josefsson wrote:

> I don't see how RFCs can force an implementation to accept strings
> that may cause security problems.

I agree. If an implementor discovers a problem in a spec, they may wish 
to address that problem in their implementation.

> My SASL implementation reject the
> PR-29 sequences, as will my Kerberos implementation, and I suggest
> that everyone implement similar precautions.

I haven't been involved with this issue for very long. Would you say 
that a lot of the implementors have already heard of your approach, and 
that they are either using the same approach or considering it?

> Until this problem is addressed in an update of RFC 3454, rejecting
> the problem sequences appear to be the most conservative approach to
> me.  What would you propose to do instead?

Well, my feeling is that it will take too long to publish a new version 
of the Stringprep RFC, and that implementors should get together to try 
to reach a rough consensus and make changes before the new RFC is 
published. PRI #29 has been published, with a fair amount of info for 
the implementors to make a decision.

> If the situation is as you claim, that there are multiple StringPrep
> implementations out there that implement NFKC in different ways, it
> seems hazardous to permit the strings through when you don't know how
> other components will behave.  This is especially true if you perform
> authentication or authorization on an internationalized authentication
> or authorization identity, and then pass it on to another component
> that may run another NFKC implementation on the string, before it is
> used by a component that assume the identity has been properly
> authenticated or authorized earlier.

I can see that your approach is ultra-conservative, given that there is 
some evidence that the affected character sequences are rare.

> The problem sequences doesn't normally occur in the wild, at least
> that is what PR-29 says, so it is unlikely to ever be a practical
> problem.  It remains a security concern though, and that concern won't
> go away until the spec's are updated, regardless of what I do in my
> implementation.

Why would a mere spec update make the concern go away? Didn't you say 
that the differing implementations were the concern?

> This isn't up to individual implementors.  RFC 3454 need to be updated
> to address the problem.  Everyone can submit their own update of RFC
> 3454 to the IETF and advocate for their proposal.  I don't care
> strongly which solution is chosen, if there is a good migration plan
> to the new idea.  Meanwhile, implementors will route around the damage
> and pick their own solutions.

OK, let's suppose just for the moment, that we decide to have Stringprep 
point to version 24 or higher of UAX #15. Can you think of a migration 
plan that would satisfy ultra-conservative implementors like yourself?

Or, if you wish, suppose that we do _not_ have Stringprep point to a 
newer version of UAX #15. Can you think of a good migration plan for 
that? (Given that some implementations implement UAX #15 differently.)

Erik



From owner-idn@ops.ietf.org  Sun Mar 20 16:17:48 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id QAA23271
	for <idn-archive@lists.ietf.org>; Sun, 20 Mar 2005 16:17:48 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DD7jc-000OIv-Ie
	for idn-data@psg.com; Sun, 20 Mar 2005 21:13:20 +0000
Received: from [217.13.230.178] (helo=yxa.extundo.com)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DD7ja-000OIE-0w
	for idn@ops.ietf.org; Sun, 20 Mar 2005 21:13:18 +0000
Received: from latte.josefsson.org (c494102a.s-bi.bostream.se [217.215.27.65])
	(authenticated bits=0)
	by yxa.extundo.com (8.13.3/8.13.3/Debian-6) with ESMTP id j2KLD6Kh031188
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Sun, 20 Mar 2005 22:13:09 +0100
From: Simon Josefsson <jas@extundo.com>
To: Erik van der Poel <erik@vanderpoel.org>
Cc: idn@ops.ietf.org
Subject: [idn] Re: stringprep: PRI #29
References: <42322CE2.4040509@vanderpoel.org>
	<4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org>
	<iluk6odazwb.fsf@latte.josefsson.org>
	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>
	<ilull8qb5n5.fsf@latte.josefsson.org>
	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>
	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>
	<20050316091126.GA24254~@nicemice.net>
	<iluzmx36h6t.fsf@latte.josefsson.org>
	<423CD9DC.5080401@vanderpoel.org>
	<ilur7iaycuj.fsf@latte.josefsson.org>
	<423DB883.1020408@vanderpoel.org>
OpenPGP: id=B565716F; url=http://josefsson.org/key.txt
Blog: http://www.livejournal.com/users/jas4711/
X-Hashcash: 1:21:050320:idn@ops.ietf.org::PNP5IcTx4SIAEq8Z:3YBg
X-Hashcash: 1:21:050320:erik@vanderpoel.org::BxrFa9+POEYju/hQ:4hnA
Date: Sun, 20 Mar 2005 22:12:45 +0100
In-Reply-To: <423DB883.1020408@vanderpoel.org> (Erik van der Poel's message of
	"Sun, 20 Mar 2005 09:53:07 -0800")
Message-ID: <iluis3mxbqq.fsf@latte.josefsson.org>
User-Agent: Gnus/5.110003 (No Gnus v0.3) Emacs/22.0.50 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Virus-Scanned: ClamAV version 0.83, clamav-milter version 0.83 on yxa.extundo.com
X-Virus-Status: Clean
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Erik van der Poel <erik@vanderpoel.org> writes:

>> My SASL implementation reject the
>> PR-29 sequences, as will my Kerberos implementation, and I suggest
>> that everyone implement similar precautions.
>
> I haven't been involved with this issue for very long. Would you say 
> that a lot of the implementors have already heard of your approach, and 
> that they are either using the same approach or considering it?

I haven't seen much evidence of that.  The SASL and Kerberos specs
that use StringPrep haven't been published yet.  Few, if any,
implementors are speaking about this issue in those WG's.  Presumably
the specs are pushed out before the ideas have been implemented and
tested in practice.

>> Until this problem is addressed in an update of RFC 3454, rejecting
>> the problem sequences appear to be the most conservative approach to
>> me.  What would you propose to do instead?
>
> Well, my feeling is that it will take too long to publish a new version 
> of the Stringprep RFC, and that implementors should get together to try 
> to reach a rough consensus and make changes before the new RFC is 
> published. PRI #29 has been published, with a fair amount of info for 
> the implementors to make a decision.

I think it may be better to try and reach that consensus within the
IETF.  The expertise on this are supposed to be here.

>> The problem sequences doesn't normally occur in the wild, at least
>> that is what PR-29 says, so it is unlikely to ever be a practical
>> problem.  It remains a security concern though, and that concern won't
>> go away until the spec's are updated, regardless of what I do in my
>> implementation.
>
> Why would a mere spec update make the concern go away? Didn't you say 
> that the differing implementations were the concern?

Right.  I was assuming implementors will implement a sanely updated
spec, and that this in combination would solve the problem.

>> This isn't up to individual implementors.  RFC 3454 need to be updated
>> to address the problem.  Everyone can submit their own update of RFC
>> 3454 to the IETF and advocate for their proposal.  I don't care
>> strongly which solution is chosen, if there is a good migration plan
>> to the new idea.  Meanwhile, implementors will route around the damage
>> and pick their own solutions.
>
> OK, let's suppose just for the moment, that we decide to have Stringprep 
> point to version 24 or higher of UAX #15. Can you think of a migration 
> plan that would satisfy ultra-conservative implementors like yourself?

The spec could suggest that all problem sequences are to be rejected.

> Or, if you wish, suppose that we do _not_ have Stringprep point to a 
> newer version of UAX #15. Can you think of a good migration plan for 
> that? (Given that some implementations implement UAX #15 differently.)

Here too, the spec could suggest to reject all problem sequences.  The
NFKC implementations could continue to work as the Unicode 3.2
algorithm description suggest, but since the problem sequences are
rejected, you wouldn't notice the difference in practice.

Assuming PR#29 is correct on that these strings doesn't occur
naturally, rejecting them doesn't appear to have any interoperability
consequences.

Regards,
Simon



From owner-idn@ops.ietf.org  Mon Mar 21 13:37:30 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id NAA03730
	for <idn-archive@lists.ietf.org>; Mon, 21 Mar 2005 13:37:29 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DDRfQ-000AnK-BD
	for idn-data@psg.com; Mon, 21 Mar 2005 18:30:20 +0000
Received: from [207.115.63.77] (helo=pimout1-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DDRfM-000Ame-5Q
	for idn@ops.ietf.org; Mon, 21 Mar 2005 18:30:16 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout1-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2LIU2mU062168;
	Mon, 21 Mar 2005 13:30:10 -0500
Message-ID: <423F12A9.60009@vanderpoel.org>
Date: Mon, 21 Mar 2005 10:30:01 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Simon Josefsson <jas@extundo.com>
CC: idn@ops.ietf.org
Subject: Re: [idn] Re: stringprep: PRI #29
References: <42322CE2.4040509@vanderpoel.org>	<4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org>	<iluk6odazwb.fsf@latte.josefsson.org>	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>	<ilull8qb5n5.fsf@latte.josefsson.org>	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>	<20050316091126.GA24254~@nicemice.net>	<iluzmx36h6t.fsf@latte.josefsson.org>	<423CD9DC.5080401@vanderpoel.org>	<ilur7iaycuj.fsf@latte.josefsson.org>	<423DB883.1020408@vanderpoel.org> <iluis3mxbqq.fsf@latte.josefsson.org>
In-Reply-To: <iluis3mxbqq.fsf@latte.josefsson.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

>>>Everyone can submit their own update of RFC
>>>3454 to the IETF and advocate for their proposal.  I don't care
>>>strongly which solution is chosen, if there is a good migration plan
>>>to the new idea.  Meanwhile, implementors will route around the damage
>>>and pick their own solutions.
>>
>>OK, let's suppose just for the moment, that we decide to have Stringprep 
>>point to version 24 or higher of UAX #15. Can you think of a migration 
>>plan that would satisfy ultra-conservative implementors like yourself?
> 
> The spec could suggest that all problem sequences are to be rejected.

One way is to have more than one Internet Draft from individuals, and 
another way is to have a single draft that lists all the alternatives 
and discusses pros and cons of each. I guess the latter approach is 
sometimes used by working groups, but we don't currently have a 
Stringprep working group. Thoughts?

Erik



From owner-idn@ops.ietf.org  Mon Mar 21 13:44:48 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id NAA04228
	for <idn-archive@lists.ietf.org>; Mon, 21 Mar 2005 13:44:48 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DDRna-000COd-QL
	for idn-data@psg.com; Mon, 21 Mar 2005 18:38:46 +0000
Received: from [217.13.230.178] (helo=yxa.extundo.com)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DDRnV-000CM0-8g
	for idn@ops.ietf.org; Mon, 21 Mar 2005 18:38:41 +0000
Received: from latte.josefsson.org (c494102a.s-bi.bostream.se [217.215.27.65])
	(authenticated bits=0)
	by yxa.extundo.com (8.13.3/8.13.3/Debian-6) with ESMTP id j2LIcVWc030033
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Mon, 21 Mar 2005 19:38:35 +0100
From: Simon Josefsson <jas@extundo.com>
To: Erik van der Poel <erik@vanderpoel.org>
Cc: idn@ops.ietf.org
Subject: [idn] Re: stringprep: PRI #29
References: <42322CE2.4040509@vanderpoel.org>
	<4232B2FD.1080104@vanderpoel.org> <4232BA56.5090001@vanderpoel.org>
	<iluk6odazwb.fsf@latte.josefsson.org>
	<00e801c528a8$99ad37d0$72703009@sanjose.ibm.com>
	<ilull8qb5n5.fsf@latte.josefsson.org>
	<42367B63.6080300@vanderpoel.org> <4237450A.9010901@v.loewis.de>
	<423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org>
	<20050316091126.GA24254~@nicemice.net>
	<iluzmx36h6t.fsf@latte.josefsson.org>
	<423CD9DC.5080401@vanderpoel.org>
	<ilur7iaycuj.fsf@latte.josefsson.org>
	<423DB883.1020408@vanderpoel.org>
	<iluis3mxbqq.fsf@latte.josefsson.org> <423F12A9.60009@vanderpoel.org>
OpenPGP: id=B565716F; url=http://josefsson.org/key.txt
Blog: http://www.livejournal.com/users/jas4711/
X-Hashcash: 1:21:050321:idn@ops.ietf.org::973Eqeii+eGezdXs:7iU
X-Hashcash: 1:21:050321:erik@vanderpoel.org::UGWhpGl/iMJsAovI:2l2H
Date: Mon, 21 Mar 2005 19:38:10 +0100
In-Reply-To: <423F12A9.60009@vanderpoel.org> (Erik van der Poel's message of
	"Mon, 21 Mar 2005 10:30:01 -0800")
Message-ID: <ilupsxs7skt.fsf@latte.josefsson.org>
User-Agent: Gnus/5.110003 (No Gnus v0.3) Emacs/22.0.50 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Virus-Scanned: ClamAV version 0.83, clamav-milter version 0.83 on yxa.extundo.com
X-Virus-Status: Clean
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Erik van der Poel <erik@vanderpoel.org> writes:

>>>>Everyone can submit their own update of RFC
>>>>3454 to the IETF and advocate for their proposal.  I don't care
>>>>strongly which solution is chosen, if there is a good migration plan
>>>>to the new idea.  Meanwhile, implementors will route around the damage
>>>>and pick their own solutions.
>>>
>>> OK, let's suppose just for the moment, that we decide to have
>>> Stringprep point to version 24 or higher of UAX #15. Can you think
>>> of a migration plan that would satisfy ultra-conservative
>>> implementors like yourself?
>> The spec could suggest that all problem sequences are to be
>> rejected.
>
> One way is to have more than one Internet Draft from individuals, and 
> another way is to have a single draft that lists all the alternatives 
> and discusses pros and cons of each. I guess the latter approach is 
> sometimes used by working groups, but we don't currently have a 
> Stringprep working group. Thoughts?

I don't think a working group is required to do this work.  I believe
updates of older standards are sometimes done outside a working group.

Having a draft outlining the alternatives would be a useful
contribution.  Could be a first step towards producing a single draft
incorporating a solution.

Thanks,
Simon



From owner-idn@ops.ietf.org  Tue Mar 22 16:26:20 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id QAA09646
	for <idn-archive@lists.ietf.org>; Tue, 22 Mar 2005 16:26:19 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DDqln-000Ey6-BK
	for idn-data@psg.com; Tue, 22 Mar 2005 21:18:35 +0000
Received: from [208.184.76.39] (helo=above.proper.com)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DDqlm-000Ewz-A8
	for idn@ops.ietf.org; Tue, 22 Mar 2005 21:18:34 +0000
Received: from [10.20.30.249] (dsl2-63-249-109-245.cruzio.com [63.249.109.245])
	(authenticated bits=0)
	by above.proper.com (8.12.11/8.12.9) with ESMTP id j2MLIWW1021748
	for <idn@ops.ietf.org>; Tue, 22 Mar 2005 13:18:33 -0800 (PST)
	(envelope-from phoffman@imc.org)
Mime-Version: 1.0
Message-Id: <p06210212be663c22ba1c@[10.20.30.249]>
Date: Tue, 22 Mar 2005 13:19:05 -0800
To: idn@ops.ietf.org
From: Paul Hoffman <phoffman@imc.org>
Subject: [idn] Mac OS X Safari and IDN spoofing
Content-Type: text/plain; charset="us-ascii" ; format="flowed"
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Another browser vendor's solution: 
<http://docs.info.apple.com/article.html?artnum=301116>.

--Paul Hoffman, Director
--Internet Mail Consortium



From owner-idn@ops.ietf.org  Tue Mar 22 16:48:38 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id QAA11544
	for <idn-archive@lists.ietf.org>; Tue, 22 Mar 2005 16:48:38 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DDr9v-000K3x-WD
	for idn-data@psg.com; Tue, 22 Mar 2005 21:43:32 +0000
Received: from [193.201.200.34] (helo=tuschin.blackcatnetworks.co.uk)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DDr9s-000K2z-Lr
	for idn@ops.ietf.org; Tue, 22 Mar 2005 21:43:28 +0000
Received: from grmarkham.plus.com ([80.229.30.161] helo=[192.168.1.100])
	by tuschin.blackcatnetworks.co.uk with asmtp (Exim 3.35 #1 (Debian))
	id 1DDr9s-00038m-00
	for <idn@ops.ietf.org>; Tue, 22 Mar 2005 21:43:28 +0000
Message-ID: <4240917F.30801@mozilla.org>
Date: Tue, 22 Mar 2005 21:43:27 +0000
From: Gervase Markham <gerv@mozilla.org>
Organization: mozilla.org
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: idn@ops.ietf.org
Subject: Re: [idn] Mac OS X Safari and IDN spoofing
References: <p06210212be663c22ba1c@[10.20.30.249]>
In-Reply-To: <p06210212be663c22ba1c@[10.20.30.249]>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.3 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Paul Hoffman wrote:
> Another browser vendor's solution: 
> <http://docs.info.apple.com/article.html?artnum=301116>.

I suspect that this is also an interim solution, like the one 
mozilla.org came up with. I would hope they can find a better way than 
freezing out the Greeks, Cherokee Indians and Russians permanently. :-)

Gerv



From owner-idn@ops.ietf.org  Tue Mar 22 17:50:00 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id RAA16273
	for <idn-archive@lists.ietf.org>; Tue, 22 Mar 2005 17:49:59 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DDs7m-0002cu-F3
	for idn-data@psg.com; Tue, 22 Mar 2005 22:45:22 +0000
Received: from [203.117.75.21] (helo=red-aura.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DDs7k-0002cN-NH
	for idn@ops.ietf.org; Tue, 22 Mar 2005 22:45:21 +0000
Received: (qmail 50209 invoked from network); 22 Mar 2005 22:48:43 -0000
Received: from bb220-255-106-19.singnet.com.sg (HELO ?192.168.15.88?) (jseng@220.255.106.19)
  by red-aura.com with RC4-SHA encrypted SMTP; 22 Mar 2005 22:48:43 -0000
In-Reply-To: <4240917F.30801@mozilla.org>
References: <p06210212be663c22ba1c@[10.20.30.249]> <4240917F.30801@mozilla.org>
Mime-Version: 1.0 (Apple Message framework v619.2)
Content-Type: text/plain; charset=US-ASCII; format=flowed
Message-Id: <9271f2a6d20072ae7e9f1cf9e74cce45@seng.cc>
Content-Transfer-Encoding: 7bit
Cc: idn@ops.ietf.org
From: James Seng <james@seng.cc>
Subject: Re: [idn] Mac OS X Safari and IDN spoofing
Date: Wed, 23 Mar 2005 06:45:13 +0800
To: Gervase Markham <gerv@mozilla.org>
X-Mailer: Apple Mail (2.619.2)
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

i thought the ideas they have was pretty interesting

choose the scripts you use most often that you like to display normally 
but otherwise, will display in punycode.

a good short term solution so i expect them to evolve over time as we 
gain more experience.

now, do we want to standard "this" or do we want apps people to 
continue to evolve the mechanism to deal with spoofing? i prefer the 
latter.

james

On 23-Mar-05, at AM 05:43, Gervase Markham wrote:

> Paul Hoffman wrote:
>> Another browser vendor's solution: 
>> <http://docs.info.apple.com/article.html?artnum=301116>.
>
> I suspect that this is also an interim solution, like the one 
> mozilla.org came up with. I would hope they can find a better way than 
> freezing out the Greeks, Cherokee Indians and Russians permanently. 
> :-)
>
> Gerv
>




From owner-idn@ops.ietf.org  Wed Mar 23 14:41:52 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id OAA24264
	for <idn-archive@lists.ietf.org>; Wed, 23 Mar 2005 14:41:51 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DEBcP-000CDy-Aa
	for idn-data@psg.com; Wed, 23 Mar 2005 19:34:17 +0000
Received: from [207.115.63.98] (helo=pimout4-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DEBcL-000CDU-ST
	for idn@ops.ietf.org; Wed, 23 Mar 2005 19:34:14 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout4-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2NJY75K193018;
	Wed, 23 Mar 2005 14:34:08 -0500
Message-ID: <4241C4AF.1020707@vanderpoel.org>
Date: Wed, 23 Mar 2005 11:34:07 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: James Seng <james@seng.cc>, Gervase Markham <gerv@mozilla.org>
CC: idn@ops.ietf.org
Subject: Re: [idn] Mac OS X Safari and IDN spoofing
References: <p06210212be663c22ba1c@[10.20.30.249]> <4240917F.30801@mozilla.org> <9271f2a6d20072ae7e9f1cf9e74cce45@seng.cc>
In-Reply-To: <9271f2a6d20072ae7e9f1cf9e74cce45@seng.cc>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Opera addressed the IDN spoofing issue with a number of changes:

In 8.0 beta 2, they introduced a whitelist of TLDs that they consider 
safe because they appear to have good policies in place: no, jp, de, se, 
kr, tw, cn, at, dk, ch, and li. TLDs not on this list have their domain 
labels checked for characters outside Latin-1 (ISO 8859-1, Unicodes up 
to U+00FF). If there are characters outside Latin-1, the label is 
displayed in Punycode.

In 8.0 beta 3, they added hu and museum to the TLD whitelist, and they 
allowed the user to switch to a blacklist using the tilde (~), e.g. 
~:com:tw:. The character checking now allows a single script or specific 
script combinations in each domain label or sublabel, separated by dot 
(.) and hyphen (-). This allows e.g. xml-ccccccc where xml is ASCII and 
cccccc is the Russian word for "documents" in Cyrillic (I think).

I have added links to Opera's 8.0 beta 2 and 3 release notes and IDN 
Security Advisory to my Related Work section:

http://nameprep.org/#related-work

Another idea that I mentioned a while ago in a couple of forums is to 
check for characters used in the user's languages, which can be found in 
the browser localization and HTTP Accept-Language list. There are many 
different ways to display these labels, e.g. Punycode for labels with 
characters outside the user's languages. Another idea is to use pale 
green for characters in the user's main language, pale yellow for those 
in the user's secondary languages, and pale red for characters outside 
those languages. These colors are based on traffic lights.

James Seng wrote:

> now, do we want to standard "this" or do we want apps people to continue 
> to evolve the mechanism to deal with spoofing? i prefer the latter.

I agree that the IETF should not standardize these types of UI policies, 
though it might be a good idea to have some recommendations in an 
informative appendix or something.

However, the IETF may wish to consider standardizing a limited set of 
characters in IDN. For example, we may wish to extend RFC 952's host 
name rules (LDH = Letters, Digits and Hyphen) to a Unicode equivalent, 
thereby disallowing such characters as the slash homographs (e.g. math 
symbol for division).

As I wrote this email, Mark Davis sent a very relevant email to the 
Unicode list:

http://www.unicode.org/mail-arch/

Click the first link, user unicode-ml, password unicode.

Erik



From owner-idn@ops.ietf.org  Fri Mar 25 10:20:00 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id KAA06372
	for <idn-archive@lists.ietf.org>; Fri, 25 Mar 2005 10:20:00 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DEqTu-000PvH-GY
	for idn-data@psg.com; Fri, 25 Mar 2005 15:12:14 +0000
Received: from [193.201.200.34] (helo=tuschin.blackcatnetworks.co.uk)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DEqTt-000Pv5-Is
	for idn@ops.ietf.org; Fri, 25 Mar 2005 15:12:13 +0000
Received: from ip-80-242-39-37.aramiska-arc.aramiska.net ([80.242.39.37] helo=[195.168.1.53])
	by tuschin.blackcatnetworks.co.uk with asmtp (Exim 3.35 #1 (Debian))
	id 1DEqTr-00051j-00
	for <idn@ops.ietf.org>; Fri, 25 Mar 2005 15:12:13 +0000
Message-ID: <42442A07.2030003@mozilla.org>
Date: Fri, 25 Mar 2005 15:11:03 +0000
From: Gervase Markham <gerv@mozilla.org>
User-Agent: Mozilla Thunderbird 1.0 (X11/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: idn@ops.ietf.org
Subject: Re: [idn] Mac OS X Safari and IDN spoofing
References: <p06210212be663c22ba1c@[10.20.30.249]> <4240917F.30801@mozilla.org> <9271f2a6d20072ae7e9f1cf9e74cce45@seng.cc>
In-Reply-To: <9271f2a6d20072ae7e9f1cf9e74cce45@seng.cc>
X-Enigmail-Version: 0.89.6.0
X-Enigmail-Supports: pgp-inline, pgp-mime
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

James Seng wrote:
> i thought the ideas they have was pretty interesting
> 
> choose the scripts you use most often that you like to display normally 
> but otherwise, will display in punycode.

What sort of effect do you think it will have on IDN acceptance and use 
if companies using IDN domains know that their domain name will display 
as gobbledygook in an unknown percentage of their customer's browsers?

Gerv



From owner-idn@ops.ietf.org  Fri Mar 25 11:39:18 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id LAA15905
	for <idn-archive@lists.ietf.org>; Fri, 25 Mar 2005 11:39:17 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DErkN-000CPn-J8
	for idn-data@psg.com; Fri, 25 Mar 2005 16:33:19 +0000
Received: from [63.247.76.194] (helo=montage.altserver.com)
	by psg.com with esmtps (TLSv1:DES-CBC3-SHA:168)
	(Exim 4.44 (FreeBSD))
	id 1DErkL-000CPG-Io
	for idn@ops.ietf.org; Fri, 25 Mar 2005 16:33:17 +0000
Received: from lns-p19-1-idf-82-251-137-168.adsl.proxad.net ([82.251.137.168] helo=jfc.afrac.org)
	by montage.altserver.com with esmtpa (Exim 4.44)
	id 1DErFJ-0003Bs-Bg; Fri, 25 Mar 2005 08:01:13 -0800
Message-Id: <6.1.2.0.2.20050325164709.03f3e010@mail.jefsey.com>
X-Sender: jefsey+jefsey.com@mail.jefsey.com
X-Mailer: QUALCOMM Windows Eudora Version 6.1.2.0
Date: Fri, 25 Mar 2005 17:01:10 +0100
To: Gervase Markham <gerv@mozilla.org>, idn@ops.ietf.org
From: "JFC (Jefsey) Morfin" <jefsey@jefsey.com>
Subject: Re: [idn] Mac OS X Safari and IDN spoofing
In-Reply-To: <42442A07.2030003@mozilla.org>
References: <p06210212be663c22ba1c@[10.20.30.249]>
 <4240917F.30801@mozilla.org>
 <9271f2a6d20072ae7e9f1cf9e74cce45@seng.cc>
 <42442A07.2030003@mozilla.org>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"; format=flowed
X-AntiAbuse: This header was added to track abuse, please include it with any abuse report
X-AntiAbuse: Primary Hostname - montage.altserver.com
X-AntiAbuse: Original Domain - ops.ietf.org
X-AntiAbuse: Originator/Caller UID/GID - [0 0] / [47 12]
X-AntiAbuse: Sender Address Domain - jefsey.com
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

At 16:11 25/03/2005, Gervase Markham wrote:
>James Seng wrote:
>>i thought the ideas they have was pretty interesting
>>choose the scripts you use most often that you like to display normally 
>>but otherwise, will display in punycode.
>
>What sort of effect do you think it will have on IDN acceptance and use if 
>companies using IDN domains know that their domain name will display as 
>gobbledygook in an unknown percentage of their customer's browsers?

They will not if they are "babel names", ie names registered for their 
punycode display, such as "xn--cocacola.com".

I made a list in using Simon Josefsson oline tool and a small funycode 
program for Adam to test them. What he did. I do not remember the names I 
gave: I tried a few like xn--adam-costello.com, xn--vint-cerf.ibm, 
xn--gw-bush.com, etc. Many worked. If I am right the most brillant was 
xn--ibm.com which called for a single character IDN. The main issue is that 
if you TM the Unicode name there is nothing to be done.
jfc




From owner-idn@ops.ietf.org  Fri Mar 25 14:22:43 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id OAA02276
	for <idn-archive@lists.ietf.org>; Fri, 25 Mar 2005 14:22:42 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DEuId-00049H-V8
	for idn-data@psg.com; Fri, 25 Mar 2005 19:16:51 +0000
Received: from [207.115.63.77] (helo=pimout1-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DEuIc-00048m-OQ
	for idn@ops.ietf.org; Fri, 25 Mar 2005 19:16:51 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout1-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2PJGfmU060668;
	Fri, 25 Mar 2005 14:16:43 -0500
Message-ID: <42446397.7030100@vanderpoel.org>
Date: Fri, 25 Mar 2005 11:16:39 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0.2 (X11/20050317)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Gervase Markham <gerv@mozilla.org>
CC: idn@ops.ietf.org
Subject: Re: [idn] Mac OS X Safari and IDN spoofing
References: <p06210212be663c22ba1c@[10.20.30.249]> <4240917F.30801@mozilla.org> <9271f2a6d20072ae7e9f1cf9e74cce45@seng.cc> <42442A07.2030003@mozilla.org>
In-Reply-To: <42442A07.2030003@mozilla.org>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 8bit

Gervase Markham wrote:
> James Seng wrote:
>> choose the scripts you use most often that you like to display 
>> normally but otherwise, will display in punycode.
> 
> What sort of effect do you think it will have on IDN acceptance and use 
> if companies using IDN domains know that their domain name will display 
> as gobbledygook in an unknown percentage of their customer's browsers?

Companies, organizations and individuals are permitted to register more 
than one domain name. Companies that operate all over the world may wish 
to register domain names using their local names. It remains to be seen 
whether we will ever reach the point where a large percentage of users 
can view domain names containing characters from their "own" character 
set, but some registrants may wish to register their names now anyway, 
just in case. (Anyone willing to guess what that percentage is at the 
moment?)

I just went to Coca-Cola's site and navigated to their Chinese site to 
try to find out how they "spell" their name in Chinese. I don't know if 
this email is going to work, but here it is: å�¯å�£å�¯ä¹�

Then I used IBM's IDN demo to convert it to Punycode: xn--fjqs9k9ab. 
Then I tried the CN and COM domains, and found that the CN one was a 
totally unrelated site, probably a squatter. The COM site was another 
squatter, with "money & sex" in large letters, and "domain names ... for 
sale".

I also tried to find the Taiwanese version of Coca-Cola. Again, this may 
not work: å�¯å�£å�¯æ¨‚

The Punycode for this is xn--6orxab817t. I tried this name in the TW 
domain and reached Taiwan's NIC, where the Coca-Cola company can now 
register their name for a reasonable price (hopefully). The COM domain 
had another squatter.

So, while we are talking about technical details, squatters are taking 
action...

Erik

PS If I got the Chinese name for Coca-Cola wrong, or the Punycode is 
incorrect, please let me know. This was just an experiment...



From owner-idn@ops.ietf.org  Fri Mar 25 18:46:00 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id SAA01045
	for <idn-archive@lists.ietf.org>; Fri, 25 Mar 2005 18:46:00 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DEyPB-000FTG-4W
	for idn-data@psg.com; Fri, 25 Mar 2005 23:39:53 +0000
Received: from [207.115.63.102] (helo=pimout3-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DEyP7-000FSp-VW
	for idn@ops.ietf.org; Fri, 25 Mar 2005 23:39:50 +0000
Received: from [10.1.1.2] (adsl-64-174-147-206.dsl.sntc01.pacbell.net [64.174.147.206])
	by pimout3-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2PNdiOW200554;
	Fri, 25 Mar 2005 18:39:44 -0500
Message-ID: <4244A140.80308@vanderpoel.org>
Date: Fri, 25 Mar 2005 15:39:44 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0.2 (X11/20050317)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: Gervase Markham <gerv@mozilla.org>
CC: idn@ops.ietf.org
Subject: Re: [idn] Mac OS X Safari and IDN spoofing
References: <p06210212be663c22ba1c@[10.20.30.249]> <4240917F.30801@mozilla.org> <9271f2a6d20072ae7e9f1cf9e74cce45@seng.cc> <42442A07.2030003@mozilla.org>
In-Reply-To: <42442A07.2030003@mozilla.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

Gervase Markham wrote:
> James Seng wrote:
>> choose the scripts you use most often that you like to display 
>> normally but otherwise, will display in punycode.
> 
> What sort of effect do you think it will have on IDN acceptance and use 
> if companies using IDN domains know that their domain name will display 
> as gobbledygook in an unknown percentage of their customer's browsers?

Punycode is gobbledygook to everybody, but Japanese is gobbledygook to a 
lot of Englishmen, too. I realize that you don't want to balkanize the 
Net, but to some extent, the world already is. We don't understand each 
other's languages, nor should we, really. If we are very lucky, we may 
eventually get to the point where we can display every IDN in Unicode 
form, no matter which TLD it is in.

The Japanese have been pushing very hard for IDN. If you take a look at 
jprs.jp, you will see many Japanese domain names. You will also see that 
Opera is listed in their news on March 1st since it has reenabled IDNs 
in 8.0 beta 2. And Microsoft was mentioned on Jan. 26th since the IRI 
spec (RFC 3987) was published, thereby clearing the way for IDN support 
in MSIE 7:

http://news.zdnet.co.uk/software/windows/0,39020396,39191671,00.htm
http://jprs.jp/whatsnew/

JPRS also has a page listing the various browsers, mobile phone apps and 
other Internet apps that support IDNs. The browsers are listed in the 
order MSIE, Netscape, Mozilla Suite, Mozilla Firefox, Opera and Safari. 
(It's not alphabetical order.) The Mozilla entries also describe how to 
reenable IDNs.

http://jdna.jp/jdn/browsers/

The following page also talks about the pain of installing a plug-in and 
that users might not even know that they need to install one (i.e. 
VeriSign's plug-in for MSIE):

http://xn--wgv71a119e.jp/access/

It will be interesting to see what MSIE and .com do in the IDN space.

Erik



From owner-idn@ops.ietf.org  Sun Mar 27 16:36:52 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id QAA07728
	for <idn-archive@lists.ietf.org>; Sun, 27 Mar 2005 16:36:51 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DFfKU-00042q-7N
	for idn-data@psg.com; Sun, 27 Mar 2005 21:29:54 +0000
Received: from [64.36.79.201] (helo=nicemice.net)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DFfKR-00042V-1T
	for idn@ops.ietf.org; Sun, 27 Mar 2005 21:29:51 +0000
Received: from amc by nicemice.net with local (Exim 4.44)
	id 1DFfKP-0004Dm-KU
	for idn@ops.ietf.org; Sun, 27 Mar 2005 13:29:49 -0800
Date: Sun, 27 Mar 2005 21:29:49 +0000
From: "Adam M. Costello" <idn.amc+0@nicemice.net.RemoveThisWord.cnri.reston.va.us>
To: idn@ops.ietf.org
Subject: Re: [idn] Re: stringprep: PRI #29
Message-ID: <20050327212949.GA15994~@nicemice.net>
Reply-To: IETF idn working group <idn@ops.ietf.org>
References: <423754F3.50405@vanderpoel.org> <ilumzt47ezc.fsf@latte.josefsson.org> <20050316091126.GA24254~@nicemice.net> <iluzmx36h6t.fsf@latte.josefsson.org> <423CD9DC.5080401@vanderpoel.org> <ilur7iaycuj.fsf@latte.josefsson.org> <423DB883.1020408@vanderpoel.org> <iluis3mxbqq.fsf@latte.josefsson.org> <423F12A9.60009@vanderpoel.org> <ilupsxs7skt.fsf@latte.josefsson.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <ilupsxs7skt.fsf@latte.josefsson.org>
User-Agent: Mutt/1.5.6+20040907i
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham 
	version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

Simon Josefsson <jas@extundo.com> wrote:

> Having a draft outlining the alternatives would be a useful
> contribution.

For an implementation, I see the following alternatives:

1) Reject the problem sequences (and no others) before normalizing (add
   a step 0 to the stringprep algorithm).

2) Reject some superset of the problem sequences that is easier to
   compute and still rejects only implausible strings.

3) Reject nothing, but make sure the normalization algorithm follows the
   proposed fixed normalization spec (and the original sample code).

4) Reject nothing, but make sure the normalization algorithm follows the
   current broken normalization spec (not the original sample code).

5) Reject nothing, and follow whichever normalization spec is already
   implemented (that is, ignore the problem).

I have listed these in order of decreasing quality (though the order of
2 and 3 is debatable), and in order of decreasing complexity (except
that 3 and 4 are equally complex).

I don't expect anyone to defend 5.

Given that there already exist implementations of both kinds of
normalization, and neither is more right or more wrong than the other
(in light of the internally inconsistent spec), it would be silly for
stringprep to standardize on the broken one, so we can discard 4.

I can imagine an implementor making a case for any of 1-3.  The next
question is how much latitude the stringprep spec should give the
implementor.

We might consider allowing implementations to choose from among more
than one approved alternative.  I lean against that idea, because
stringprep is used to define valid strings in protocols, and it's hard
to analyze what can happen when implementations disagree about the
validity of a string.  (There is already one way this can happen in
stringprep: unassigned code points become assigned.  The analysis was
very tricky, and I'd prefer to keep that sort of thing to a minimum.)

If stringprep were to pick alternative 3 as the one and only allowed
behavior, some implementations would consider that an unacceptable
security risk and implement 1 or 2 anyway, so in practice we'd still
have implementations choosing from multiple alternatives.

This argues for the stringprep spec to require the rejection of either
(1) the problem sequences or (2) some particular superset of the problem
sequences that is easier to compute.  But the implementation simplicity
of (3) is very appealing, and part of me hopes to be persuaded to go
with that in spite of the analytical complexity.

If we choose 1 or 2, we still need to decide how to define the sequences
that must be rejected.  For example, if we choose 1, I suggest something
like this:

    Definition:  A string must be rejected if and only if oldNormalize
    and newNormalize return different results.

    Theorem:  The rejected strings are exactly the ones containing
    code points with such-and-such properties in such-and-such
    combinations...

    Theorem:  In Unicode version x.y, the previous theorem amounts to
    the following table of specific code point combinations...

Notice that if an implementation has access to both oldNormalize and
newNormalize, it can implement the definition directly without the
complexity of applying either theorem.  It could also do a simple check
for the presence of any code points from the table, and optimize away
the second normalization if none are present.

AMC



From owner-idn@ops.ietf.org  Sun Mar 27 18:28:28 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id SAA15785
	for <idn-archive@lists.ietf.org>; Sun, 27 Mar 2005 18:28:27 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DFh88-000INw-U5
	for idn-data@psg.com; Sun, 27 Mar 2005 23:25:16 +0000
Received: from [64.36.79.201] (helo=nicemice.net)
	by psg.com with esmtps (TLSv1:AES256-SHA:256)
	(Exim 4.44 (FreeBSD))
	id 1DFh86-000INb-Oj
	for idn@ops.ietf.org; Sun, 27 Mar 2005 23:25:14 +0000
Received: from amc by nicemice.net with local (Exim 4.44)
	id 1DFh84-0004IL-QW
	for idn@ops.ietf.org; Sun, 27 Mar 2005 15:25:12 -0800
Date: Sun, 27 Mar 2005 23:25:12 +0000
From: "Adam M. Costello" <idn.amc+0@nicemice.net.RemoveThisWord.cnri.reston.va.us>
To: IETF idn working group <idn@ops.ietf.org>
Subject: Re: [idn] IDNA section 3.1 requirement 3
Message-ID: <20050327232512.GB15994~@nicemice.net>
Reply-To: IETF idn working group <idn@ops.ietf.org>
References: <DCA85A0719E37431D3C99DC8@scan.jck.com> <20050316221337.GB25580~@nicemice.net> <052C0407EAFFC3AC92D2D7D9@7AD4D3FB4841A5E367CCF211> <33c401c52b07$3004e600$477d3009@sanjose.ibm.com> <20050316221337.GB25580~@nicemice.net> <052C0407EAFFC3AC92D2D7D9@7AD4D3FB4841A5E367CCF211> <20050316221337.GB25580~@nicemice.net> <p06210260be5e6f4e2379@[10.20.30.249]> <20050317063435.GA26106~@nicemice.net> <p0621027abe5f6eaa4ccf@[10.20.30.249]>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <34bc01c52b2a$d01efe00$477d3009@sanjose.ibm.com> <DCA85A0719E37431D3C99DC8@scan.jck.com> <33c401c52b07$3004e600$477d3009@sanjose.ibm.com> <p0621027abe5f6eaa4ccf@[10.20.30.249]>
User-Agent: Mutt/1.5.6+20040907i
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.1 required=5.0 tests=AWL,BAYES_00,URIBL_SBL 
	autolearn=no version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk

I have been persuaded that the recommendations in my proposal were too
narrow, and did not leave enough room for implementations to experiment
with alternative ways of presenting suspicious labels, like color and
decoration.  Here's a less restrictive proposal:

--begin--

[section 3.1]

     3) When a domain label occupying or obtained from a domain name
        slot is to be shown to a user, it SHOULD NOT simply be shown
        in whatever form it was found in; before being shown it SHOULD
        be forced into either ASCII form (which can be obtained by
        applying ToASCII) or non-ACE form (which can be obtained by
        applying ToUnicode, see section 4).  Implementors are encouraged
        to develop policies that balance the conflicting goals of not
        showing unintelligible ACE strings and not showing misleading
        Unicode strings.  See appendix A for suggestions.  When the user
        has explicitly requested to see one form or the other, that
        form SHOULD be shown.  When requirements 2 and 3 both apply,
        requirement 2 takes precedence.

[appendix A]

    This appendix offers suggestions only, not recommendations or
    requirements.

    For labels that are ACEs or have ACE forms, there are various
    factors that an application can consider when deciding how to
    display the label to a user.

    The ACE form is unsuitable for presentation to a user because it
    is unintelligible, unrecognizable, not very useful, and quite
    unfriendly.  Its one redeeming feature is that it is ASCII-only,
    and therefore has the best chance of being displayable and
    copy-and-pastable, and the least chance of containing misleading
    characters.

    The non-ACE form is intelligible to the user (and therefore much
    friendlier and more useful), if it is displayable.  But in an
    environment that cannot handle the characters, the non-ACE form
    could turn out to be even less useful than the ACE form.

    The non-ACE form can be misleading, by containing characters that
    look like delimiters (for example, U+2044 looks like a slash), or
    that look like characters in other scripts (for example, many Latin,
    Greek, and Cyrillic letters look alike).

    The misleading-label problem is the most complex to deal with.  A
    general approach is to identify suspicious characters, and then
    use some means to avoid displaying the suspicious characters, or
    to display them safely.  Below are a few (but certainly not all)
    possible methods.  Implementations are free to experiment and
    innovate.

    Identifying suspicious characters:

        Some characters could be considered suspicious in all contexts;
        for example, all characters outside Unicode categories L
        (letter), N (number), and M (mark), except U+002D hyphen-minus.

        Some characters could be considered suspicious in labels that
        are children of (or descendents of) certain domains.  For
        example, in a domain whose registration rules are believed to
        avoid confusion only for certain scripts, characters outside
        those scripts could be considered suspicious.  In a domain
        believed to have no restrictions on registered names, all
        non-ASCII characters could be considered suspicious.

        Some characters could be considered suspicious depending on what
        other characters appear in the same label.  For example, in a
        label containing Cyrillic, Greek, and Latin characters, one of
        those scripts could be chosen as the main script (possibly the
        one that appears first, or appears most often), and the others
        could be considered suspicious.

    Avoiding displaying suspicious characters:

        Showing the ACE form avoids displaying all non-ASCII characters,
        but see above for the disadvantages of the ACE form.

        Showing a replacement character for the suspicious characters,
        while displaying non-suspicious characters normally, will have a
        friendlier appearance than the ACE form, but is likely to break
        copy-and-paste.

        In some contexts, an escape mechanism is available that can be
        used to obscure characters.  For example, in an International
        Resource Identifier (IRI), any character can be represented by
        percent-encoded UTF-8.  This will interject some ugliness, but
        is still likely to have a friendlier appearance than the ACE
        form, and will not break copy-and-paste.

    Displaying suspicious characters safely:

        Color, highlighting, underlining, etc. could be used to flag
        suspicious characters.  One concern with this approach is
        whether the user will understand the significance of such
        markings.

--end--

The rest of this message contains a few responses to some criticisms
of my previous proposal.  The responses are probably moot, since that
proposal has now been replaced, but anyway...

Paul Hoffman <phoffman@imc.org> wrote:

> > As long as they don't see "paypal" or whatever, they're at least not
> > being misled.
>
> The example given at the start of your message was the
> homograph-slash.  A spoof domain name that has that character and
> "paypal" will *still* display "paypal" in the Punycode.

True.  My explanation was a bit sloppy.  Let me try again:  As long as
the user doesn't see the misleading characters, the user is not being
misled.  If the misleading character is a cyrillic "a" in "paypal", then
it's enough to avoid displaying the cyrillic "a".  If the misleading
character is a slash-homograph immediately following "paypal.com", it's
enough to avoid displaying the slash-homograph.

> As you remember from a few years ago, cut-and-paste often doesn't work
> reliably with non-ASCII characters even under good conditions.  This
> seems like a red herring.

For me, the inability to copy and paste URIs into and out of a browser's
location field would be a major inconvenience, probably enough to
make me abandon the browser in favor of another.  Once IRIs become
widespread, I expect I'll feel the same way about them.

Mark Davis <mark.davis@jtcsv.com> wrote:

> Use of the raw punycode in place of the represented characters will
> cause more user confusion, not less.

> User sees:
>
> xn--tlralit-byabbe.fr versus xn--tlralit-byabb390f.fr
>
> Presented with a collection of apparently random letters, eyes quickly
> glaze over, and people really can't distinguish between two names
> in any sensible fashion.  Users are not going to memorize which
> gobbledygook is the one they want.

I agree, but that's beside the point.  I don't expect anyone to
recognize an ACE, or distinguish between one ACE and another.  I
expect people to consider all ACEs as unrecognized domains.  I expect
registrants who want recognizable domains to pick domain names that
won't display as ACE to the target audience.

AMC



From owner-idn@ops.ietf.org  Mon Mar 28 12:19:40 2005
Received: from psg.com (mailnull@psg.com [147.28.0.62])
	by ietf.org (8.9.1a/8.9.1a) with ESMTP id MAA18351
	for <idn-archive@lists.ietf.org>; Mon, 28 Mar 2005 12:19:39 -0500 (EST)
Received: from majordom by psg.com with local (Exim 4.44 (FreeBSD))
	id 1DFxlk-000AK3-2V
	for idn-data@psg.com; Mon, 28 Mar 2005 17:11:16 +0000
Received: from [207.115.63.102] (helo=pimout3-ext.prodigy.net)
	by psg.com with esmtp (Exim 4.44 (FreeBSD))
	id 1DFxl3-000AES-HM
	for idn@ops.ietf.org; Mon, 28 Mar 2005 17:10:33 +0000
Received: from [4.246.96.203] (dialup-4.246.96.203.Dial1.SanJose1.Level3.net [4.246.96.203])
	by pimout3-ext.prodigy.net (8.12.10 milter /8.12.10) with ESMTP id j2SHAROW023618
	for <idn@ops.ietf.org>; Mon, 28 Mar 2005 12:10:31 -0500
Message-ID: <42483B9E.8070902@vanderpoel.org>
Date: Mon, 28 Mar 2005 09:15:10 -0800
From: Erik van der Poel <erik@vanderpoel.org>
User-Agent: Mozilla Thunderbird 1.0 (Windows/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: IETF idn working group <idn@ops.ietf.org>
Subject: Re: [idn] Mac OS X Safari and IDN spoofing
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on psg.com
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00,RCVD_IN_SORBS_WEB 
	autolearn=ham version=3.0.1
Sender: owner-idn@ops.ietf.org
Precedence: bulk
Content-Transfer-Encoding: 7bit

I wrote:

 > The Japanese have been pushing very hard for IDN.
 > If you take a look at jprs.jp, ...

It has been pointed out to me that there is no "the Japanese" in this 
area, and that some of the individuals at JPRS may have opinions that do 
not necessarily match the opinions of some other Japanese people.

Also, JPRS appears to be distributing VeriSign's i-Nav IDN plug-in for MSIE.

Erik



