
From ietf-nntp-bounces+nntpext-archive=ietf.org@lists.eyrie.org  Sat Jun 11 20:57:57 2011
Return-Path: <ietf-nntp-bounces+nntpext-archive=ietf.org@lists.eyrie.org>
X-Original-To: ietfarch-nntpext-archive@ietfa.amsl.com
Delivered-To: ietfarch-nntpext-archive@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8D24511E80C9 for <ietfarch-nntpext-archive@ietfa.amsl.com>; Sat, 11 Jun 2011 20:57:57 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 0.962
X-Spam-Level: 
X-Spam-Status: No, score=0.962 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, HOST_EQ_MODEMCABLE=1.368, HOST_MISMATCH_COM=0.311, RCVD_IN_PBL=0.905, RCVD_IN_SORBS_DUL=0.877, RDNS_DYNAMIC=0.1]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3GKEfHmG9GeP for <ietfarch-nntpext-archive@ietfa.amsl.com>; Sat, 11 Jun 2011 20:57:57 -0700 (PDT)
Received: from hope.eyrie.org (hope.eyrie.org [IPv6:2001:470:30:84:e276:63ff:fe62:3535]) by ietfa.amsl.com (Postfix) with ESMTP id 8ADEE11E809C for <nntpext-archive@ietf.org>; Sat, 11 Jun 2011 20:57:52 -0700 (PDT)
Received: from hope.eyrie.org (unknown [IPv6:::1]) by hope.eyrie.org (Postfix) with ESMTP id 5222C67E20 for <nntpext-archive@ietf.org>; Sat, 11 Jun 2011 20:57:51 -0700 (PDT)
X-Original-To: ietf-nntp@lists.eyrie.org
Delivered-To: ietf-nntp@lists.eyrie.org
Received: from Mintaka.sabahattin-gucukoglu.com (sgucukoglu-2-pt.tunnel.tserv8.dal1.ipv6.he.net [IPv6:2001:470:1f0e:7ef::2]) by hope.eyrie.org (Postfix) with ESMTP id CA43367E10 for <ietf-nntp@lists.eyrie.org>; Sat, 11 Jun 2011 20:57:49 -0700 (PDT)
Received: from Mintaka.sabahattin-gucukoglu.com ([::ffff:127.0.0.1]:53377) by Mintaka.sabahattin-gucukoglu.com with [XMail 1.27 ESMTP Server] id <S35F62> for <ietf-nntp@lists.eyrie.org> from <mail-dated-1310443066.1d7e94@sabahattin-gucukoglu.com>;  Sun, 12 Jun 2011 04:57:46 +0100
Received: from [192.168.1.20] (cpc2-dals7-0-0-cust570.hari.cable.virginmedia.com [82.35.114.59]) (using SMTP over TLS) by Mintaka.sabahattin-gucukoglu.com (tmda-ofmipd) with ESMTP; Sun, 12 Jun 2011 04:57:44 +0100
Content-Type: text/plain; charset=iso-8859-1
Mime-Version: 1.0 (Apple Message framework v1084)
In-Reply-To: <4DCEDA10.5050402@trigofacile.com>
Date: Sun, 12 Jun 2011 04:57:40 +0100
Content-Transfer-Encoding: quoted-printable
Message-Id: <41FD59ED-16FD-4127-9D93-128690330AFC@sabahattin-gucukoglu.com>
References: <F5F3320A-9B6A-4566-889C-A667D1360871@sabahattin-gucukoglu.com>	<4DCD6503.2060302@trigofacile.com> <E4634E62-C386-40D1-A2C2-BEC6D2331D90@sabahattin-gucukoglu.com> <4DCEDA10.5050402@trigofacile.com>
To: ietf-nntp@lists.eyrie.org
X-Mailer: Apple Mail (2.1084)
X-Delivery-Agent: TMDA/1.1.12-kg3 (Haumea)
From: Sabahattin Gucukoglu <mail@sabahattin-gucukoglu.com>
X-Primary-Address: mail@sabahattin-gucukoglu.com
Subject: Re: [NNTP] Article Reinstatement
X-BeenThere: ietf-nntp@lists.eyrie.org
X-Mailman-Version: 2.1.13
Precedence: list
Reply-To: Sabahattin Gucukoglu <mail-dated-1310443066.1d7e94@sabahattin-gucukoglu.com>
List-Id: NNTP protocol discussion <ietf-nntp.lists.eyrie.org>
List-Unsubscribe: <http://lists.eyrie.org/mailman/options/ietf-nntp>, <mailto:ietf-nntp-request@lists.eyrie.org?subject=unsubscribe>
List-Archive: <http://lists.eyrie.org/pipermail/ietf-nntp>
List-Post: <mailto:ietf-nntp@lists.eyrie.org>
List-Help: <mailto:ietf-nntp-request@lists.eyrie.org?subject=help>
List-Subscribe: <http://lists.eyrie.org/mailman/listinfo/ietf-nntp>, <mailto:ietf-nntp-request@lists.eyrie.org?subject=subscribe>
Sender: ietf-nntp-bounces+nntpext-archive=ietf.org@lists.eyrie.org
Errors-To: ietf-nntp-bounces+nntpext-archive=ietf.org@lists.eyrie.org

I think we really need an effort to roll all these errata into 3977bis.

On 14 May 2011, at 20:37, Julien =C9LIE wrote:
>>> The low watermark can not decrease.
>>=20
>> Even when the client disconnects?
>=20
> Yes, the low water mark SHOULD NOT decrease.
>=20
> Section 6.1.1.2:
>=20
>   Except when the group is empty and all three numbers are zero,
>   whenever a subsequent GROUP command for the same newsgroup is =
issued,
>   either by the same client or a different client, the reported low
>   water mark in the response MUST be no less than that in any previous
>   response for that newsgroup in this session, and it SHOULD be no =
less
>   than that in any previous response for that newsgroup ever sent to
>   any client.  Any failure to meet the latter condition SHOULD be
>   transient only.  The client may make use of the low water mark to
>   remove all remembered information about articles with lower numbers,
>   as these will never recur.
>=20
>>> It is not an RFC-compliant behaviour. min could not have been set
>>> to 2.

Yes, (as Clive correctly points out) very sensible.  But how do we =
distinguish, inside the server, an article that *might* be reinstated =
and one that just expired?

>> So what does a server do when the lowest-numbered article is pending
>> reinstatement and the client requests it?
>=20
> The news server just answers the article does not exist:
>=20
>   First form (message-id specified)
>     430                   No article with that message-id
>=20
>   Second form (article number specified)
>     423                   No article with that number
>=20
>   Third form (current article number used)
>     423                   No article with that number
>=20
> Note that reinstatement can be done on other articles than the =
lowest-numbered article.

Is there any language which specifically allows the use of these codes =
for reporting an invalid article number because of a (possible) =
reinstatement?  =46rom here it looks like just an implementation detail. =
 I'd otherwise assume that the server simply pretends the article isn't =
valid even though it might be, in the future.  There is a semantic =
difference that the server hides.

>> Looking back at my original message, I see that I made an assumption
>> that the high and low watermarks were always valid articles, but I
>> can see now that the RFC has us covered in the special case of
>> reinstatement.  Good. :-)
>=20
> And also the fact that articles can expire and no longer be present in =
the news spool.  The low water mark does not necessarily point to a =
still retrievable article at the time an ARTICLE command is sent.

That's fine; such an article really would be no longer existent.

> news.test has 5 messages, min=3D1 max=3D5 count=3D5 1. remove #1 min=3D1=

>>> max=3D5 count=3D4 2. reinstate #1 and remove #3 min=3D1 max=3D5 =
count=3D4
>>=20
>> By which we understand that an invalid article response will result
>> from requesting a removed article, yes?
>=20
> Not "invalid", but "inexistent".

Yes, OK, this needs to be rolled into bis.

> So a client that comes between action 1 and action 2 will never see
>>> #1; it won't ask for #1 afterwards because the high water mark is
>>> 5.  The same way as a client coming after action 2 will never see
>>> #3. But is it really a problem?
>>=20
>> Taking into account the use of article reinstatement, probably not in
>> many cases, but you can imagine that if you are a news puller or
>> offline reader, you want to go forward in the article stream and not
>> worry about what came before.  Any circumstance that results in
>> article deletion should be permanent, from the client's perspective.
>> But yes, it's just me, picking nits. :-)
>=20
> It is up to the client to decide how to implement its retrieval of =
articles.  If it assumes the article stream always go forward (which =
happens nearly all the time), then it will miss reinstatements.  That's =
all.  The client just prefers rapidity to exhaustivity (sending a =
LISTGROUP every time, or every n times, it connects to a news group).

Yes, indeed.  This seems to be how I've come away with this.  I used to =
do such exhaustive checks, but noting that reinstated articles were =
removed and then the same numbers used on the reinstatements, I decided =
that the client would benefit from the speed, if we assume the reader is =
acting on behalf of the user at the time the articles are retrieved, =
rather than read (for caching).  This doesn't always work, but it does =
work 99% of the time.  Especially since many servers just don't do the =
reinstatement thing at all.

Cheers,
Sabahattin

From ietf-nntp-bounces+nntpext-archive=ietf.org@lists.eyrie.org  Sun Jun 12 02:12:35 2011
Return-Path: <ietf-nntp-bounces+nntpext-archive=ietf.org@lists.eyrie.org>
X-Original-To: ietfarch-nntpext-archive@ietfa.amsl.com
Delivered-To: ietfarch-nntpext-archive@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E42BB11E807F for <ietfarch-nntpext-archive@ietfa.amsl.com>; Sun, 12 Jun 2011 02:12:35 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.299
X-Spam-Level: 
X-Spam-Status: No, score=-2.299 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, MIME_8BIT_HEADER=0.3]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id h324b94zoxM4 for <ietfarch-nntpext-archive@ietfa.amsl.com>; Sun, 12 Jun 2011 02:12:35 -0700 (PDT)
Received: from hope.eyrie.org (hope.eyrie.org [IPv6:2001:470:30:84:e276:63ff:fe62:3535]) by ietfa.amsl.com (Postfix) with ESMTP id B769B11E8078 for <nntpext-archive@ietf.org>; Sun, 12 Jun 2011 02:12:34 -0700 (PDT)
Received: from hope.eyrie.org (unknown [IPv6:::1]) by hope.eyrie.org (Postfix) with ESMTP id AB45967E14 for <nntpext-archive@ietf.org>; Sun, 12 Jun 2011 02:12:33 -0700 (PDT)
X-Original-To: ietf-nntp@lists.eyrie.org
Delivered-To: ietf-nntp@lists.eyrie.org
Received: from denver.dinauz.org (denver.dinauz.org [91.121.7.193]) by hope.eyrie.org (Postfix) with ESMTP id 077C467D74 for <ietf-nntp@lists.eyrie.org>; Sun, 12 Jun 2011 02:12:32 -0700 (PDT)
Received: from localhost (localhost.localdomain [127.0.0.1]) by denver.dinauz.org (Postfix) with ESMTP id A8C8C815D for <ietf-nntp@lists.eyrie.org>; Sun, 12 Jun 2011 11:12:31 +0200 (CEST)
Received: from denver.dinauz.org ([127.0.0.1]) by localhost (denver.dinauz.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 6202-mhSRO98 for <ietf-nntp@lists.eyrie.org>; Sun, 12 Jun 2011 11:12:31 +0200 (CEST)
Received: from MacBook-Pro-de-Julien-Elie.local (AAubervilliers-552-1-21-61.w92-141.abo.wanadoo.fr [92.141.84.61]) by denver.dinauz.org (Postfix) with ESMTPSA id 7567D805F for <ietf-nntp@lists.eyrie.org>; Sun, 12 Jun 2011 11:12:31 +0200 (CEST)
Message-ID: <4DF482FE.6040906@trigofacile.com>
Date: Sun, 12 Jun 2011 11:12:30 +0200
From: =?windows-1252?Q?Julien_=C9LIE?= <julien@trigofacile.com>
Organization: TrigoFACILE -- http://www.trigofacile.com/
User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; fr; rv:1.9.2.17) Gecko/20110414 Thunderbird/3.1.10
MIME-Version: 1.0
To: ietf-nntp@lists.eyrie.org
References: <F5F3320A-9B6A-4566-889C-A667D1360871@sabahattin-gucukoglu.com>	<4DCD6503.2060302@trigofacile.com>	<E4634E62-C386-40D1-A2C2-BEC6D2331D90@sabahattin-gucukoglu.com>	<4DCEDA10.5050402@trigofacile.com> <41FD59ED-16FD-4127-9D93-128690330AFC@sabahattin-gucukoglu.com>
In-Reply-To: <41FD59ED-16FD-4127-9D93-128690330AFC@sabahattin-gucukoglu.com>
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 8bit
Subject: Re: [NNTP] Article Reinstatement
X-BeenThere: ietf-nntp@lists.eyrie.org
X-Mailman-Version: 2.1.13
Precedence: list
List-Id: NNTP protocol discussion <ietf-nntp.lists.eyrie.org>
List-Unsubscribe: <http://lists.eyrie.org/mailman/options/ietf-nntp>, <mailto:ietf-nntp-request@lists.eyrie.org?subject=unsubscribe>
List-Archive: <http://lists.eyrie.org/pipermail/ietf-nntp>
List-Post: <mailto:ietf-nntp@lists.eyrie.org>
List-Help: <mailto:ietf-nntp-request@lists.eyrie.org?subject=help>
List-Subscribe: <http://lists.eyrie.org/mailman/listinfo/ietf-nntp>, <mailto:ietf-nntp-request@lists.eyrie.org?subject=subscribe>
Sender: ietf-nntp-bounces+nntpext-archive=ietf.org@lists.eyrie.org
Errors-To: ietf-nntp-bounces+nntpext-archive=ietf.org@lists.eyrie.org

Hi Sabahattin,

> I think we really need an effort to roll all these errata into
> 3977bis.

… and move the NNTP protocol to Draft Standard at the same time.



> But how do we
> distinguish, inside the server, an article that *might* be reinstated
> and one that just expired?

I think it is implementation-specific, and therefore not to be dealt 
with in an RFC.



>>> So what does a server do when the lowest-numbered article is
>>> pending reinstatement and the client requests it?
>>
>> The news server just answers the article does not exist:
>
> Is there any language which specifically allows the use of these
> codes for reporting an invalid article number because of a (possible)
> reinstatement?

The article does not exist.  The language is to respond 430/423/420.
(Please note that I wrote twice 423 in my previous mail; it was 423+420.)

Maybe you were asking for a new code telling that the article does not 
exist but may be reinstated?
It could be something to look at in RFC3977bis.  However, clients do not 
currently expect this possible new response code to existing commands 
like ARTICLE.



> This doesn't always
> work, but it does work 99% of the time.  Especially since many
> servers just don't do the reinstatement thing at all.

Though I do not have figures, I would tend to think that it is far more 
than 99%.  "Many servers don't do the reinstatement thing" might also be 
an euphemism :)

-- 
Julien ÉLIE

« Un voyage de mille lieues commence toujours par un premier pas. »
   (Lao Zi)

From ietf-nntp-bounces+nntpext-archive=ietf.org@lists.eyrie.org  Sun Jun 12 05:09:33 2011
Return-Path: <ietf-nntp-bounces+nntpext-archive=ietf.org@lists.eyrie.org>
X-Original-To: ietfarch-nntpext-archive@ietfa.amsl.com
Delivered-To: ietfarch-nntpext-archive@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 95CE211E809E for <ietfarch-nntpext-archive@ietfa.amsl.com>; Sun, 12 Jun 2011 05:09:33 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.999
X-Spam-Level: 
X-Spam-Status: No, score=-1.999 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, J_CHICKENPOX_57=0.6]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ASlpQHjoRvcE for <ietfarch-nntpext-archive@ietfa.amsl.com>; Sun, 12 Jun 2011 05:09:32 -0700 (PDT)
Received: from hope.eyrie.org (hope.eyrie.org [IPv6:2001:470:30:84:e276:63ff:fe62:3535]) by ietfa.amsl.com (Postfix) with ESMTP id 80AF411E8070 for <nntpext-archive@ietf.org>; Sun, 12 Jun 2011 05:09:29 -0700 (PDT)
Received: from hope.eyrie.org (unknown [IPv6:::1]) by hope.eyrie.org (Postfix) with ESMTP id 9268367DEA for <nntpext-archive@ietf.org>; Sun, 12 Jun 2011 05:09:28 -0700 (PDT)
X-Original-To: ietf-nntp@lists.eyrie.org
Delivered-To: ietf-nntp@lists.eyrie.org
Received: from nyder.davros.org (nyder.davros.org [82.68.24.146]) by hope.eyrie.org (Postfix) with ESMTP id E84EB67D05 for <ietf-nntp@lists.eyrie.org>; Sun, 12 Jun 2011 05:09:26 -0700 (PDT)
Received: from nyder.davros.org (localhost [127.0.0.1]) by nyder.davros.org (8.14.4/8.14.4) with ESMTP id p5CC5Ets033510; Sun, 12 Jun 2011 13:05:15 +0100 (BST) (envelope-from clive@nyder.davros.org)
Received: (from clive@localhost) by nyder.davros.org (8.14.4/8.14.4/Submit) id p5CC5E5D033509; Sun, 12 Jun 2011 13:05:14 +0100 (BST) (envelope-from clive)
Date: Sun, 12 Jun 2011 13:05:14 +0100
From: "Clive D.W. Feather" <clive@davros.org>
To: Sabahattin Gucukoglu <mail-dated-1310443066.1d7e94@sabahattin-gucukoglu.com>
Message-ID: <20110612120514.GC7272@davros.org>
References: <F5F3320A-9B6A-4566-889C-A667D1360871@sabahattin-gucukoglu.com> <4DCD6503.2060302@trigofacile.com> <E4634E62-C386-40D1-A2C2-BEC6D2331D90@sabahattin-gucukoglu.com> <4DCEDA10.5050402@trigofacile.com> <41FD59ED-16FD-4127-9D93-128690330AFC@sabahattin-gucukoglu.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <41FD59ED-16FD-4127-9D93-128690330AFC@sabahattin-gucukoglu.com>
User-Agent: Mutt/1.4.2.3i
Cc: ietf-nntp@lists.eyrie.org
Subject: Re: [NNTP] Article Reinstatement
X-BeenThere: ietf-nntp@lists.eyrie.org
X-Mailman-Version: 2.1.13
Precedence: list
List-Id: NNTP protocol discussion <ietf-nntp.lists.eyrie.org>
List-Unsubscribe: <http://lists.eyrie.org/mailman/options/ietf-nntp>, <mailto:ietf-nntp-request@lists.eyrie.org?subject=unsubscribe>
List-Archive: <http://lists.eyrie.org/pipermail/ietf-nntp>
List-Post: <mailto:ietf-nntp@lists.eyrie.org>
List-Help: <mailto:ietf-nntp-request@lists.eyrie.org?subject=help>
List-Subscribe: <http://lists.eyrie.org/mailman/listinfo/ietf-nntp>, <mailto:ietf-nntp-request@lists.eyrie.org?subject=subscribe>
Sender: ietf-nntp-bounces+nntpext-archive=ietf.org@lists.eyrie.org
Errors-To: ietf-nntp-bounces+nntpext-archive=ietf.org@lists.eyrie.org

Sabahattin Gucukoglu said:
> I think we really need an effort to roll all these errata into 3977bis.

I'm not clear that there is an error here.

>>>> It is not an RFC-compliant behaviour. min could not have been set
>>>> to 2.
> Yes, (as Clive correctly points out) very sensible.  But how do we distinguish, inside the server, an article that *might* be reinstated and one that just expired?

That's up to the implementer.

>>> So what does a server do when the lowest-numbered article is pending
>>> reinstatement and the client requests it?
>> The news server just answers the article does not exist:

Exactly.

> Is there any language which specifically allows the use of these codes for reporting an invalid article number because of a (possible) reinstatement?

Until and unless the article is reinstated, it does not exist. Full stop.

Reinstatement is either:
(1) a rare event (e.g. because of an erroneous cancel)
(2) a side-effect of running a server farm that isn't perfectly in sync.

>> And also the fact that articles can expire and no longer be present in the news spool.  The low water mark does not necessarily point to a still retrievable article at the time an ARTICLE command is sent.
> That's fine; such an article really would be no longer existent.

Until and unless an article has been reinstated, it does not exist.

>>> By which we understand that an invalid article response will result
>>> from requesting a removed article, yes?
>> Not "invalid", but "inexistent".
> Yes, OK, this needs to be rolled into bis.

What needs to be rolled in? 6.2.1.2 makes it perfectly clear that article
numbers are invalid once the article is removed, and then become valid
again if it is reinstated.

> This doesn't always work, but it does work 99% of the time.  Especially since many servers just don't do the reinstatement thing at all.

"Those who do not learn from history are doomed to repeat it."

The reinstatement wording was carefully worked out after experience with
real users and real server farms that weren't in perfect sync. You might
examine demon.service from 1995 to 1999 for some examples of upset users
(no, I can't give exact cites from this long ago).

-- 
Clive D.W. Feather          | If you lie to the compiler,
Email: clive@davros.org     | it will get its revenge.
Web: http://www.davros.org  |   - Henry Spencer
Mobile: +44 7973 377646
