From owner-ietf-mta-filters Mon Mar  8 09:40:29 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i28HeTLp084733;
	Mon, 8 Mar 2004 09:40:29 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i28HeTFD084732;
	Mon, 8 Mar 2004 09:40:29 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i28HeSod084726
	for <ietf-mta-filters@imc.org>; Mon, 8 Mar 2004 09:40:28 -0800 (PST)
	(envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243)
 id <01L7DP2016Q80027NR@mauve.mrochek.com> for ietf-mta-filters@imc.org; Mon,
 08 Mar 2004 09:40:30 -0800 (PST)
Date: Mon, 08 Mar 2004 09:22:25 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Comments on draft-daboo-sieve-mime-00.txt
In-reply-to: "Your message dated Thu, 05 Feb 2004 20:42:55 -0500"
 <104800.1076013775@ninevah.cyrusoft.com>
To: Cyrus Daboo <daboo@cyrusoft.com>
Cc: IETF MTA Filters List <ietf-mta-filters@imc.org>
Message-id: <01L7HAGIBZLW0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii; format=flowed
Content-transfer-encoding: 7BIT
References: <104800.1076013775@ninevah.cyrusoft.com>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


> FYI - the following is a draft for a new SIEVE operation for testing the
> content of MIME part headers. Comments welcome...

First let me say that I think the scope of this extension is right
on target - a simple mechanism that allows searching through embedded
part and message headers and which provides for simple checks against
media type and content disposition parammters is something we need.

Having said that, I think the specifics of how this was done aren't right.
First, as presently written this specification only extends the header test,
and it does so by creating an entirely new test. But there are two other tests
that are equally applicable to inner headers: exists and address. Either
similar "mimeexists" and "mimeaddress" tests need to be added (and perhaps
"mime" changed to "mimeheader"), or this needs to be done within the existing
tests by adding a :mime parameter. I'm indifferent as to which one of these
approaches is chosen, but we do need one of them.

Second, I really don't like the use of an optional middle parameter to specify
that the test is to be performed on a parameter value. This sort of thing is
why we have labelled parameters: It should be done as :parameter or something
similar. As for the use of a null parameter-names value to indicate a test of
non-paramer material, this can done with :parameter as well, but I do worry
that this is a bit tricky. OTOH, I haven't been able to come up with a
differenent way to do it that I like better.

Third, some references probably needs to be made to RFC 2231 and how to handle
encoded parameters. I think the right answer here is to handle this the same
way we already require that encoded words be handled.

A final implementation note. I threw together an implementation of this the
other day and I've already found it to be very useful. IMO this is an
extension we should try and advance sooner rather than later.

				Ned


From owner-ietf-mta-filters Thu Mar 11 02:13:17 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BADHIb053927;
	Thu, 11 Mar 2004 02:13:17 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BADHW4053926;
	Thu, 11 Mar 2004 02:13:17 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mout1.freenet.de (exim@mout1.freenet.de [194.97.50.132])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BADEV4053908
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 02:13:16 -0800 (PST)
	(envelope-from michael@freenet-ag.de)
Received: from [194.97.55.147] (helo=mx4.freenet.de)
	by mout1.freenet.de with asmtp (Exim 4.30)
	id 1B1NBb-0002Av-EG
	for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 11:13:07 +0100
Received: from nostromo.freenet-ag.de ([194.97.7.6])
	by mx4.freenet.de with esmtp (TLSv1:AES256-SHA:256) (Exim 4.303 #3)
	id 1B1NBb-0001OH-Cm
	for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 11:13:07 +0100
Received: from michael by nostromo.freenet-ag.de with local (ID michael) (Exim 4.303 #3)
	id 1B1NBa-0001RG-O0
	for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 11:13:06 +0100
To: ietf-mta-filters@mail.imc.org
Subject: Sieve extension to expire mails?
Message-Id: <E1B1NBa-0001RG-O0@nostromo.freenet-ag.de>
From: Michael Haardt <michael@freenet-ag.de>
Date: Thu, 11 Mar 2004 11:13:06 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


Hello,

I use a spam scanner which tags mail, Sieve to filter it in folders and
IMAP to access the folders, but I miss the function "keep mail up to n
days in this folder", as offered by some mail providers, badly.

For that reason, I would like opinions about a Sieve extension, which
allows the mail system to expire mails older than a set amount of time.
I say "allow", as the time of removal should not be specified.  Some
systems may do so in daily cleanup jobs, others when delivering the mail.

It is important that this function is not performed by the client,
because I would like to come back from a longer vacation and have the
last 7 days of a mailing list archived, not my mailbox flooded with it.

I can think of different ways right now:

Add an option to fileinto and keep, like:

  fileinto :expire 7 "inbox.mailinglist";

The advantage is probably easy implementation for cleanup on delivery,
but the disadvantage is having to specify it multiple times, if a script
files mail into that folder at different places, and more complicated
implementation of daily clenaup jobs.  This approach is the opposite:

  expire 7 "inbox.mailinglist";
  [actual filter code inclduing fileinto ... ]

Using expire to specify expiration times once at the beginning of the
script is more modular.  Periodic jobs could extract that information
easily and it separates folder attributes and filter logic.

In case more attributes of folders are required, perhaps a generic
statement would be useful:

  folder :expire 7 "inbox.mailinglist";

Do we need a better granularity than days? Does anybody have a better
idea how to add this feature to Sieve? 

Michael


From owner-ietf-mta-filters Thu Mar 11 02:35:18 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BAZH8b055063;
	Thu, 11 Mar 2004 02:35:17 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BAZHoQ055062;
	Thu, 11 Mar 2004 02:35:17 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from quasar.skima.is (quasar.skima.is [212.30.200.205])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BAZGpp055054
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 02:35:17 -0800 (PST)
	(envelope-from gsh@centrum.is)
Received: from AZ01663 ([192.147.34.142] [192.147.34.142]) by quasar.skima.is with ESMTP; Thu, 11 Mar 2004 10:35:09 Z
Message-Id: <003f01c40754$873b8a50$2a4115ac@siminn.is>
From: "=?iso-8859-1?Q?Gu=F0bj=F6rn_S._Hreinsson?=" <gsh@centrum.is>
To: <ietf-mta-filters@mail.imc.org>, "Michael Haardt" <michael@freenet-ag.de>
References: <E1B1NBa-0001RG-O0@nostromo.freenet-ag.de>
Subject: Re: Sieve extension to expire mails?
Date: Thu, 11 Mar 2004 10:35:09 -0000
MIME-Version: 1.0
Content-Type: text/plain;
	charset="iso-8859-1"
Content-Transfer-Encoding: 7bit
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


This is usually a folder property that a mailstore process removes messages
based on. Do you want this to be a message property? I really see no reason
why a sieve extension is needed for this, if you mark a message and the user
prefers to remove such messages after x hours/days then it should be a
function
in the delivery process and mailstore cleanup?

Or is sieve now more than a mta filter language?

Rgds,
-GSH

----- Original Message ----- 
From: "Michael Haardt" <michael@freenet-ag.de>
To: <ietf-mta-filters@mail.imc.org>
Sent: Thursday, March 11, 2004 10:13 AM
Subject: Sieve extension to expire mails?


>
> Hello,
>
> I use a spam scanner which tags mail, Sieve to filter it in folders and
> IMAP to access the folders, but I miss the function "keep mail up to n
> days in this folder", as offered by some mail providers, badly.
>
> For that reason, I would like opinions about a Sieve extension, which
> allows the mail system to expire mails older than a set amount of time.
> I say "allow", as the time of removal should not be specified.  Some
> systems may do so in daily cleanup jobs, others when delivering the mail.
>
> It is important that this function is not performed by the client,
> because I would like to come back from a longer vacation and have the
> last 7 days of a mailing list archived, not my mailbox flooded with it.
>
> I can think of different ways right now:
>
> Add an option to fileinto and keep, like:
>
>   fileinto :expire 7 "inbox.mailinglist";
>
> The advantage is probably easy implementation for cleanup on delivery,
> but the disadvantage is having to specify it multiple times, if a script
> files mail into that folder at different places, and more complicated
> implementation of daily clenaup jobs.  This approach is the opposite:
>
>   expire 7 "inbox.mailinglist";
>   [actual filter code inclduing fileinto ... ]
>
> Using expire to specify expiration times once at the beginning of the
> script is more modular.  Periodic jobs could extract that information
> easily and it separates folder attributes and filter logic.
>
> In case more attributes of folders are required, perhaps a generic
> statement would be useful:
>
>   folder :expire 7 "inbox.mailinglist";
>
> Do we need a better granularity than days? Does anybody have a better
> idea how to add this feature to Sieve?
>
> Michael
>
>


From owner-ietf-mta-filters Thu Mar 11 03:12:28 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BBCPTw057544;
	Thu, 11 Mar 2004 03:12:27 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BBCPcN057543;
	Thu, 11 Mar 2004 03:12:25 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mout2.freenet.de (mout2.freenet.de [194.97.50.155])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BBCOAI057537
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 03:12:25 -0800 (PST)
	(envelope-from michael@freenet-ag.de)
Received: from [194.97.50.138] (helo=mx0.freenet.de)
	by mout2.freenet.de with asmtp (Exim 4.30)
	id 1B1O6y-0007ab-TK
	for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 12:12:24 +0100
Received: from nostromo.freenet-ag.de ([194.97.7.6])
	by mx0.freenet.de with esmtp (TLSv1:AES256-SHA:256) (Exim 4.303 #2)
	id 1B1O6y-0000xJ-RG
	for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 12:12:24 +0100
Received: from michael by nostromo.freenet-ag.de with local (ID michael) (Exim 4.303 #3)
	id 1B1O6y-0001VV-9z
	for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 12:12:24 +0100
To: ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
Message-Id: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
From: Michael Haardt <michael@freenet-ag.de>
Date: Thu, 11 Mar 2004 12:12:24 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


> This is usually a folder property that a mailstore process removes messages
> based on. Do you want this to be a message property? I really see no reason
> why a sieve extension is needed for this, if you mark a message and the user
> prefers to remove such messages after x hours/days then it should be a
> function
> in the delivery process and mailstore cleanup?
>
> Or is sieve now more than a mta filter language?

The idea of a folder property versus a message property is interesting,
but indeed I thought about a folder property to be specified by Sieve.
Expiring mails on delivery is way more efficient than daily jobs, because
on many systems (e.g. maildir) the folder contents are already in the page
cache.  Sieve, as MDA filter, controls local delivery on my systems and if
local delivery includes expiration, it feels natural to control that, too.

Michael


From owner-ietf-mta-filters Thu Mar 11 05:08:10 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BD8AJS064540;
	Thu, 11 Mar 2004 05:08:10 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BD8Au6064539;
	Thu, 11 Mar 2004 05:08:10 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from kalyani.oryx.com (kalyani.oryx.com [212.125.101.207])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BD85WB064530
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 05:08:09 -0800 (PST)
	(envelope-from arnt@gulbrandsen.priv.no)
Received: from libertango.oryx.com (libertango.oryx.com [195.30.94.163])
	(using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
	(No client certificate requested)
	by kalyani.oryx.com (Postfix) with ESMTP id 7F2001BDE23
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 14:07:53 +0100 (CET)
Message-Id: <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com>
From: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>
To: ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
In-Reply-To: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
Content-Type: text/plain; format=flowed
MIME-Version: 1.0
Date: Thu, 11 Mar 2004 14:08:52 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


Michael Haardt writes:
> The idea of a folder property versus a message property is 
> interesting, but indeed I thought about a folder property to be 
> specified by Sieve. Expiring mails on delivery is way more efficient 
> than daily jobs, because on many systems (e.g. maildir) the folder 
> contents are already in the page cache. Sieve, as MDA filter, 
> controls local delivery on my systems and if local delivery includes 
> expiration, it feels natural to control that, too.

Sieve, as a language/protocol, must be held to stricter standards than 
any single implementation.

If sieve makes the promise that a a mailbox should contain only the past 
seven days' mail, users might reasonably rely on that. If, then, no 
mail is delivered in seven days, the mailbox should STILL contain the 
past seven days' mail (that is, it should be empty). If expiry happens 
as part of delivery, older mail will still be retrievable.

If your implementation confuses delivery and expiry, that's okay. You 
have a privacy/security issue, that's all. But if the sieve language 
confuses them, all implementations do. Much worse.

FWIW, I also don't like the idea of sieve managing folder properties. 
That seems to be out of scope for sieve.

Arnt


From owner-ietf-mta-filters Thu Mar 11 06:01:10 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BE1AqU066835;
	Thu, 11 Mar 2004 06:01:10 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BE1Add066834;
	Thu, 11 Mar 2004 06:01:10 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mout1.freenet.de (mout1.freenet.de [194.97.50.132])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BE199l066826
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 06:01:10 -0800 (PST)
	(envelope-from michael@freenet-ag.de)
Received: from [194.97.55.147] (helo=mx4.freenet.de)
	by mout1.freenet.de with asmtp (Exim 4.30)
	id 1B1QkE-00009x-8J
	for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 15:01:06 +0100
Received: from nostromo.freenet-ag.de ([194.97.7.6])
	by mx4.freenet.de with esmtp (TLSv1:AES256-SHA:256) (Exim 4.303 #3)
	id 1B1QkE-000598-5R
	for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 15:01:06 +0100
Received: from michael by nostromo.freenet-ag.de with local (ID michael) (Exim 4.303 #3)
	id 1B1QkD-0001eg-T3
	for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 15:01:05 +0100
To: ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
Message-Id: <E1B1QkD-0001eg-T3@nostromo.freenet-ag.de>
From: Michael Haardt <michael@freenet-ag.de>
Date: Thu, 11 Mar 2004 15:01:05 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


> Sieve, as a language/protocol, must be held to stricter standards than 
> any single implementation.

I gave an example, where I know that expiry on delivery would be almost
for free, to show that there are alternatives to a regular cleanup job.
That's why I would allow both.

> If sieve makes the promise that a a mailbox should contain only the past 
> seven days' mail, users might reasonably rely on that.

If Sieve makes that promise, yes, but that's not what I was talking about.
I didn't talk about a privacy feature, either, but about a convenience
feature, and that's why I don't have a "privacy/security issue".

The feature I described is: Hey, MDA, you can throw messages in this
folder away after n days.  A great thing for subscribed newsletters.

> FWIW, I also don't like the idea of sieve managing folder properties. 
> That seems to be out of scope for sieve.

That's a point I can understand.  If Sieve focuses only on messages,
then manipulating persistent folder attributes would be simply out
of scope.  Does it focus strictly on messages, not folders, despite
folders containing messages?

If so, how about message attributes to allow expiration to happen?

Michael


From owner-ietf-mta-filters Thu Mar 11 06:27:40 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BEReTx067960;
	Thu, 11 Mar 2004 06:27:40 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BERenf067959;
	Thu, 11 Mar 2004 06:27:40 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from kalyani.oryx.com (kalyani.oryx.com [212.125.101.207])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BERd6j067953
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 06:27:39 -0800 (PST)
	(envelope-from arnt@gulbrandsen.priv.no)
Received: from libertango.oryx.com (libertango.oryx.com [195.30.94.163])
	(using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
	(No client certificate requested)
	by kalyani.oryx.com (Postfix) with ESMTP id 016FE1BDE6B
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 15:27:39 +0100 (CET)
Message-Id: <oVQ+E0hsQtDcieakBsIt5w.md5@libertango.oryx.com>
From: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>
To: ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
References: <E1B1QkD-0001eg-T3@nostromo.freenet-ag.de>
In-Reply-To: <E1B1QkD-0001eg-T3@nostromo.freenet-ag.de>
Content-Type: text/plain; format=flowed
MIME-Version: 1.0
Date: Thu, 11 Mar 2004 15:28:38 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


Michael Haardt writes:
> If Sieve makes that promise, yes, but that's not what I was talking 
> about. I didn't talk about a privacy feature, either, but about a 
> convenience feature, and that's why I don't have a "privacy/security 
> issue".

It's a privacy/security issue the moment a user misunderstands, and 
relies on the feature.

>>  FWIW, I also don't like the idea of sieve managing folder 
>>  properties. That seems to be out of scope for sieve.
>
> That's a point I can understand. If Sieve focuses only on messages, 
> then manipulating persistent folder attributes would be simply out of 
> scope. Does it focus strictly on messages, not folders, despite 
> folders containing messages?

Yes. Sieve ignores folders almost entirely. (Except that fileinto may 
create a folder.)

> If so, how about message attributes to allow expiration to happen?

Much better.

Such attributes are called annotations in IMAPspeak, and they're 
supported by the ANNOTATE extension, which is itself still a draft and 
not terribly widely implemented. If there isn't yet a sieve extension 
to set a message annotation, there certainly should be.

Arnt


From owner-ietf-mta-filters Thu Mar 11 06:31:48 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BEVm2b068237;
	Thu, 11 Mar 2004 06:31:48 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BEVmx1068236;
	Thu, 11 Mar 2004 06:31:48 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from quasar.skima.is (quasar.skima.is [212.30.200.205])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BEVkdf068230
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 06:31:47 -0800 (PST)
	(envelope-from gsh@centrum.is)
Received: from AZ01663 ([192.147.34.142] [192.147.34.142]) by quasar.skima.is with ESMTP; Thu, 11 Mar 2004 14:31:48 Z
Message-Id: <017601c40775$95ef9110$2a4115ac@siminn.is>
From: "=?iso-8859-1?Q?Gu=F0bj=F6rn_S._Hreinsson?=" <gsh@centrum.is>
To: <ietf-mta-filters@mail.imc.org>, "Michael Haardt" <michael@freenet-ag.de>
References: <E1B1QkD-0001eg-T3@nostromo.freenet-ag.de>
Subject: Re: Sieve extension to expire mails?
Date: Thu, 11 Mar 2004 14:31:48 -0000
MIME-Version: 1.0
Content-Type: text/plain;
	charset="iso-8859-1"
Content-Transfer-Encoding: 7bit
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


> If so, how about message attributes to allow expiration to happen?

Nothing wrong with that. You could maintain messages in the users 
maildir (however you store them) and maintain information about 
thoses messages in a db, like sleepycat for instance. Relatively simple 
and cheap to read that db for messages that need to be expired and 
expire those that are due...

Rgds,
-GSH


From owner-ietf-mta-filters Thu Mar 11 06:53:09 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BEr995069385;
	Thu, 11 Mar 2004 06:53:09 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BEr9aa069384;
	Thu, 11 Mar 2004 06:53:09 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BEr89L069378
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 06:53:08 -0800 (PST)
	(envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243)
 id <01L7KTEM74YO0027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org;
 Thu, 11 Mar 2004 06:53:09 -0800 (PST)
Date: Thu, 11 Mar 2004 06:42:24 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Sieve extension to expire mails?
In-reply-to: "Your message dated Thu, 11 Mar 2004 14:08:52 +0100"
 <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com>
To: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>
Cc: ietf-mta-filters@mail.imc.org
Message-id: <01L7LBH2PFU40027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii; format=flowed
Content-transfer-encoding: 7BIT
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
 <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>



> Michael Haardt writes:
> > The idea of a folder property versus a message property is
> > interesting, but indeed I thought about a folder property to be
> > specified by Sieve. Expiring mails on delivery is way more efficient
> > than daily jobs, because on many systems (e.g. maildir) the folder
> > contents are already in the page cache. Sieve, as MDA filter,
> > controls local delivery on my systems and if local delivery includes
> > expiration, it feels natural to control that, too.

> Sieve, as a language/protocol, must be held to stricter standards than
> any single implementation.

I agree 100%

> If sieve makes the promise that a a mailbox should contain only the past
> seven days' mail, users might reasonably rely on that. If, then, no
> mail is delivered in seven days, the mailbox should STILL contain the
> past seven days' mail (that is, it should be empty). If expiry happens
> as part of delivery, older mail will still be retrievable.

I guess I have no problem per se with having per-folder or per-mailbox
expirations. But sieve operates per-message, not per-folder or per-mailbox.
Supporting per-message expirations is considerably more difficult than
per-folder or per-mailbox, and I doubt if the benefits are worth the cost.

But regardless of the expiration model, this proposal seems to me to be
putting the cart before the horse - we'd need to define an IMAP expiration
extension before it is reasonable to extend sieve to support it. And such a
sieve extension only makes sense if the model chosen for expirations is
per-message.

> If your implementation confuses delivery and expiry, that's okay. You
> have a privacy/security issue, that's all. But if the sieve language
> confuses them, all implementations do. Much worse.

> FWIW, I also don't like the idea of sieve managing folder properties.
> That seems to be out of scope for sieve.

Exactly right. If the expiration model is per-folder or per-mailbox sieve
has no business trying to muck with it.

				Ned


From owner-ietf-mta-filters Thu Mar 11 07:04:29 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BF4Tml070972;
	Thu, 11 Mar 2004 07:04:29 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BF4TTu070971;
	Thu, 11 Mar 2004 07:04:29 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from tierw.net.avaya.com (tierw.net.avaya.com [198.152.13.100])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BF4Op8070957
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 07:04:24 -0800 (PST)
	(envelope-from rickblock@avaya.com)
Received: from tierw.net.avaya.com (localhost [127.0.0.1])
	by tierw.net.avaya.com (Switch-3.1.2/Switch-3.1.0) with ESMTP id i2BF0DE0028155;
	Thu, 11 Mar 2004 10:00:13 -0500 (EST)
Received: from bighorn.dr.avaya.com (h135-9-1-59.avaya.com [135.9.1.59])
	by tierw.net.avaya.com (Switch-3.1.2/Switch-3.1.0) with SMTP id i2BF0BE0028111;
	Thu, 11 Mar 2004 10:00:12 -0500 (EST)
Received: from avaya.com by bighorn.dr.avaya.com (SMI-8.6/EMS-1.5 sol2)
	id IAA18336; Thu, 11 Mar 2004 08:04:20 -0700
Message-ID: <40508037.6080600@avaya.com>
Date: Thu, 11 Mar 2004 08:05:27 -0700
From: Rick Block <rickblock@avaya.com>
User-Agent: Mozilla/5.0 (Windows; U; Win98; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: ned.freed@mrochek.com
CC: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com>
In-Reply-To: <01L7LBH2PFU40027NR@mauve.mrochek.com>
Content-Type: text/plain; charset=us-ascii; format=flowed
Content-Transfer-Encoding: 7bit
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>




ned.freed@mrochek.com wrote:
> But regardless of the expiration model, this proposal seems to me to be
> putting the cart before the horse - we'd need to define an IMAP expiration
> extension before it is reasonable to extend sieve to support it. And such a
> sieve extension only makes sense if the model chosen for expirations is
> per-message.

Expiration based on message age is common in voicemail systems.  Some
such systems warn users about messages about to expire and allow users
to "renew" messages, so although the expiration interval is typically
per mailbox/folder the expiry process must be driven by a writable
per message property (one of effective date or expiration date).

-Rick


From owner-ietf-mta-filters Thu Mar 11 07:13:21 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFDLJA071700;
	Thu, 11 Mar 2004 07:13:21 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BFDLD0071699;
	Thu, 11 Mar 2004 07:13:21 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFDK7T071693
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 07:13:20 -0800 (PST)
	(envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243)
 id <01L7KTEM74YO0027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org;
 Thu, 11 Mar 2004 07:13:22 -0800 (PST)
Date: Thu, 11 Mar 2004 07:04:01 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Sieve extension to expire mails?
In-reply-to: "Your message dated Thu, 11 Mar 2004 15:28:38 +0100"
 <oVQ+E0hsQtDcieakBsIt5w.md5@libertango.oryx.com>
To: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>
Cc: ietf-mta-filters@mail.imc.org
Message-id: <01L7LC73VQZ40027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii; format=flowed
Content-transfer-encoding: 7BIT
References: <E1B1QkD-0001eg-T3@nostromo.freenet-ag.de>
 <oVQ+E0hsQtDcieakBsIt5w.md5@libertango.oryx.com>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


> > That's a point I can understand. If Sieve focuses only on messages,
> > then manipulating persistent folder attributes would be simply out of
> > scope. Does it focus strictly on messages, not folders, despite
> > folders containing messages?

> Yes. Sieve ignores folders almost entirely. (Except that fileinto may
> create a folder.)

And IMAP's folder-level capabilities are somewhat limited.

> > If so, how about message attributes to allow expiration to happen?

> Much better.

> Such attributes are called annotations in IMAPspeak, and they're
> supported by the ANNOTATE extension, which is itself still a draft and
> not terribly widely implemented. If there isn't yet a sieve extension
> to set a message annotation, there certainly should be.

Yes, a sieve extension to interface with the IMAP ANNOTATE extension makes
sense, assuming of course that IMAP ANNOTATE is approved. But it only makes
sense to use annotations for storying expiry information if it is done
per-message. And even then a separate IMAP extension would need to be defined.

				Ned


From owner-ietf-mta-filters Thu Mar 11 07:24:56 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFOuTm072122;
	Thu, 11 Mar 2004 07:24:56 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BFOuAq072121;
	Thu, 11 Mar 2004 07:24:56 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFOt43072114
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 07:24:55 -0800 (PST)
	(envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8])
	(user=rjs3 mech=GSSAPI (0 bits))
	by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2BFOtkw014373;
	Thu, 11 Mar 2004 10:24:55 -0500
Date: Thu, 11 Mar 2004 10:24:55 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: ned.freed@mrochek.com
cc: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
In-Reply-To: <01L7LBH2PFU40027NR@mauve.mrochek.com>
Message-ID: <Pine.LNX.4.58-035.0403111022500.23108@sourcefour.andrew.cmu.edu>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
 <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Thu, 11 Mar 2004 ned.freed@mrochek.com wrote:

> But regardless of the expiration model, this proposal seems to me to be
> putting the cart before the horse - we'd need to define an IMAP expiration
> extension before it is reasonable to extend sieve to support it. And such a
> sieve extension only makes sense if the model chosen for expirations is
> per-message.

There's nothing that says we need an IMAP extension for expiration before
defining a sieve extension for expiration.  Sieve can work in enviornments
other than IMAP.

You could also have a sieve implementation that ran against the current
contents of a mailbox iteratively, and threw out (or refiled) all messages
older than the expiration date, for example [though I suppose this relies
more on a date comparison extension than any particular "Expire"
extension].

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----


From owner-ietf-mta-filters Thu Mar 11 07:22:49 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFMnqO072022;
	Thu, 11 Mar 2004 07:22:49 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BFMnpf072021;
	Thu, 11 Mar 2004 07:22:49 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFMmqa072015
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 07:22:48 -0800 (PST)
	(envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8])
	(user=rjs3 mech=GSSAPI (0 bits))
	by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2BFMjkw014366;
	Thu, 11 Mar 2004 10:22:45 -0500
Date: Thu, 11 Mar 2004 10:22:46 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: ned.freed@mrochek.com
cc: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
In-Reply-To: <01L7LC73VQZ40027NR@mauve.mrochek.com>
Message-ID: <Pine.LNX.4.58-035.0403111021250.23108@sourcefour.andrew.cmu.edu>
References: <E1B1QkD-0001eg-T3@nostromo.freenet-ag.de>
 <oVQ+E0hsQtDcieakBsIt5w.md5@libertango.oryx.com> <01L7LC73VQZ40027NR@mauve.mrochek.com>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Thu, 11 Mar 2004 ned.freed@mrochek.com wrote:

> Yes, a sieve extension to interface with the IMAP ANNOTATE extension makes
> sense, assuming of course that IMAP ANNOTATE is approved. But it only makes
> sense to use annotations for storying expiry information if it is done
> per-message. And even then a separate IMAP extension would need to be defined.

I suspect it makes more sense (in general) to ahve a per-folder
(ANNOTATEMORE) entry to perform expiration (Cyrus IMAP provides this now
using a vendor annotation).  I suppose a per-folder annotation could just
be used as a default value for a per-message annotation too, however..

[as we venture off-topic]...

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----


From owner-ietf-mta-filters Thu Mar 11 07:52:38 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFqcWw073584;
	Thu, 11 Mar 2004 07:52:38 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BFqcwQ073583;
	Thu, 11 Mar 2004 07:52:38 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from kalyani.oryx.com (kalyani.oryx.com [212.125.101.207])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFqbnx073577
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 07:52:38 -0800 (PST)
	(envelope-from arnt@gulbrandsen.priv.no)
Received: from libertango.oryx.com (libertango.oryx.com [195.30.94.163])
	(using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
	(No client certificate requested)
	by kalyani.oryx.com (Postfix) with ESMTP id AFA251BDE70
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 16:52:37 +0100 (CET)
Message-Id: <llTNzoWCn6UC5XBystZ9Jw.md5@libertango.oryx.com>
From: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>
To: ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
 <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com>
 <01L7LBH2PFU40027NR@mauve.mrochek.com>
 <Pine.LNX.4.58-035.0403111022500.23108@sourcefour.andrew.cmu.edu>
In-Reply-To: <Pine.LNX.4.58-035.0403111022500.23108@sourcefour.andrew.cmu.edu>
Content-Type: text/plain; format=flowed
MIME-Version: 1.0
Date: Thu, 11 Mar 2004 16:53:37 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


Rob Siemborski writes:
> On Thu, 11 Mar 2004 ned.freed@mrochek.com wrote:
>
>>  But regardless of the expiration model, this proposal seems to me to 
>>  be putting the cart before the horse - we'd need to define an IMAP 
>>  expiration extension before it is reasonable to extend sieve to 
>>  support it. And such a sieve extension only makes sense if the 
>>  model chosen for expirations is per-message.
>
> There's nothing that says we need an IMAP extension for expiration 
> before defining a sieve extension for expiration. Sieve can work in 
> enviornments other than IMAP.

It can. But since the two tend to go together in practice, I'd say that 
extensions should too, if only to lessen the chance of future gotchas. 
I would hate to stumble into another maze like ACL/2.

As I read the ANNOTATE draft, Freenet is free to say that 
/vendor/freenet/expiry is an integer containing some number of days, 
counting from the INTERNALDATE. No extension needed.

Arnt


From owner-ietf-mta-filters Thu Mar 11 07:47:15 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFlFGg073362;
	Thu, 11 Mar 2004 07:47:15 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BFlFtK073361;
	Thu, 11 Mar 2004 07:47:15 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFlFY8073355
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 07:47:15 -0800 (PST)
	(envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243)
 id <01L7KTEM74YO0027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org;
 Thu, 11 Mar 2004 07:47:17 -0800 (PST)
Date: Thu, 11 Mar 2004 07:36:32 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Sieve extension to expire mails?
In-reply-to: "Your message dated Thu, 11 Mar 2004 08:05:27 -0700"
 <40508037.6080600@avaya.com>
To: Rick Block <rickblock@avaya.com>
Cc: ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>,
        ietf-mta-filters@mail.imc.org
Message-id: <01L7LDD65YBO0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii; format=flowed
Content-transfer-encoding: 7BIT
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
 <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com>
 <01L7LBH2PFU40027NR@mauve.mrochek.com> <40508037.6080600@avaya.com>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


> > But regardless of the expiration model, this proposal seems to me to be
> > putting the cart before the horse - we'd need to define an IMAP expiration
> > extension before it is reasonable to extend sieve to support it. And such a
> > sieve extension only makes sense if the model chosen for expirations is
> > per-message.

> Expiration based on message age is common in voicemail systems.  Some
> such systems warn users about messages about to expire and allow users
> to "renew" messages, so although the expiration interval is typically
> per mailbox/folder the expiry process must be driven by a writable
> per message property (one of effective date or expiration date).

First, the fact that some (but by no means all) voice mail systems work this
way doesn't make it a good idea for email systems to work this way. My
voicemail is seriously stressed by my having 20 stored messages in it. In
contrast, my email handles more than 2,000,000 stored messages without
incident, and I routinely put more than 20,000 messages in a single folder.
Per-message expirations could easily have a deleterious effect on this sort of
scalability.

Second, even assuming per-message expiries are a good idea doesn't change the
fact that this proposal is being made in the wrong venue. An IMAP extension
needs to be specified first. Only after that is in place does it make sense to
consider whether or not a sieve extension makes sense. And this in turn
breaks down into three cases:

(1) Expiration is done per-folder or per-mailbox. Sieve deals with messages,
    not folders or mailboxes, so an extension is inappropriate.

(2) Expiration is done per-message using annotations. A sieve extension
    to deal with annotations makes sense in this case; a sieve extension
    to deal with expiration specifically does not.

(3) Expiration is done separately from annotations. A sieve extension may
    make sense in this case, but the odds of this being the way expirations
    get implemented are very, very low.

				Ned


From owner-ietf-mta-filters Thu Mar 11 09:14:57 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BHEv4R079660;
	Thu, 11 Mar 2004 09:14:57 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BHEvfL079659;
	Thu, 11 Mar 2004 09:14:57 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BHEuv9079653
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 09:14:56 -0800 (PST)
	(envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243)
 id <01L7KTEM74YO0027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org;
 Thu, 11 Mar 2004 09:14:58 -0800 (PST)
Date: Thu, 11 Mar 2004 09:06:31 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Sieve extension to expire mails?
In-reply-to: "Your message dated Thu, 11 Mar 2004 10:24:55 -0500 (EST)"
 <Pine.LNX.4.58-035.0403111022500.23108@sourcefour.andrew.cmu.edu>
To: Rob Siemborski <rjs3@andrew.cmu.edu>
Cc: ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>,
        ietf-mta-filters@mail.imc.org
Message-id: <01L7LGFVMRCI0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii
Content-transfer-encoding: 7BIT
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
 <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com>
 <01L7LBH2PFU40027NR@mauve.mrochek.com>
 <Pine.LNX.4.58-035.0403111022500.23108@sourcefour.andrew.cmu.edu>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


> On Thu, 11 Mar 2004 ned.freed@mrochek.com wrote:

> > But regardless of the expiration model, this proposal seems to me to be
> > putting the cart before the horse - we'd need to define an IMAP expiration
> > extension before it is reasonable to extend sieve to support it. And such a
> > sieve extension only makes sense if the model chosen for expirations is
> > per-message.

> There's nothing that says we need an IMAP extension for expiration before
> defining a sieve extension for expiration.  Sieve can work in enviornments
> other than IMAP.

Perhaps, but if we decide on this course it will be the first time we've
created an action in sieve that isn't bound to a well understand protocol
semantic defined elsewhere. Every existing action (keep, reject, fileinto,
discard, redirect, and even addheader and refuse) depends normatively
on these sorts of semantics.

For example, folders exist independent of IMAP, but having IMAP there to define
the essential semantics of folders is very useful. Failing to capture the
semantics of message expiration outside the context of sieve would IMO be a
mistake.

> You could also have a sieve implementation that ran against the current
> contents of a mailbox iteratively, and threw out (or refiled) all messages
> older than the expiration date, for example [though I suppose this relies
> more on a date comparison extension than any particular "Expire"
> extension].

Sure, and I'm reasonably comfortable with this, although to be fair it does
extent the applicability of sieve past the use on or around the time of
delivery.

				Ned


From owner-ietf-mta-filters Thu Mar 11 15:38:08 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BNc7MR004765;
	Thu, 11 Mar 2004 15:38:08 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2BNc7wa004764;
	Thu, 11 Mar 2004 15:38:07 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40])
	by above.proper.com (8.12.11/8.12.8) with SMTP id i2BNc2kl004756
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 15:38:02 -0800 (PST)
	(envelope-from mem@mv.mv.com)
Received: (qmail 10022 invoked from network); 11 Mar 2004 18:37:36 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17)
  by mercury.mv.net with SMTP; 11 Mar 2004 18:38:07 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40
  local-name mercury.mv.net
Received: (qmail 24788 invoked by uid 101); 11 Mar 2004 18:37:35 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Thu, 11 Mar 2004 18:37:35 -0500
To: ned.freed@mrochek.com
Cc: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
Message-ID: <20040311233735.GC23860@iridium.mv.net>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <01L7LBH2PFU40027NR@mauve.mrochek.com>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Thu, Mar 11, 2004 at 06:42:24AM -0800, ned.freed@mrochek.com wrote:
> 
> >Michael Haardt writes:
> 
> >If sieve makes the promise that a a mailbox should contain only the past
> >seven days' mail, users might reasonably rely on that. If, then, no
> >mail is delivered in seven days, the mailbox should STILL contain the
> >past seven days' mail (that is, it should be empty). If expiry happens
> >as part of delivery, older mail will still be retrievable.
> 
> I guess I have no problem per se with having per-folder or per-mailbox
> expirations. But sieve operates per-message, not per-folder or per-mailbox.
> Supporting per-message expirations is considerably more difficult than
> per-folder or per-mailbox, and I doubt if the benefits are worth the cost.

Just to back up a little bit: I've got a similar item on my own
todo/wish list, so I do support a related concept.  However I don't
look at it as a sieve agent managing mailbox expirations.  Pure mailbox
expirations are, I would agree, more of an external maintenance function.
The thing that I would like to see is more of limiting the volume
of a folder, either in terms of total data size or of number of messages.
So either

    fileinto :keep-maximum-messages 100 "somefolder";
or
    fileinto :keep-maximum-storage 100k "somefolder";
(or both).

One comment raised was along the lines of "sieve deals with messages,
not with folders."  I would contend that sieve is a language that can
operate inside of many contexts, one of which is local delivery.  With
local delivery, the distinction is blurred.  I own my incoming mail,
and I own my stored folders, and I want to be able to tell my delivery
agent how to manage both of them and resolve a storage/quota issue in
a reasonably understandable way.  This sort of thing (which I think of
as "rolling mailboxes") would be a nice facility for quarantining
incoming messages which, without the facility, one might otherwise
simply delete.

Also, I understand the philosophy that says that this sort of thing
should be an attribute of a folder.  However I don't agree that every
operation that you might want to do on a folder should be expressed as
a folder attribute, especially one with magic side effects.  There's
really nothing wrong with expressing folder limits as a control over
delivery; the distinction is where and how you express it.  Expressing
it inside a delivery script is as much setting a folder/delivery
attribute as is expressing it in some parameter attached to the
folder.  BTW I have nothing against either.  (This is kind of like the
way that various OSes differ in their treatment of files: in some, one
configures files to behave in a certain way; in others, one writes
programs to treat files in different ways.)


> But regardless of the expiration model, this proposal seems to me to be
> putting the cart before the horse - we'd need to define an IMAP expiration
> extension before it is reasonable to extend sieve to support it. And such a
> sieve extension only makes sense if the model chosen for expirations is
> per-message.

I don't really see why IMAP should drive SIEVE (then again, I'm no
longer talking about "expiration" so this may not be a disagreement.)
SIEVE is a filtering language, IMAP is a folder access protocol.  They
are not the same, although I understand that for some, they are
intertwined.  But I wouldn't use that subset of circumstances as a
driver for SIEVE functionality.  (If I'm misunderstanding, I'm happy
to be educated.)

Bottom line: I don't (necessarily) support sieve dictating folder
expiration, but would look forward to a "rolling mailbox" sort of
facility.

Yours,
-mm-


From owner-ietf-mta-filters Thu Mar 11 17:59:34 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2C1xYpc011704;
	Thu, 11 Mar 2004 17:59:34 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2C1xY8p011703;
	Thu, 11 Mar 2004 17:59:34 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2C1xTb4011696
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 17:59:29 -0800 (PST)
	(envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243)
 id <01L7KTEM74YO0027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org;
 Thu, 11 Mar 2004 17:59:34 -0800 (PST)
Date: Thu, 11 Mar 2004 17:34:36 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Sieve extension to expire mails?
In-reply-to: "Your message dated Thu, 11 Mar 2004 18:37:35 -0500"
 <20040311233735.GC23860@iridium.mv.net>
To: "Mark E. Mallett" <mem@mv.mv.com>
Cc: ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>,
        ietf-mta-filters@mail.imc.org
Message-id: <01L7LYRALADE0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii
Content-transfer-encoding: 7BIT
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
 <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com>
 <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


> > > If sieve makes the promise that a a mailbox should contain only the past
> > > seven days' mail, users might reasonably rely on that. If, then, no
> > > mail is delivered in seven days, the mailbox should STILL contain the
> > > past seven days' mail (that is, it should be empty). If expiry happens
> > > as part of delivery, older mail will still be retrievable.

> > I guess I have no problem per se with having per-folder or per-mailbox
> > expirations. But sieve operates per-message, not per-folder or per-mailbox.
> > Supporting per-message expirations is considerably more difficult than
> > per-folder or per-mailbox, and I doubt if the benefits are worth the cost.

> Just to back up a little bit: I've got a similar item on my own
> todo/wish list, so I do support a related concept.  However I don't
> look at it as a sieve agent managing mailbox expirations.  Pure mailbox
> expirations are, I would agree, more of an external maintenance function.
> The thing that I would like to see is more of limiting the volume
> of a folder, either in terms of total data size or of number of messages.
> So either

>     fileinto :keep-maximum-messages 100 "somefolder";
> or
>     fileinto :keep-maximum-storage 100k "somefolder";
> (or both).

Or how about limits on an entire folder tree? Or limits expressed in terms of
messages with different characteristics? (These are not theoretical -- I've
seen requests for both of these.) The list goes on and on and on.

Like it or not, this is digging deep into the general area of message store
semantics and brings up any number of fairly subtle issues, e.g., are the
criteria met by deleting old messages, deleting the largest messages, holding
new messages, bouncing new messages, etc. etc.

I will again repeat that this is an area that sieve has previously succeeded in
avoiding, and given that we have at least two active working groups (IMAPEXT
and LEMONADE) playing in this general area, plus one  inactive one that has
come fairly close to this space (ACAP) I think it is unlikely in the extreme
that sieve work on such things will be uncontroversial. Remember, we made an
intentional choice not to be an IETF working group, and that choice  has
consequences, both good and bad.

> One comment raised was along the lines of "sieve deals with messages,
> not with folders."  I would contend that sieve is a language that can
> operate inside of many contexts, one of which is local delivery.  With
> local delivery, the distinction is blurred.  I own my incoming mail,
> and I own my stored folders, and I want to be able to tell my delivery
> agent how to manage both of them and resolve a storage/quota issue in
> a reasonably understandable way.  This sort of thing (which I think of
> as "rolling mailboxes") would be a nice facility for quarantining
> incoming messages which, without the facility, one might otherwise
> simply delete.

> Also, I understand the philosophy that says that this sort of thing
> should be an attribute of a folder.  However I don't agree that every
> operation that you might want to do on a folder should be expressed as
> a folder attribute, especially one with magic side effects.  There's
> really nothing wrong with expressing folder limits as a control over
> delivery; the distinction is where and how you express it.  Expressing
> it inside a delivery script is as much setting a folder/delivery
> attribute as is expressing it in some parameter attached to the
> folder.  BTW I have nothing against either.  (This is kind of like the
> way that various OSes differ in their treatment of files: in some, one
> configures files to behave in a certain way; in others, one writes
> programs to treat files in different ways.)

> > But regardless of the expiration model, this proposal seems to me to be
> > putting the cart before the horse - we'd need to define an IMAP expiration
> > extension before it is reasonable to extend sieve to support it. And such a
> > sieve extension only makes sense if the model chosen for expirations is
> > per-message.

> I don't really see why IMAP should drive SIEVE (then again, I'm no
> longer talking about "expiration" so this may not be a disagreement.)
> SIEVE is a filtering language, IMAP is a folder access protocol.

The reason IMAP should drive sieve in this area is because IMAP is,
in addition to being a protocol, the way we've chosen to capture
a consistent set of message store semantics.

> They
> are not the same, although I understand that for some, they are
> intertwined.

The implementation intertwining of the two is largely irrelevant as far as I'm
concerned. My concern is that this group isn't the right place to define
significant extensions to message store semantics. Even if we do it and do it
right I suspect the IESG won't like it one bit. (I base this assessment on the
LEMONADE chartering experience, where the IESG required explicit language
restricting the group's activities to IMAP and also called for close
coordination with IMAPEXT.)

> But I wouldn't use that subset of circumstances as a
> driver for SIEVE functionality.  (If I'm misunderstanding, I'm happy
> to be educated.)

> Bottom line: I don't (necessarily) support sieve dictating folder
> expiration, but would look forward to a "rolling mailbox" sort of
> facility.

Well, as others have previously pointed out, one way to get this sort of
functionality is through the specification of an extension that hooks into
the IMAP ANNOTATE or ANNOTATEMORE extensions. Nothing would prevent someone
from using such an extension in a non-IMAP environment.

				Ned


From owner-ietf-mta-filters Thu Mar 11 21:11:17 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2C5BHdQ022550;
	Thu, 11 Mar 2004 21:11:17 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2C5BHmK022549;
	Thu, 11 Mar 2004 21:11:17 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2C5BGhE022543
	for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 21:11:16 -0800 (PST)
	(envelope-from rjs3@andrew.cmu.edu)
Received: from MUTE.WRCT.ORG (MUTE.WRCT.ORG [128.2.39.39])
	(user=rjs3 mech=GSSAPI (0 bits))
	by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2C5BJkw015789;
	Fri, 12 Mar 2004 00:11:19 -0500
Date: Fri, 12 Mar 2004 00:11:19 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
X-X-Sender: rjs3@mute.wrct.org
To: "Mark E. Mallett" <mem@mv.mv.com>
cc: ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>,
        ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
In-Reply-To: <20040311233735.GC23860@iridium.mv.net>
Message-ID: <Pine.LNX.4.55L-032.0403120008290.12781@mute.wrct.org>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
 <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com>
 <20040311233735.GC23860@iridium.mv.net>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Thu, 11 Mar 2004, Mark E. Mallett wrote:

> The thing that I would like to see is more of limiting the volume
> of a folder, either in terms of total data size or of number of messages.
> So either
>
>     fileinto :keep-maximum-messages 100 "somefolder";
> or
>     fileinto :keep-maximum-storage 100k "somefolder";
> (or both).

In addition to Ned's comments (which I tend to agree with), does
implementing this sort of folder semantic on a per-message basis even
make any sense?

Let's presume the script:

if envelope :all :contains "to" "rjs3+a@" {
        fileinto "INBOX.foo";
} elsif envelope :all :contains "to" "rjs3+b@" {
        fileinto :keep-maximum-storage 100k "INBOX.foo";
}

Does this mean the script only enforces the limit when an "rjs3+b" message
arrives?  If so, is that even useful?

Its entirely unclear to me that folder-wide attributes are useful to
employ in a sieve script.  Per-message expiration dates (and even generic
annotation-setting) seems fine, but folder-wide attributes just don't seem
like a good fit.

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----


From owner-ietf-mta-filters Fri Mar 12 02:04:17 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CA4Hl8017296;
	Fri, 12 Mar 2004 02:04:17 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2CA4Hp2017295;
	Fri, 12 Mar 2004 02:04:17 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from relay.unizar.es (piedra.unizar.es [155.210.11.65])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CA4F9D017288
	for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 02:04:16 -0800 (PST)
	(envelope-from 462931@celes.unizar.es)
Received: from localhost (mesa.unizar.es [155.210.11.66])
	by relay.unizar.es (8.12.6/8.12.3) with ESMTP id i2C9tums004556
	for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 10:55:56 +0100
Received: from 155.210.155.171 ( [155.210.155.171])
	as user 462931@155.210.11.71 by webmail.unizar.es with HTTP;
	Fri, 12 Mar 2004 10:55:20 +0100
Message-ID: <1079085320.405189089b8b4@webmail.unizar.es>
Date: Fri, 12 Mar 2004 10:55:20 +0100
From: =?ISO-8859-1?B?RGF2aWQgU+FuY2hleiBQ6XJleg==?= <462931@celes.unizar.es>
To: Sieve list <ietf-mta-filters@mail.imc.org>
Subject: Sieve to Maildrop
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
User-Agent: Internet Messaging Program (IMP) 3.1
X-Originating-IP: 155.210.155.171
X-Virus-Scanned: TAMIZ + Sophos en unizar.es
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


Hello
I'd like to know if there is a tool for translating Sieve to Maildrop.

              Thanks
                 DvD





P.D.: Sorry my bad english


From owner-ietf-mta-filters Fri Mar 12 12:41:05 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CKf5Yc063696;
	Fri, 12 Mar 2004 12:41:05 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2CKf5GM063695;
	Fri, 12 Mar 2004 12:41:05 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40])
	by above.proper.com (8.12.11/8.12.8) with SMTP id i2CKf4lX063689
	for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 12:41:04 -0800 (PST)
	(envelope-from mem@mv.mv.com)
Received: (qmail 27901 invoked from network); 12 Mar 2004 15:41:04 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17)
  by mercury.mv.net with SMTP; 12 Mar 2004 15:41:06 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40
  local-name mercury.mv.net
Received: (qmail 16696 invoked by uid 101); 12 Mar 2004 15:41:03 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Fri, 12 Mar 2004 15:41:03 -0500
To: Rob Siemborski <rjs3@andrew.cmu.edu>
Cc: "Mark E. Mallett" <mem@mv.mv.com>, ned.freed@mrochek.com,
        Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>,
        ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
Message-ID: <20040312204103.GE2223@iridium.mv.net>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net> <Pine.LNX.4.55L-032.0403120008290.12781@mute.wrct.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <Pine.LNX.4.55L-032.0403120008290.12781@mute.wrct.org>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Fri, Mar 12, 2004 at 12:11:19AM -0500, Rob Siemborski wrote:
> In addition to Ned's comments (which I tend to agree with), does
> implementing this sort of folder semantic on a per-message basis even
> make any sense?
> 
> Let's presume the script:
> 
> if envelope :all :contains "to" "rjs3+a@" {
>         fileinto "INBOX.foo";
> } elsif envelope :all :contains "to" "rjs3+b@" {
>         fileinto :keep-maximum-storage 100k "INBOX.foo";
> }
> 
> Does this mean the script only enforces the limit when an "rjs3+b" message
> arrives?  If so, is that even useful?

That does look like that is what that script would do, and no, it's
probably not useful.  I would call that a bad script.  When one
provides facilities in a language, one is not personally expected to
debug every script that can be written in it.

There's always a conflict between exposing and encapsulating language
facilities.  For example, the original poster had the notion of adding
a folder definition that would ensure that all operations into that
folder would operate the same way.  I wouldn't want that: I generally
go for the low-level granularity that lets the script writer have
complete control (and responsibility for their own errors).

(In my own implementation I have other ways of dealing with that
conflict anyway.)

mm


From owner-ietf-mta-filters Fri Mar 12 12:31:44 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CKVin5063281;
	Fri, 12 Mar 2004 12:31:44 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2CKVi5w063280;
	Fri, 12 Mar 2004 12:31:44 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40])
	by above.proper.com (8.12.11/8.12.8) with SMTP id i2CKVd7U063270
	for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 12:31:39 -0800 (PST)
	(envelope-from mem@mv.mv.com)
Received: (qmail 14841 invoked from network); 12 Mar 2004 15:31:42 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17)
  by mercury.mv.net with SMTP; 12 Mar 2004 15:31:42 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40
  local-name mercury.mv.net
Received: (qmail 13260 invoked by uid 101); 12 Mar 2004 15:31:42 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Fri, 12 Mar 2004 15:31:42 -0500
To: ned.freed@mrochek.com
Cc: "Mark E. Mallett" <mem@mv.mv.com>,
        Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>,
        ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
Message-ID: <20040312203142.GD2223@iridium.mv.net>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net> <01L7LYRALADE0027NR@mauve.mrochek.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <01L7LYRALADE0027NR@mauve.mrochek.com>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Thu, Mar 11, 2004 at 05:34:36PM -0800, ned.freed@mrochek.com wrote:
> 
> >     fileinto :keep-maximum-messages 100 "somefolder";
> > or
> >     fileinto :keep-maximum-storage 100k "somefolder";
> > (or both).
> 
> Or how about limits on an entire folder tree? Or limits expressed in terms of
> messages with different characteristics? (These are not theoretical -- I've
> seen requests for both of these.) The list goes on and on and on.

One can always theorize extreme tangents for any discussion.  Even so,
it could be useful to have fundamental access to operations on
existing mailstore when storing a new message.



> Like it or not, this is digging deep into the general area of message store
> semantics and brings up any number of fairly subtle issues, e.g., are the
> criteria met by deleting old messages, deleting the largest messages, holding
> new messages, bouncing new messages, etc. etc.

Obviously we disagree, because (re "like it or not") I do
like it :-)  In the case of a rolling mailbox, the issues are not
subtle.  One has a sliding window of the mailbox, where old
messages are dropped to make room for new ones.  This is really
not an outlandish idea, nor does it introduce any new folder
semantics.  If it sparks other ideas or other ways to access mail
folders, so much the better-- any way to give owner of a mailstore
a little more control at delivery time.  That's one of the things
SIEVE is for.

mm


From owner-ietf-mta-filters Fri Mar 12 13:50:55 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CLotv2067221;
	Fri, 12 Mar 2004 13:50:55 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2CLotJv067220;
	Fri, 12 Mar 2004 13:50:55 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CLosN9067214
	for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 13:50:54 -0800 (PST)
	(envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8])
	(user=rjs3 mech=GSSAPI (0 bits))
	by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2CLoukw017528;
	Fri, 12 Mar 2004 16:50:56 -0500
Date: Fri, 12 Mar 2004 16:50:56 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: "Mark E. Mallett" <mem@mv.mv.com>
cc: ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>,
        ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
In-Reply-To: <20040312204103.GE2223@iridium.mv.net>
Message-ID: <Pine.LNX.4.58-035.0403121648590.13082@sourcefour.andrew.cmu.edu>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
 <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com>
 <20040311233735.GC23860@iridium.mv.net> <Pine.LNX.4.55L-032.0403120008290.12781@mute.wrct.org>
 <20040312204103.GE2223@iridium.mv.net>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


I suppose that's what I get for hitting the send key at the wrong time...

Let's try this again.

On Fri, 12 Mar 2004, Mark E. Mallett wrote:

>
> On Fri, Mar 12, 2004 at 12:11:19AM -0500, Rob Siemborski wrote:
> > In addition to Ned's comments (which I tend to agree with), does
> > implementing this sort of folder semantic on a per-message basis even
> > make any sense?
> >
> > Let's presume the script:
> >
> > if envelope :all :contains "to" "rjs3+a@" {
> >         fileinto "INBOX.foo";
> > } elsif envelope :all :contains "to" "rjs3+b@" {
> >         fileinto :keep-maximum-storage 100k "INBOX.foo";
> > }
> >
> > Does this mean the script only enforces the limit when an "rjs3+b" message
> > arrives?  If so, is that even useful?
>
> That does look like that is what that script would do, and no, it's
> probably not useful.  I would call that a bad script.

Well-defined syntax shouldn't let you write a "bad script".  I'd argue
that this particular addition to sieve is likely to be extraordinarly
confusing to users.  If I have 10 places in a script where I can file into
a particular mailbox, I shouldn't need to remember that in each of those
places I need to set the *same* max storage limit.

> There's always a conflict between exposing and encapsulating language
> facilities.  For example, the original poster had the notion of adding
> a folder definition that would ensure that all operations into that
> folder would operate the same way.  I wouldn't want that: I generally
> go for the low-level granularity that lets the script writer have
> complete control (and responsibility for their own errors).

If such an overriding defaults system existed, this problem wouldn't
exist.  You could even have both a default value, *and* allow people to
override it.

Though, in the end, I think this is something best left as a folder
attribute.

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----


From owner-ietf-mta-filters Fri Mar 12 13:48:20 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CLmKcx067096;
	Fri, 12 Mar 2004 13:48:20 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2CLmK2F067095;
	Fri, 12 Mar 2004 13:48:20 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CLmGOu067086
	for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 13:48:16 -0800 (PST)
	(envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8])
	(user=rjs3 mech=GSSAPI (0 bits))
	by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2CLmGkw017515;
	Fri, 12 Mar 2004 16:48:16 -0500
Date: Fri, 12 Mar 2004 16:48:16 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: "Mark E. Mallett" <mem@mv.mv.com>
cc: ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>,
        ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
In-Reply-To: <20040312204103.GE2223@iridium.mv.net>
Message-ID: <Pine.LNX.4.58-035.0403121647270.13082@sourcefour.andrew.cmu.edu>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
 <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com>
 <20040311233735.GC23860@iridium.mv.net> <Pine.LNX.4.55L-032.0403120008290.12781@mute.wrct.org>
 <20040312204103.GE2223@iridium.mv.net>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Fri, 12 Mar 2004, Mark E. Mallett wrote:

> On Fri, Mar 12, 2004 at 12:11:19AM -0500, Rob Siemborski wrote:
> > In addition to Ned's comments (which I tend to agree with), does
> > implementing this sort of folder semantic on a per-message basis even
> > make any sense?
> >
> > Let's presume the script:
> >
> > if envelope :all :contains "to" "rjs3+a@" {
> >         fileinto "INBOX.foo";
> > } elsif envelope :all :contains "to" "rjs3+b@" {
> >         fileinto :keep-maximum-storage 100k "INBOX.foo";
> > }
> >
> > Does this mean the script only enforces the limit when an "rjs3+b" message
> > arrives?  If so, is that even useful?
>
> That does look like that is what that script would do, and no, it's
> probably not useful.  I would call that a bad script.

Well-defined syntax shouldn't let you write a "bad script".

> When one
> provides facilities in a language, one is not personally expected to
> debug every script that can be written in it.



> There's always a conflict between exposing and encapsulating language
> facilities.  For example, the original poster had the notion of adding
> a folder definition that would ensure that all operations into that
> folder would operate the same way.  I wouldn't want that: I generally
> go for the low-level granularity that lets the script writer have
> complete control (and responsibility for their own errors).
>
> (In my own implementation I have other ways of dealing with that
> conflict anyway.)
>
> mm
>
>
>

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----


From owner-ietf-mta-filters Fri Mar 12 14:14:20 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CMEKmZ068864;
	Fri, 12 Mar 2004 14:14:20 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2CMEKYH068863;
	Fri, 12 Mar 2004 14:14:20 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40])
	by above.proper.com (8.12.11/8.12.8) with SMTP id i2CMEJZj068853
	for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 14:14:19 -0800 (PST)
	(envelope-from mem@mv.mv.com)
Received: (qmail 3678 invoked from network); 12 Mar 2004 17:12:20 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17)
  by mercury.mv.net with SMTP; 12 Mar 2004 17:14:21 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40
  local-name mercury.mv.net
Received: (qmail 734 invoked by uid 101); 12 Mar 2004 17:12:19 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Fri, 12 Mar 2004 17:12:19 -0500
To: Rob Siemborski <rjs3@andrew.cmu.edu>
Cc: "Mark E. Mallett" <mem@mv.mv.com>, ned.freed@mrochek.com,
        Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>,
        ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
Message-ID: <20040312221219.GD6308@iridium.mv.net>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net> <Pine.LNX.4.55L-032.0403120008290.12781@mute.wrct.org> <20040312204103.GE2223@iridium.mv.net> <Pine.LNX.4.58-035.0403121648590.13082@sourcefour.andrew.cmu.edu>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <Pine.LNX.4.58-035.0403121648590.13082@sourcefour.andrew.cmu.edu>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


> > That does look like that is what that script would do, and no, it's
> > probably not useful.  I would call that a bad script.
> 
> Well-defined syntax shouldn't let you write a "bad script".

I would have to flat-out disagree with that.  But that's a whole
nother conversation.


>  I'd argue
> that this particular addition to sieve is likely to be extraordinarly
> confusing to users.  If I have 10 places in a script where I can file into
> a particular mailbox, I shouldn't need to remember that in each of those
> places I need to set the *same* max storage limit.

I can sympathize with those comments even if I don't necessarily have
the same perspective as you.  Mine is to give the power to the script
writer, not protect them from that power.  On a related note: do people
who will be confused by languages write scripts by hand, anyway?  I
imagine that those people use some interface that generates scripts
for them, and "power users" will write scripts by hand.  Neither of
these groups should object to having powerful underlying facilities.

BTW I am not pushing this as a proposal; note that I am commenting in
a thread started by someone else.  But I do believe it is a good idea
that could either be implemented as-is or incorporated into a more
complete extension somewhere down the line.

Yours,
-mm-


From owner-ietf-mta-filters Fri Mar 12 14:16:58 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CMGw1A068980;
	Fri, 12 Mar 2004 14:16:58 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2CMGw4B068979;
	Fri, 12 Mar 2004 14:16:58 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CMGvVL068973
	for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 14:16:57 -0800 (PST)
	(envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8])
	(user=rjs3 mech=GSSAPI (0 bits))
	by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2CMGwkw017588;
	Fri, 12 Mar 2004 17:16:58 -0500
Date: Fri, 12 Mar 2004 17:16:59 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: "Mark E. Mallett" <mem@mv.mv.com>
cc: ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>,
        ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
In-Reply-To: <20040312221219.GD6308@iridium.mv.net>
Message-ID: <Pine.LNX.4.58-035.0403121714200.22156@sourcefour.andrew.cmu.edu>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
 <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com>
 <20040311233735.GC23860@iridium.mv.net> <Pine.LNX.4.55L-032.0403120008290.12781@mute.wrct.org>
 <20040312204103.GE2223@iridium.mv.net> <Pine.LNX.4.58-035.0403121648590.13082@sourcefour.andrew.cmu.edu>
 <20040312221219.GD6308@iridium.mv.net>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Fri, 12 Mar 2004, Mark E. Mallett wrote:

> > > That does look like that is what that script would do, and no, it's
> > > probably not useful.  I would call that a bad script.
> >
> > Well-defined syntax shouldn't let you write a "bad script".
>
> I would have to flat-out disagree with that.  But that's a whole
> nother conversation.

Semantics.  It's a syntacticly correct script that even has a valid
interpretation, which is logical, even if its not necessaraly what the
user would expect.  That does not at all make it a "bad script", as you
say.

> On a related note: do people who will be confused by languages write
> scripts by hand, anyway?

Its possible to write code in any language that is confusing, the point is
to minimize the confusion.  Even experienced users might not see what is
going on in a script that is a thousand lines long, with fileintos
into the same mailbox separated by a few hundred lines.

> I imagine that those people use some interface that generates scripts
> for them, and "power users" will write scripts by hand.  Neither of
> these groups should object to having powerful underlying facilities.

But they might object to the language making it easy to make mistakes.

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----


From owner-ietf-mta-filters Fri Mar 12 15:17:18 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CNHICS072202;
	Fri, 12 Mar 2004 15:17:18 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2CNHIHb072201;
	Fri, 12 Mar 2004 15:17:18 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CNHEwh072192
	for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 15:17:14 -0800 (PST)
	(envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243)
 id <01L7N5EITY1S0027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org;
 Fri, 12 Mar 2004 15:17:17 -0800 (PST)
Date: Fri, 12 Mar 2004 15:13:51 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Sieve extension to expire mails?
In-reply-to: "Your message dated Fri, 12 Mar 2004 15:31:42 -0500"
 <20040312203142.GD2223@iridium.mv.net>
To: "Mark E. Mallett" <mem@mv.mv.com>
Cc: ned.freed@mrochek.com, "Mark E. Mallett" <mem@mv.mv.com>,
        Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>,
        ietf-mta-filters@mail.imc.org
Message-id: <01L7N7DG3T7Q0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii
Content-transfer-encoding: 7BIT
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
 <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com>
 <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net>
 <01L7LYRALADE0027NR@mauve.mrochek.com> <20040312203142.GD2223@iridium.mv.net>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>



> On Thu, Mar 11, 2004 at 05:34:36PM -0800, ned.freed@mrochek.com wrote:
> >
> > >     fileinto :keep-maximum-messages 100 "somefolder";
> > > or
> > >     fileinto :keep-maximum-storage 100k "somefolder";
> > > (or both).
> >
> > Or how about limits on an entire folder tree? Or limits expressed in terms of
> > messages with different characteristics? (These are not theoretical -- I've
> > seen requests for both of these.) The list goes on and on and on.

> One can always theorize extreme tangents for any discussion.

But these weren't extremes. They are both quite reasonable requests.

> Even so,
> it could be useful to have fundamental access to operations on
> existing mailstore when storing a new message.

Again, it depends on how those operations are organized. And the way to make
sure they are properly organized is to work out the semantics in a venue
appropriate for mail store semantic discussions. This isn't that venue.

> > Like it or not, this is digging deep into the general area of message store
> > semantics and brings up any number of fairly subtle issues, e.g., are the
> > criteria met by deleting old messages, deleting the largest messages, holding
> > new messages, bouncing new messages, etc. etc.

> Obviously we disagree, because (re "like it or not") I do
> like it :-)  In the case of a rolling mailbox, the issues are not
> subtle.  One has a sliding window of the mailbox, where old
> messages are dropped to make room for new ones.  This is really
> not an outlandish idea, nor does it introduce any new folder
> semantics.

Sure it does. Folders normally retain messages until they are deleted.
This changes that semantics rather completely, don't you think?

				Ned


From owner-ietf-mta-filters Fri Mar 12 15:50:52 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CNoqdu074333;
	Fri, 12 Mar 2004 15:50:52 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2CNoqGY074332;
	Fri, 12 Mar 2004 15:50:52 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40])
	by above.proper.com (8.12.11/8.12.8) with SMTP id i2CNopDO074326
	for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 15:50:51 -0800 (PST)
	(envelope-from mem@mv.mv.com)
Received: (qmail 13890 invoked from network); 12 Mar 2004 18:50:56 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17)
  by mercury.mv.net with SMTP; 12 Mar 2004 18:50:56 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40
  local-name mercury.mv.net
Received: (qmail 18783 invoked by uid 101); 12 Mar 2004 18:49:55 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Fri, 12 Mar 2004 18:49:55 -0500
To: ned.freed@mrochek.com
Cc: "Mark E. Mallett" <mem@mv.mv.com>,
        Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>,
        ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
Message-ID: <20040312234955.GG6308@iridium.mv.net>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net> <01L7LYRALADE0027NR@mauve.mrochek.com> <20040312203142.GD2223@iridium.mv.net> <01L7N7DG3T7Q0027NR@mauve.mrochek.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <01L7N7DG3T7Q0027NR@mauve.mrochek.com>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Fri, Mar 12, 2004 at 03:13:51PM -0800, ned.freed@mrochek.com wrote:

> Sure it does. Folders normally retain messages until they are deleted.
> This changes that semantics rather completely, don't you think?

I don't think so, and that's an opinion that I was trying to convey.
Perhaps there's a distinction centering around "deleted by whom?"  My
attitude is that the owner of a mailbox could legitimately instruct a
delivery agent to manipulate that mailbox as part of delivery.  One of
those instructions could be "delete the oldest message [under some
condition]".  I see no philosophical difference between that
instruction and manually hitting the 'd' key.  This introduces no new
storage semantics nor any new operational semantics.  It does wrap up
a few primitive operations into a higher level function, but that
doesn't make those operations new.  (Making them more granular would
actually be to my liking.)

Just me, I guess?

-mm-


From owner-ietf-mta-filters Fri Mar 12 16:16:49 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2D0GnTp075407;
	Fri, 12 Mar 2004 16:16:49 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2D0Gn5X075406;
	Fri, 12 Mar 2004 16:16:49 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2D0GmVw075400
	for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 16:16:48 -0800 (PST)
	(envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243)
 id <01L7N5EITY1S0027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org;
 Fri, 12 Mar 2004 16:16:52 -0800 (PST)
Date: Fri, 12 Mar 2004 16:04:41 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Sieve extension to expire mails?
In-reply-to: "Your message dated Fri, 12 Mar 2004 18:49:55 -0500"
 <20040312234955.GG6308@iridium.mv.net>
To: "Mark E. Mallett" <mem@mv.mv.com>
Cc: ned.freed@mrochek.com, "Mark E. Mallett" <mem@mv.mv.com>,
        Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>,
        ietf-mta-filters@mail.imc.org
Message-id: <01L7N9GBS1480027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii
Content-transfer-encoding: 7BIT
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
 <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com>
 <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net>
 <01L7LYRALADE0027NR@mauve.mrochek.com> <20040312203142.GD2223@iridium.mv.net>
 <01L7N7DG3T7Q0027NR@mauve.mrochek.com> <20040312234955.GG6308@iridium.mv.net>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


> On Fri, Mar 12, 2004 at 03:13:51PM -0800, ned.freed@mrochek.com wrote:

> > Sure it does. Folders normally retain messages until they are deleted.
> > This changes that semantics rather completely, don't you think?

> I don't think so, and that's an opinion that I was trying to convey.
> Perhaps there's a distinction centering around "deleted by whom?"

Yes, and it is a very significant one. If I have a specialized client that
prowls through some set of folders and deletes things based on some criteria or
other, its operational parameters are by definition a client concern.  Clients
the semantics and so the issue of consistent semantics for store-based deletion
doesn't arise.

If, on the other hand, a store implements some sort of message expiration
system, it almost certainly will be provided to multiple users who will  want
to use multiple clients to control and manipulate the facility on multiple
servers. Failure to nail down the semantics properly is likely to lead to
problems -- messages won't be deleted when they should have been, and worse,
messages might be deleted when they should not have been. One of the reasons we
have standards is to try and prevent this sort of thing from happening.

It is entirely reasonable to talk about using sieve to control either
a client or server side expiration facility. But a client side facility
would logically be controlled through the use of private headers or
annotations or something similar. The only thing that would need to
be standardized in this case is the means to add headers or annotations
or whatever in sieve.

A server side facility, on the other hand, needs to have the server
side semantics nailed down first. I have alredy explained why I believe
this is the case in considerable detail.

> My
> attitude is that the owner of a mailbox could legitimately instruct a
> delivery agent to manipulate that mailbox as part of delivery.  One of
> those instructions could be "delete the oldest message [under some
> condition]".  I see no philosophical difference between that
> instruction and manually hitting the 'd' key.  This introduces no new
> storage semantics nor any new operational semantics.  It does wrap up
> a few primitive operations into a higher level function, but that
> doesn't make those operations new.  (Making them more granular would
> actually be to my liking.)

> Just me, I guess?

It certainly is not a view I share, nor is it a view that I feel is
likely to lead to a successful sieve extension. Again, I have
explained why I think this is the case.

				Ned


From owner-ietf-mta-filters Sat Mar 13 18:44:22 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2E2iLfW021533;
	Sat, 13 Mar 2004 18:44:21 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2E2iLFW021532;
	Sat, 13 Mar 2004 18:44:21 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from out2.smtp.messagingengine.com (out2.smtp.messagingengine.com [66.111.4.26])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2E2iJxE021525
	for <ietf-mta-filters@imc.org>; Sat, 13 Mar 2004 18:44:21 -0800 (PST)
	(envelope-from matthew@elvey.fastmail.fm)
X-Sasl-enc: Vsb3m86BGudLBUt2xvwtJg 1079232263
Received: from elvey.fastmail.fm (adsl-69-104-63-158.dsl.pltn13.pacbell.net [69.104.63.158])
	by mail.messagingengine.com (Postfix) with ESMTP id 6D5376E235B
	for <ietf-mta-filters@imc.org>; Sat, 13 Mar 2004 21:44:22 -0500 (EST)
Message-ID: <4053C706.9060306@elvey.fastmail.fm>
Date: Sat, 13 Mar 2004 18:44:22 -0800
From: "Matthew Elvey (FM)" <matthew@elvey.fastmail.fm>
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.6b) Gecko/20031205 Thunderbird/0.4
X-Accept-Language: en-us, en
MIME-Version: 1.0
Cc: ietf-mta-filters@imc.org
Subject: Re: New Sieve extension "refuse" proposal - draft-elvey-refuse-sieve-01h
 - Request for feedback on Open Issues.
References: <402BDB3F.1090808@elvey.fastmail.fm>
In-Reply-To: <402BDB3F.1090808@elvey.fastmail.fm>
X-Habeas-SWE-1: winter into spring
X-Habeas-SWE-2: brightly anticipated
X-Habeas-SWE-3: like Habeas SWE (tm)
X-Habeas-SWE-4: Copyright 2002 Habeas (tm)
X-Habeas-SWE-5: Sender Warranted Email (SWE) (tm). The sender of this
X-Habeas-SWE-6: email in exchange for a license for this Habeas
X-Habeas-SWE-7: warrant mark warrants that this is a Habeas Compliant
X-Habeas-SWE-8: Message (HCM) and not spam. Please report use of this
X-Habeas-SWE-9: mark in spam to <http://www.habeas.com/report/>.
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


First of all, thanks to all for all the feedback so far.

Alexey and I didn't receive any feedback on Section 13 'Open Issues for 
Discussion', items 2 or 3, so I'm sending this email to
ask folks (who may have missed it because it was at the end after the 
boring boilerplate) to comment.

We'll have a new draft out shortly (It's just waiting for any changes 
this post my lead to.)

On 2/12/2004 11:59 AM, Matthew Elvey (FM) sent forth electrons to convey:

>
> Hello, folks.  Please review and provide feedback on the "refuse" 
> extension, designed to mostly replace Sieve's "reject" command.
>
> ... please review and comment on what's at
> <http://www.elvey.com/it/sieve/draft-elvey-refuse-sieve-01h.txt>
>
> We welcome feedback, particularly
>  -   changes that include replacement text or
>  -   suggestions from Sieve implementers.
>
> ...
>
> -Matthew & Alexey
>


From owner-ietf-mta-filters Sat Mar 13 21:04:13 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2E54D4D028477;
	Sat, 13 Mar 2004 21:04:13 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2E54DJu028476;
	Sat, 13 Mar 2004 21:04:13 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2E54Bx0028470
	for <ietf-mta-filters@imc.org>; Sat, 13 Mar 2004 21:04:11 -0800 (PST)
	(envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243)
 id <01L7O54WXJ740027NR@mauve.mrochek.com> for ietf-mta-filters@imc.org; Sat,
 13 Mar 2004 21:04:16 -0800 (PST)
Date: Sat, 13 Mar 2004 20:37:59 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: New Sieve extension "refuse" proposal -
	draft-elvey-refuse-sieve-01h
	- Request for feedback on Open Issues.
In-reply-to: "Your message dated Sat, 13 Mar 2004 18:44:22 -0800"
 <4053C706.9060306@elvey.fastmail.fm>
To: "Matthew Elvey (FM)" <matthew@elvey.fastmail.fm>
Cc: ietf-mta-filters@imc.org
Message-id: <01L7OXRZNS240027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; charset=ISO-8859-1; format=flowed
Content-transfer-encoding: 7BIT
References: <402BDB3F.1090808@elvey.fastmail.fm>
 <4053C706.9060306@elvey.fastmail.fm>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>



> First of all, thanks to all for all the feedback so far.

> Alexey and I didn't receive any feedback on Section 13 'Open Issues for
> Discussion', items 2 or 3, so I'm sending this email to
> ask folks (who may have missed it because it was at the end after the
> boring boilerplate) to comment.

I note in passing that item 2 only appears in the -01 revision on your
web site - people looking at the -00 revision in the I-D directory
may be confused when they only find two open issues, not three.

Regarding item 2 -

   2) Should the following text be added to the draft? (Section 4.? ?)
   
   Systems that support the extension must encourage use (by their
   users) of "refuse" over "discard" and "reject" where it is an
   appropriate alternative.

I'm not entirely sure what it means to "encourage use", but I guess it could
refer to offering refuse actions preferentially in a GUI or something similar.
If so, I regard this as a somewhat dangerous promotion of nonportable scripts,
since refuse as presently constituted is an MTA-only sort of thing.

The real problem here has nothing to do with sieve and everything to do with
the architecture of email itself: For a variety of reasons the most effective
way to deal with spam is to reject it at the SMTP level prior to final
delivery, but an MUA by definition operates after that point. So even if
you "fix" the portability "problem" you do not and cannot get the desired
behavior on an MUA.

The logical direction this leads is that sieves are best run on MTAs just
before or during final delivery. But do we really want to say this? Perhaps
it would make sense to say it in a BCP talking about spam filtering best
practices, but not, I think, in a technical specification of a sieve
extension.

And regarding item 3 -

   3) Explicitly supporting Enhanced Error Codes (RFC 2034).
   
The suggested text talking about how to generate an appropriate enhanced error
code is definitely appropriate and should IMO be included in the document. The
broader question of whether or not it is appropriate to give users control over
what code is inserted is the interesting one here. After thinking about this
I've concluded that the benefits just don't outweigh the risks - there really
aren't that many other codes that would be appropriate to use with refuse. If
this were to be supported at all there would have to be a list of the codes a
user is allowed to specify, and anything else would be ignored.

This is a shame, because there are a few other codes that make some amount of
sense, e.g. 5.2.3, "message length exceeds administrative limit". There are
even some 4.x.y codes that make sense, e.g. 4.4.4, "unable to route", when,
say, a presence check fails and an urgent message needs to be returned
immediately. (Note that this last case is one where a 5xy 4.a.b sort of
response indicating "message returned due to a transient problem" may be
appropriate - one of the things done in the revision of the NOTARY document when
they moved to draft was to make it clear such combinations are allowed.)

				Ned


From owner-ietf-mta-filters Mon Mar 15 11:59:35 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2FJxZCK090981;
	Mon, 15 Mar 2004 11:59:35 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2FJxZl7090980;
	Mon, 15 Mar 2004 11:59:35 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from darius.cyrusoft.com (darius.cyrusoft.com [63.163.82.2])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2FJxYrk090974
	for <ietf-mta-filters@imc.org>; Mon, 15 Mar 2004 11:59:35 -0800 (PST)
	(envelope-from daboo@cyrusoft.com)
Received: from ninevah.cyrusoft.com (ninevah.cyrusoft.com [63.163.82.9])
	(authenticated bits=0)
	by darius.cyrusoft.com (8.12.9/8.12.9) with ESMTP id i2FJrKk3029794
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
	Mon, 15 Mar 2004 14:53:22 -0500
Date: Mon, 15 Mar 2004 14:59:36 -0500
From: Cyrus Daboo <daboo@cyrusoft.com>
To: ned.freed@mrochek.com
cc: IETF MTA Filters List <ietf-mta-filters@imc.org>
Subject: Re: Comments on draft-daboo-sieve-mime-00.txt
Message-ID: <187472.1079362776@ninevah.cyrusoft.com>
In-Reply-To: <01L7HAGIBZLW0027NR@mauve.mrochek.com>
References: <104800.1076013775@ninevah.cyrusoft.com>
 <01L7HAGIBZLW0027NR@mauve.mrochek.com>
X-Mailer: Mulberry/3.2.0a1 (Mac OS X)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


Hi Ned,
Thanks for your comments:

--On Monday, March 8, 2004 9:22 AM -0800 ned.freed@mrochek.com wrote:

| Having said that, I think the specifics of how this was done aren't
| right. First, as presently written this specification only extends the
| header test, and it does so by creating an entirely new test. But there
| are two other tests that are equally applicable to inner headers: exists
| and address. Either similar "mimeexists" and "mimeaddress" tests need to
| be added (and perhaps "mime" changed to "mimeheader"), or this needs to
| be done within the existing tests by adding a :mime parameter. I'm
| indifferent as to which one of these approaches is chosen, but we do need
| one of them.
|
| Second, I really don't like the use of an optional middle parameter to
| specify that the test is to be performed on a parameter value. This sort
| of thing is why we have labelled parameters: It should be done as
| :parameter or something similar. As for the use of a null parameter-names
| value to indicate a test of non-paramer material, this can done with
| :parameter as well, but I do worry that this is a bit tricky. OTOH, I
| haven't been able to come up with a differenent way to do it that I like
| better.

OK - here is another solution to the syntax. What I'm proposing is a 
mimeheader test that takes the following parameters:

:name - the name of a specific MIME header to test (can be a list of names)
:parameter-name - the name of a specific parameter name to test (can be a 
list)

:exists - test the existence of the specified items

:text - do comparisons against the content of the entire MIME header 
selected
:value - do comparisons against the value of the MIME header, excluding 
parameters
:parameter-value - do comparisons on parameter values only

In the case of the later three parameters a comparator and text to compare 
against are also required, in the case of :exists, no additional items 
appear.

What I've done below is to enumerate the type of tests one might want to do 
with MIME headers together with new sample syntax for how those would 
appear in a SIEVE script:

1) Test the presence of a specific MIME header:

    if (mimeheader :name "Content-Foo" :exists)

2) Test the presence of a specific parameter in any MIME header:

    if (mimeheader :parameter-name "filename" :exists)

3) Test the presence of a specific parameter in a specific MIME header:

    if (mimeheader :name "Content-Disposition" :parameter-name "filename" 
:exists)

4) Test for text anywhere in a specific MIME header

    if (mimeheader :name "Content-Disposition" :text :contains ".exe")

5) Test for text only in the value (not parameters) in a specific MIME 
header

    if (mimeheader :name "Content-Disposition" :value :contains "attach")

6) Test for text in any parameter values only in a specific MIME header

    if (mimeheader :name "Content-Disposition" :parameter-value :contains 
".exe")

7) Test for text in a specific parameter value only in a specific MIME 
header

    if (mimeheader :name "Content-Disposition" :parameter-name "filename" 
:parameter-value :contains ".exe")

8) Test for text in any MIME header

    if (mimeheader :text :contains ".exe")

9) Test for text only in the value (not parameters) in any MIME header

    if (mimeheader :value :contains "7bit")

10) Test for text in any parameter values only in any MIME header

    if (mimeheader :parameter-value :contains "us-ascii")

11) Test for text in a specific parameter value only in any MIME header

    if (mimeheader :parameter-name "filename" :parameter-value :contains 
".exe")

I think the above deals with the issues you describe, except for the 
'address' test. Arguably there are several different formats for header 
content that one might want to test against, so I wonder whether we need 
this to be extensible in some way. Certainly for the time being we could 
have a 'address [ADDRESS-PART]' parameter in mimeheader as well.

| Third, some references probably needs to be made to RFC 2231 and how to
| handle encoded parameters. I think the right answer here is to handle
| this the same way we already require that encoded words be handled.
|

Is it OK to simply require the concatenation of parameter value 
continuations that have been split according to 2231 syntax? Would you want 
a test to specifically look for the language information?

-- 
Cyrus Daboo


From owner-ietf-mta-filters Mon Mar 15 16:03:45 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2G03j1Q006332;
	Mon, 15 Mar 2004 16:03:45 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2G03jS7006331;
	Mon, 15 Mar 2004 16:03:45 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from vementry.enterprise.ucs.ed.ac.uk (vementry.enterprise.ucs.ed.ac.uk [129.215.200.96])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2G03hgU006324
	for <ietf-mta-filters@imc.org>; Mon, 15 Mar 2004 16:03:44 -0800 (PST)
	(envelope-from Nigel.Swinson@rockliffe.com)
Received: from nigelhome (unverified [82.41.75.235]) by vementry.enterprise.ucs.ed.ac.uk
 (Rockliffe SMTPRA 6.0.9) with ESMTP id <B0000005077@vementry.enterprise.ucs.ed.ac.uk>;
 Tue, 16 Mar 2004 00:03:42 +0000
Message-ID: <016601c40aeb$17faa0f0$6401a8c0@nigelhome>
From: "Nigel Swinson" <Nigel.Swinson@rockliffe.com>
To: "Cyrus Daboo" <daboo@cyrusoft.com>
Cc: "IETF MTA Filters List" <ietf-mta-filters@imc.org>
References: <104800.1076013775@ninevah.cyrusoft.com> <01L7HAGIBZLW0027NR@mauve.mrochek.com> <187472.1079362776@ninevah.cyrusoft.com>
Subject: Re: Comments on draft-daboo-sieve-mime-00.txt
Date: Tue, 16 Mar 2004 00:10:30 -0000
MIME-Version: 1.0
Content-Type: text/plain;
	charset="iso-8859-1"
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Content-Transfer-Encoding: 8bit
X-MIME-Autoconverted: from quoted-printable to 8bit by above.proper.com id i2G03igU006326
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


I've spent quite a lot of time thinking about this particular extension too and can't wait to implement it, but have never really felt comfortable with a set of syntax, and don't feel comfortable with any of the proposals so far; so here's another to throw into the pool for thought:

I think MIME consists of two significant parts here; there's a set of new headers, and then there's the facility for multiple body parts.  Looking at the list of new headers, most of them seem to fit neatly into our existing tests (Mime-Version, Content-Id, etc), however the only one that has additional significant structure is the Content-Type header, which is defined as:

     content := "Content-Type" ":" type "/" subtype
                *(";" parameter)
                ; Matching of media type and subtype
                ; is ALWAYS case-insensitive.

Then looking more generically we've also got:

     disposition := "Content-Disposition" ":"
                    disposition-type
                    *(";" disposition-parm)

And there's probably others.  So we have this syntax.

     mime-header := header-name ":"
                    header-value
                    *(";" param-name "=" param-value)

So lets provide a tagged argument to the header, exists, address tests that parses out this structure and allows us to select exactly which bits we want to test against:

   Syntax:   header [HEADER-PART] [COMPARATOR] [MATCH-TYPE]
             <header-names: string-list> <key-list: string-list>

    HEADER-PART: ":value" / ":parameter" <param-names: string-list>

- If we specify ":value" as the optional header-part parameter, then the test only operates on the header-value.  
- If we specify the :parameter optional header-part parameter, then the string list describes the list of parameter values that we should search in.  
- If neither optional parameter is specified, the header test operates on the entire header value as normal.
- Other HEADER-PARTS could be defined in the future if we have other headers with a different defined structure.

If we think :value is too confusing for the "header value when with parameters" compared to the "whole header value", then perhaps we could use :valueonly, :noparameters or :mimevalue or something else?  Maybe the prefix could be like a "namespace" defining the header parsing algorithm to use, and if we have other headers that have a common structure, we could define other namespaces that detail the header parsing method to use.


The above would test only in the "active body part" which is the top level body part, which is the email headers, which is what we've all been dealing with already.  It would NOT recursively look for headers in all child body parts.  That would be done with the second half of my proposal.  Where a server doesn't have a mime parser, or was worried about the extra overhead of parsing the mime structure, it wouldn't support this second part, but could still support Header-Parts.

The second significant half of MIME permits us to recursively define body parts, which each have a set of headers, and content.  So any solution that we have needs to cope with the potential recursive nature of the MIME structure.  So what if we define a new tagged argument for use with all of our existing tests that specifies that we should recursively look in the body parts too?  Call it :bodyparts.  So this means that if I write a test that says:

    if header :contains "Content-Type" "text/html"

Then this would only match if the message contains a single body part that is text/html.  However if I write the following, then this would match if there is ANY text/html body part anywhere in the legal MIME structure of the message:

    if header :bodyparts :contains "Content-Type" "text/html"

With our new mimeheader test this would become more correctly:

    if header :bodyparts :value :contains "Content-Type" "text/html"

Then if we combine this with allof(), we could further define that multiple tests within an allof() must apply to the same body part.  So if we say:

    if allof :bodyparts (header :value :contains "Content-Type" "image/jpeg",
                                  size :over 100K)

Then this would catch all messages that contain a image/jpeg body part that is over 100K.  However if we say the following, then this would catch any message that contained a body part that was image/jpeg and a body part (potentially different) which was over 100K in size.:

    if allof (header :bodyparts :value :contains "Content-Type" "image/jpeg",
                size :bodyparts :over 100K)

This then very neatly fits with the body extention, and we get a test like this which would test for all messages that contain a text body part that contains the word "Spam":

    if allof :bodyparts (header :value :contains "Content-Type" "text",
                                  body :contains "Spam")

For more examples, I'll go through Cyrus examples and show how they would look for this proposal.  However before I do, I note that many look for an "in any header value" or an "in any parameter value" concept.  We currently haven't found a need for these, and I'm not sure we need them.  If we do, then I'd propose we have new tests like "anyheader", "anyexists" and a new header-part of ":anyparameter".

Also to strictly "like for like" Cyrus's examples, I have to use my :bodypart parameter on them all, even though that wouldn't be necessary, and to remove it may actually create a better test.

> 1) Test the presence of a specific MIME header:
> 
>     if (mimeheader :name "Content-Foo" :exists)

if exists :bodyparts "Content-Foo"

(Reads as: If there is any "Content-Foo" header in any body part)

> 2) Test the presence of a specific parameter in any MIME header:
> 
>     if (mimeheader :parameter-name "filename" :exists)

if anyexists :bodyparts :parameter "filename"

(Reads as: If there is any header in any body part which has a filename parameter)

> 3) Test the presence of a specific parameter in a specific MIME header:
> 
>     if (mimeheader :name "Content-Disposition" :parameter-name "filename" 
> :exists)

if exists :bodyparts :parameter "filename" "Content-Disposition"

(Reads as: If there is a Content-Disposition header in any body part which has a filename parameter)

> 4) Test for text anywhere in a specific MIME header
> 
>     if (mimeheader :name "Content-Disposition" :text :contains ".exe")

if header :bodyparts :contains "Content-Disposition" ".exe"

(Reads as: If there is a Content-Disposition header in any body part which contains the string ".exe")

> 5) Test for text only in the value (not parameters) in a specific MIME 
> header
> 
>     if (mimeheader :name "Content-Disposition" :value :contains "attach")

if header :bodyparts :value :contains "Content-Disposition" "attach"

(Reads as: If there is a Content-Disposition header in any body part which contains the string "attach" in the value excluding the parameters)

> 6) Test for text in any parameter values only in a specific MIME header
> 
>     if (mimeheader :name "Content-Disposition" :parameter-value :contains 
> ".exe")

if header :bodyparts :anyparameter :contains "Content-Disposition" ".exe"
 
(Reads as: If there is a Content-Disposition header in any body part which contains the string ".exe" in any parameter)

> 7) Test for text in a specific parameter value only in a specific MIME 
> header
> 
>     if (mimeheader :name "Content-Disposition" :parameter-name "filename" 
> :parameter-value :contains ".exe")

if header :bodypart :contains :parameter "filename" "Content-Disposition" ".exe"

(Reads as: If there is a Content-Disposition header in any body part which contains the string ".exe" in the filename parameter)

> 8) Test for text in any MIME header
> 
>     if (mimeheader :text :contains ".exe")

if anyheader :bodypart :contains ".exe"

(Reads as: If there is any header in any body part which contains the string ".exe")

I'd imagine this to be more useful though:

if anyof :bodyparts (header :anyparameter :contains "Content-Disposition" ".exe",
                                header :anyparameter :contains "Content-Type" ".exe")
 
> 9) Test for text only in the value (not parameters) in any MIME header
> 
>     if (mimeheader :value :contains "7bit")

if anyheader :bodyparts :value :contains "7bit"

(Reads as: If there is a header in any body part which contains the string "7bit" in the value not including the parameters)

> 10) Test for text in any parameter values only in any MIME header
> 
>     if (mimeheader :parameter-value :contains "us-ascii")

if anyheader :bodyparts :anyparameter :contains "us-ascii"
 
(Reads as: If there is any header in any body part which contains the string "us-ascii" in any parameter)

> 11) Test for text in a specific parameter value only in any MIME header
> 
>     if (mimeheader :parameter-name "filename" :parameter-value :contains 
> ".exe")

if anyheader :bodyparts :parameters "filename" :contains ".exe"


(Reads as: If there is any header in any body part which contains the string ".exe" in any "filename" parameter)


What do you think?

Nigel


From owner-ietf-mta-filters Tue Mar 16 05:22:42 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2GDMgw5030359;
	Tue, 16 Mar 2004 05:22:42 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2GDMgc3030358;
	Tue, 16 Mar 2004 05:22:42 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mout0.freenet.de (exim@mout0.freenet.de [194.97.50.131])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2GDMfKi030348
	for <ietf-mta-filters@mail.imc.org>; Tue, 16 Mar 2004 05:22:41 -0800 (PST)
	(envelope-from michael@freenet-ag.de)
Received: from [194.97.50.138] (helo=mx0.freenet.de)
	by mout0.freenet.de with asmtp (Exim 4.303)
	id 1B3EWj-000445-Oa
	for ietf-mta-filters@mail.imc.org; Tue, 16 Mar 2004 14:22:37 +0100
Received: from nostromo.freenet-ag.de ([194.97.7.6])
	by mx0.freenet.de with esmtp (TLSv1:AES256-SHA:256) (Exim 4.303 #2)
	id 1B3EWj-0000iA-Mp
	for ietf-mta-filters@mail.imc.org; Tue, 16 Mar 2004 14:22:37 +0100
Received: from michael by nostromo.freenet-ag.de with local (ID michael) (Exim 4.303 #3)
	id 1B3EWi-0004JS-Oz
	for ietf-mta-filters@mail.imc.org; Tue, 16 Mar 2004 14:22:36 +0100
To: ietf-mta-filters@mail.imc.org
Subject: Expiring/deleting old mail
Message-Id: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
From: Michael Haardt <michael@freenet-ag.de>
Date: Tue, 16 Mar 2004 14:22:36 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


Hello,

let me summarise the recent discussion.  I hope this reflects most
views expressed on the topic:

Some mail systems allow the concept of "rolling/automatically expiring"
mailboxes/folders which automatically remove old mail, which is useful
for mailing lists and junk mail folders.  It is important that this
function is not performed by the client, because clients usually don't
clean up during vacation.

For that reason, I suggest a Sieve extension, which allows the mail
system to remove mail.  There are several ways to address the problem:

Folder Attributes

Sieve focuses on message delivery, so using sieve to control folder
attributes would be using it for a purpose it was not intended for.

Message Attributes

This fits well into Sieve, it allows the richest set of features, but
message expiration attributes are also the most complicated approach.
Further, users might expect expiration dates to be met exactly and
not be pleased about lazy expiration, adding further complexity for
the implementation.  IMAP ANNOTATE may be the way to go for message
attributes.

Message removal at delivery

This approach is easy to understand for users and easy to implement: It
keeps removing mail, starting from the oldest, until the given criteria
are matched.  It could be realised by adding an option to "fileinto"
and probably "keep":

  fileinto :max-days 7 "inbox.mailinglist";
  fileinto :max-messages 100 "inbox.mailinglist";
  fileinto :max-storage 1M "inbox.mailinglist";

It is still open how the last action should behave when delivering
a 2M message.  Perhaps there is a better name instead of "max-".
This mechanism should not be called expiration, because people expect
a different behaviour by that name.

Michael


From owner-ietf-mta-filters Tue Mar 16 08:46:11 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2GGkBsd043837;
	Tue, 16 Mar 2004 08:46:11 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2GGkBc0043836;
	Tue, 16 Mar 2004 08:46:11 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2GGk9eM043828
	for <ietf-mta-filters@mail.imc.org>; Tue, 16 Mar 2004 08:46:10 -0800 (PST)
	(envelope-from rjs3@andrew.cmu.edu)
Received: from GEL-FRAME.andrew.cmu.edu (GEL-FRAME.andrew.cmu.edu [128.2.120.54])
	(user=rjs3 mech=GSSAPI (0 bits))
	by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2GGk9kw026513;
	Tue, 16 Mar 2004 11:46:09 -0500
Date: Tue, 16 Mar 2004 11:46:09 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: Michael Haardt <michael@freenet-ag.de>
cc: ietf-mta-filters@mail.imc.org
Subject: Re: Expiring/deleting old mail
In-Reply-To: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
Message-ID: <Pine.LNX.4.58-035.0403161145350.7839@gel-frame.andrew.cmu.edu>
References: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Tue, 16 Mar 2004, Michael Haardt wrote:

>   fileinto :max-days 7 "inbox.mailinglist";
>   fileinto :max-messages 100 "inbox.mailinglist";
>   fileinto :max-storage 1M "inbox.mailinglist";
>
> It is still open how the last action should behave when delivering
> a 2M message.  Perhaps there is a better name instead of "max-".
> This mechanism should not be called expiration, because people expect
> a different behaviour by that name.

I'd say that discussion is also needed about how to treat multiple,
conflicting, fileinto commands.

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----


From owner-ietf-mta-filters Tue Mar 16 09:11:05 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2GHB5a1045429;
	Tue, 16 Mar 2004 09:11:05 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2GHB5Z0045428;
	Tue, 16 Mar 2004 09:11:05 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from darius.cyrusoft.com (darius.cyrusoft.com [63.163.82.2])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2GHB4j8045422
	for <ietf-mta-filters@mail.imc.org>; Tue, 16 Mar 2004 09:11:05 -0800 (PST)
	(envelope-from daboo@cyrusoft.com)
Received: from ninevah.cyrusoft.com (ninevah.cyrusoft.com [63.163.82.9])
	(authenticated bits=0)
	by darius.cyrusoft.com (8.12.9/8.12.9) with ESMTP id i2GH4ek3016492
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
	Tue, 16 Mar 2004 12:04:41 -0500
Date: Tue, 16 Mar 2004 12:11:03 -0500
From: Cyrus Daboo <daboo@cyrusoft.com>
To: Michael Haardt <michael@freenet-ag.de>, ietf-mta-filters@mail.imc.org
Subject: Re: Expiring/deleting old mail
Message-ID: <243567.1079439063@ninevah.cyrusoft.com>
In-Reply-To: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
References:  <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
X-Mailer: Mulberry/3.2.0a1 (Mac OS X)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


Hi Michael,

--On Tuesday, March 16, 2004 2:22 PM +0100 Michael Haardt 
<michael@freenet-ag.de> wrote:

| Some mail systems allow the concept of "rolling/automatically expiring"
| mailboxes/folders which automatically remove old mail, which is useful
| for mailing lists and junk mail folders.  It is important that this
| function is not performed by the client, because clients usually don't
| clean up during vacation.
|
| For that reason, I suggest a Sieve extension, which allows the mail
| system to remove mail.  There are several ways to address the problem:

I'm afraid I still think expiration like this belongs in the mailstore not 
the delivery agent. There are other ways for messages to be delivered into 
mailboxes other than sieve and expiration policy for those is just as 
relevant as it is for mailboxes with sieve delivery occurring. e.g. 
Mailboxes that are targets of IMAP COPY and APPEND commands should be able 
to have expiration behaviour as you describe.

So I think the right approach is to define an IMAP extension for setting 
expiration policies on mailboxes, utilizing ANNOTEMORE for controlling the 
per-mailbox settings. The expiration test/action would be triggered by any 
action that could change the mailbox (COPY, APPEND, SELECT and external 
delivery) or, if a server chooses to implement it, an automated timed 
expiry check at an interval specified by the user or dictated by the system.

Note that one could be quite sophisticated about the expiry checks - e.g. 
IMAP SEARCH criteria could be used in the annotation to specify which 
messages are to be expired - so I could setup criteria to exclude messages 
that have the important (\Flagged) flag set etc.

-- 
Cyrus Daboo


From owner-ietf-mta-filters Tue Mar 16 17:30:57 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2H1UvHL076927;
	Tue, 16 Mar 2004 17:30:57 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2H1UvxG076926;
	Tue, 16 Mar 2004 17:30:57 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2H1Uul0076920
	for <ietf-mta-filters@mail.imc.org>; Tue, 16 Mar 2004 17:30:56 -0800 (PST)
	(envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243)
 id <01L7S9K1QH400027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org;
 Tue, 16 Mar 2004 17:31:02 -0800 (PST)
Date: Tue, 16 Mar 2004 17:12:04 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Expiring/deleting old mail
In-reply-to: "Your message dated Tue, 16 Mar 2004 14:22:36 +0100"
 <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
To: Michael Haardt <michael@freenet-ag.de>
Cc: ietf-mta-filters@mail.imc.org
Message-id: <01L7SX7NE6EA0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii
Content-transfer-encoding: 7BIT
References: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>



> Hello,

> let me summarise the recent discussion.  I hope this reflects most
> views expressed on the topic:

> Some mail systems allow the concept of "rolling/automatically expiring"
> mailboxes/folders which automatically remove old mail, which is useful
> for mailing lists and junk mail folders.  It is important that this
> function is not performed by the client, because clients usually don't
> clean up during vacation.

> For that reason, I suggest a Sieve extension, which allows the mail
> system to remove mail.  There are several ways to address the problem:

Including nailing down the semantics of this as an IMAP extension first,
and once that's done worrying the sieve issues if appropriate.

Note that semantics specified as part of an IMAP extension can be used outside
of IMAP.

> Folder Attributes

> Sieve focuses on message delivery, so using sieve to control folder
> attributes would be using it for a purpose it was not intended for.

> Message Attributes

> This fits well into Sieve, it allows the richest set of features, but
> message expiration attributes are also the most complicated approach.
> Further, users might expect expiration dates to be met exactly and
> not be pleased about lazy expiration, adding further complexity for
> the implementation.  IMAP ANNOTATE may be the way to go for message
> attributes.

> Message removal at delivery

> This approach is easy to understand for users and easy to implement: It
> keeps removing mail, starting from the oldest, until the given criteria
> are matched.  It could be realised by adding an option to "fileinto"
> and probably "keep":

>   fileinto :max-days 7 "inbox.mailinglist";
>   fileinto :max-messages 100 "inbox.mailinglist";
>   fileinto :max-storage 1M "inbox.mailinglist";

> It is still open how the last action should behave when delivering
> a 2M message.  Perhaps there is a better name instead of "max-".
> This mechanism should not be called expiration, because people expect
> a different behaviour by that name.

I'm sorry, but these are simply folder-level attributes crammed in at the
message level because that's the mechanism sieve provides. But calling them
message atributes doesn't change their nature.

I'm opposed to all of these approaches and strongly opposed to the last one. If
you want to do this, do it right - specify an IMAP extension and then, if it
makes sense, specify a sieve extension that can be used to control the
mechanism.

				Ned


From owner-ietf-mta-filters Tue Mar 16 19:25:47 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2H3PlDk083736;
	Tue, 16 Mar 2004 19:25:47 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2H3Pl30083735;
	Tue, 16 Mar 2004 19:25:47 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2H3Pkne083729
	for <ietf-mta-filters@imc.org>; Tue, 16 Mar 2004 19:25:46 -0800 (PST)
	(envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243)
 id <01L7S9K1QH400027NR@mauve.mrochek.com> for ietf-mta-filters@imc.org; Tue,
 16 Mar 2004 19:25:51 -0800 (PST)
Date: Tue, 16 Mar 2004 19:20:26 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Comments on draft-daboo-sieve-mime-00.txt
In-reply-to: "Your message dated Mon, 15 Mar 2004 14:59:36 -0500"
 <187472.1079362776@ninevah.cyrusoft.com>
To: Cyrus Daboo <daboo@cyrusoft.com>
Cc: ned.freed@mrochek.com, IETF MTA Filters List <ietf-mta-filters@imc.org>
Message-id: <01L7T180GS8E0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii; format=flowed
Content-transfer-encoding: 7BIT
References: <104800.1076013775@ninevah.cyrusoft.com>
 <01L7HAGIBZLW0027NR@mauve.mrochek.com>
 <187472.1079362776@ninevah.cyrusoft.com>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


> Hi Ned,
> Thanks for your comments:

> --On Monday, March 8, 2004 9:22 AM -0800 ned.freed@mrochek.com wrote:

> | Having said that, I think the specifics of how this was done aren't
> | right. First, as presently written this specification only extends the
> | header test, and it does so by creating an entirely new test. But there
> | are two other tests that are equally applicable to inner headers: exists
> | and address. Either similar "mimeexists" and "mimeaddress" tests need to
> | be added (and perhaps "mime" changed to "mimeheader"), or this needs to
> | be done within the existing tests by adding a :mime parameter. I'm
> | indifferent as to which one of these approaches is chosen, but we do need
> | one of them.
> |
> | Second, I really don't like the use of an optional middle parameter to
> | specify that the test is to be performed on a parameter value. This sort
> | of thing is why we have labelled parameters: It should be done as
> | :parameter or something similar. As for the use of a null parameter-names
> | value to indicate a test of non-paramer material, this can done with
> | :parameter as well, but I do worry that this is a bit tricky. OTOH, I
> | haven't been able to come up with a differenent way to do it that I like
> | better.

> OK - here is another solution to the syntax. What I'm proposing is a
> mimeheader test that takes the following parameters:

> :name - the name of a specific MIME header to test (can be a list of names)
> :parameter-name - the name of a specific parameter name to test (can be a
> list)

> :exists - test the existence of the specified items

> :text - do comparisons against the content of the entire MIME header
> selected
> :value - do comparisons against the value of the MIME header, excluding
> parameters
> :parameter-value - do comparisons on parameter values only

I really don't care for this at all. Like it or not, sieve opted to define
three tests that act on headers: header/exists/address. Unless there is a very
compelling reason to alter this model - and I've seen no evidence that there is
such a reason - I think we should stick with it. And this argues for either of
the proposals I made previously: mimeheader/mimeexists/mimeaddress or an
additional parameter on the existing tests. NIgel has expressed a preference
for the latter, but I'm happy with either.

Think of it this way: Changing an existing script that employs tests on
the outer header to one that tests all headers in the MIME structure
shouldn't require switching to a completely different sort of test.
A simple addition should be sufficient, and whether that addition is
a test name prefix or a new parameter makes no difference to me.

				Ned


From owner-ietf-mta-filters Tue Mar 16 19:19:52 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2H3JpEU082673;
	Tue, 16 Mar 2004 19:19:51 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2H3JpKv082672;
	Tue, 16 Mar 2004 19:19:51 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2H3Jopj082659
	for <ietf-mta-filters@imc.org>; Tue, 16 Mar 2004 19:19:51 -0800 (PST)
	(envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243)
 id <01L7S9K1QH400027NR@mauve.mrochek.com> for ietf-mta-filters@imc.org; Tue,
 16 Mar 2004 19:19:54 -0800 (PST)
Date: Tue, 16 Mar 2004 18:34:42 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Comments on draft-daboo-sieve-mime-00.txt
In-reply-to: "Your message dated Tue, 16 Mar 2004 00:10:30 +0000"
 <016601c40aeb$17faa0f0$6401a8c0@nigelhome>
To: Nigel Swinson <Nigel.Swinson@rockliffe.com>
Cc: Cyrus Daboo <daboo@cyrusoft.com>,
        IETF MTA Filters List <ietf-mta-filters@imc.org>
Message-id: <01L7T10MCTYK0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; charset=iso-8859-1
Content-transfer-encoding: 7BIT
References: <104800.1076013775@ninevah.cyrusoft.com>
 <01L7HAGIBZLW0027NR@mauve.mrochek.com>
 <187472.1079362776@ninevah.cyrusoft.com>
 <016601c40aeb$17faa0f0$6401a8c0@nigelhome>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>



> I've spent quite a lot of time thinking about this particular extension too
> and can't wait to implement it, but have never really felt comfortable with a
> set of syntax, and don't feel comfortable with any of the proposals so far; so
> here's another to throw into the pool for thought:

I like this proposal. But this is hardly surprising, since it differs only
slightly from some of the alternatives I proposed.

> I think MIME consists of two significant parts here; there's a set of new
> headers, and then there's the facility for multiple body parts.  Looking at the
> list of new headers, most of them seem to fit neatly into our existing tests
> (Mime-Version, Content-Id, etc), however the only one that has additional
> significant structure is the Content-Type header, which is defined as:

>      content := "Content-Type" ":" type "/" subtype
>                 *(";" parameter)
>                 ; Matching of media type and subtype
>                 ; is ALWAYS case-insensitive.

> Then looking more generically we've also got:

>      disposition := "Content-Disposition" ":"
>                     disposition-type
>                     *(";" disposition-parm)

> And there's probably others.  So we have this syntax.

>      mime-header := header-name ":"
>                     header-value
>                     *(";" param-name "=" param-value)

> So lets provide a tagged argument to the header, exists, address tests that
> parses out this structure and allows us to select exactly which bits we want
> to test against:

I think this particular extension only belongs on header.

>    Syntax:   header [HEADER-PART] [COMPARATOR] [MATCH-TYPE]
>              <header-names: string-list> <key-list: string-list>

>     HEADER-PART: ":value" / ":parameter" <param-names: string-list>

:parameter is fine but there's a problem with :value - it is already
defined in a different way by RFC 3431. How about :type instead?

> - If we specify ":value" as the optional header-part parameter, then the test
> only operates on the header-value.

> - If we specify the :parameter optional header-part parameter, then the
> string list describes the list of parameter values that we should search in.

Both of these sound good.

> - If neither optional parameter is specified, the header test operates on the
> entire header value as normal.

Has to be this way for backwards compatibility.

> - Other HEADER-PARTS could be defined in the future if we have other headers
> with a different defined structure.

Right, but it also seems reasonable that if future attr=value sorts of headers
are defined it will be done with a similar syntax to the ones that already
exist and that the same tests can be brought to bear on them.

> If we think :value is too confusing for the "header value when with
> parameters" compared to the "whole header value", then perhaps we could use
> :valueonly, :noparameters or :mimevalue or something else?

I like :type. It matches up well with "type of disposition" and "media type".

> Maybe the prefix
> could be like a "namespace" defining the header parsing algorithm to use, and
> if we have other headers that have a common structure, we could define other
> namespaces that detail the header parsing method to use.

I think this probably goes too far.

> The above would test only in the "active body part" which is the top level
> body part, which is the email headers, which is what we've all been dealing
> with already.  It would NOT recursively look for headers in all child body
> parts.  That would be done with the second half of my proposal.  Where a server
> doesn't have a mime parser, or was worried about the extra overhead of parsing
> the mime structure, it wouldn't support this second part, but could still
> support Header-Parts.

The notion of two separate extension is interesting. I personally have no need
to make the distinction, but I have no problem with the split if others
think it is useful.

> The second significant half of MIME permits us to recursively define body
> parts, which each have a set of headers, and content.  So any solution that we
> have needs to cope with the potential recursive nature of the MIME structure. 
> So what if we define a new tagged argument for use with all of our existing
> tests that specifies that we should recursively look in the body parts too? 
> Call it :bodyparts.  So this means that if I write a test that says:

>     if header :contains "Content-Type" "text/html"

> Then this would only match if the message contains a single body part that is
> text/html.  However if I write the following, then this would match if there is
> ANY text/html body part anywhere in the legal MIME structure of the message:

>     if header :bodyparts :contains "Content-Type" "text/html"

Modulo the name of the parameter (which I don't particularly care about)
this is one of the alternatives I proposed.

> With our new mimeheader test this would become more correctly:

>     if header :bodyparts :value :contains "Content-Type" "text/html"

> Then if we combine this with allof(), we could further define that multiple tests within an allof() must apply to the same body part.  So if we say:

>     if allof :bodyparts (header :value :contains "Content-Type" "image/jpeg",
>                                   size :over 100K)

> Then this would catch all messages that contain a image/jpeg body part that is over 100K.  However if we say the following, then this would catch any message that contained a body part that was image/jpeg and a body part (potentially different) which was over 100K in size.:

>     if allof (header :bodyparts :value :contains "Content-Type" "image/jpeg",
>                 size :bodyparts :over 100K)

> This then very neatly fits with the body extention, and we get a test like this which would test for all messages that contain a text body part that contains the word "Spam":

>     if allof :bodyparts (header :value :contains "Content-Type" "text",
>                                   body :contains "Spam")

> For more examples, I'll go through Cyrus examples and show how they would
> look for this proposal.  However before I do, I note that many look for an "in
> any header value" or an "in any parameter value" concept.  We currently haven't
> found a need for these, and I'm not sure we need them.  If we do, then I'd
> propose we have new tests like "anyheader", "anyexists" and a new header-part
> of ":anyparameter".

This all sounds reasonable, but as you say, let's wait for the demand before
we add it.

				Ned


From owner-ietf-mta-filters Wed Mar 17 03:11:20 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HBBKJx091484;
	Wed, 17 Mar 2004 03:11:20 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2HBBKm0091483;
	Wed, 17 Mar 2004 03:11:20 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mout2.freenet.de (mout2.freenet.de [194.97.50.155])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HBBJcp091475
	for <ietf-mta-filters@mail.imc.org>; Wed, 17 Mar 2004 03:11:19 -0800 (PST)
	(envelope-from michael@freenet-ag.de)
Received: from [194.97.50.138] (helo=mx0.freenet.de)
	by mout2.freenet.de with asmtp (Exim 4.30)
	id 1B3YxD-0007DI-Bt
	for ietf-mta-filters@mail.imc.org; Wed, 17 Mar 2004 12:11:19 +0100
Received: from nostromo.freenet-ag.de ([194.97.7.6])
	by mx0.freenet.de with esmtp (TLSv1:AES256-SHA:256) (Exim 4.303 #2)
	id 1B3YxD-0002Hu-7J
	for ietf-mta-filters@mail.imc.org; Wed, 17 Mar 2004 12:11:19 +0100
Received: from michael by nostromo.freenet-ag.de with local (ID michael) (Exim 4.303 #3)
	id 1B3YxC-00062d-RI
	for ietf-mta-filters@mail.imc.org; Wed, 17 Mar 2004 12:11:18 +0100
To: ietf-mta-filters@mail.imc.org
Subject: Re: Expiring/deleting old mail
Message-Id: <E1B3YxC-00062d-RI@nostromo.freenet-ag.de>
From: Michael Haardt <michael@freenet-ag.de>
Date: Wed, 17 Mar 2004 12:11:18 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


> > Message removal at delivery
>
> > This approach is easy to understand for users and easy to implement: It
> > keeps removing mail, starting from the oldest, until the given criteria
> > are matched.  It could be realised by adding an option to "fileinto"
> > and probably "keep":
>
> >   fileinto :max-days 7 "inbox.mailinglist";
> >   fileinto :max-messages 100 "inbox.mailinglist";
> >   fileinto :max-storage 1M "inbox.mailinglist";
>
> > It is still open how the last action should behave when delivering
> > a 2M message.  Perhaps there is a better name instead of "max-".
> > This mechanism should not be called expiration, because people expect
> > a different behaviour by that name.
>
> I'm sorry, but these are simply folder-level attributes crammed in at the
> message level because that's the mechanism sieve provides. But calling them
> message atributes doesn't change their nature.

This last approach does not add message or folder flags in any way.
The previous one did.  This is a modified action, which first cleans up
the folder and then delivers a message to it.

I could imagine to move that functionality into a new action (cleanup?),
but until I see where it could be useful apart from a following fileinto,
I talk about it as fileinto extension.

> I'm opposed to all of these approaches and strongly opposed to the last one. If
> you want to do this, do it right - specify an IMAP extension and then, if it
> makes sense, specify a sieve extension that can be used to control the
> mechanism.

That makes sense for folder or message attributes.  I don't want
any attributes, because I do not like their overhead.  To answer the
previous asked question of conflicting actions: There are no conflicts.
"max-days 7" followed by a "max-days 6" leaves the last six days mail
in the folder.

Michael


From owner-ietf-mta-filters Wed Mar 17 06:19:20 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEJKvV006584;
	Wed, 17 Mar 2004 06:19:20 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2HEJK4I006583;
	Wed, 17 Mar 2004 06:19:20 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEJJp5006577
	for <ietf-mta-filters@mail.imc.org>; Wed, 17 Mar 2004 06:19:19 -0800 (PST)
	(envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8])
	(user=rjs3 mech=GSSAPI (0 bits))
	by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2HEJIkw029238;
	Wed, 17 Mar 2004 09:19:18 -0500
Date: Wed, 17 Mar 2004 09:19:19 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: Michael Haardt <michael@freenet-ag.de>
cc: ietf-mta-filters@mail.imc.org
Subject: Re: Expiring/deleting old mail
In-Reply-To: <E1B3YxC-00062d-RI@nostromo.freenet-ag.de>
Message-ID: <Pine.LNX.4.58-035.0403170918510.30170@sourcefour.andrew.cmu.edu>
References: <E1B3YxC-00062d-RI@nostromo.freenet-ag.de>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Wed, 17 Mar 2004, Michael Haardt wrote:

> That makes sense for folder or message attributes.  I don't want
> any attributes, because I do not like their overhead.  To answer the
> previous asked question of conflicting actions: There are no conflicts.
> "max-days 7" followed by a "max-days 6" leaves the last six days mail
> in the folder.

This seems like a very fast way for script authors to shoot themselves in
the foot.

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----


From owner-ietf-mta-filters Wed Mar 17 06:17:54 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEHsqA006520;
	Wed, 17 Mar 2004 06:17:54 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2HEHsUi006519;
	Wed, 17 Mar 2004 06:17:54 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEHrqG006513
	for <ietf-mta-filters@mail.imc.org>; Wed, 17 Mar 2004 06:17:53 -0800 (PST)
	(envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8])
	(user=rjs3 mech=GSSAPI (0 bits))
	by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2HEHpkw029231;
	Wed, 17 Mar 2004 09:17:51 -0500
Date: Wed, 17 Mar 2004 09:17:52 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: ned.freed@mrochek.com
cc: Michael Haardt <michael@freenet-ag.de>, ietf-mta-filters@mail.imc.org
Subject: Re: Expiring/deleting old mail
In-Reply-To: <01L7SX7NE6EA0027NR@mauve.mrochek.com>
Message-ID: <Pine.LNX.4.58-035.0403170916061.30170@sourcefour.andrew.cmu.edu>
References: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de> <01L7SX7NE6EA0027NR@mauve.mrochek.com>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Tue, 16 Mar 2004 ned.freed@mrochek.com wrote:

> I'm sorry, but these are simply folder-level attributes crammed in at the
> message level because that's the mechanism sieve provides. But calling them
> message atributes doesn't change their nature.

I agree on the last one -- but message annotations can also be "this
message expires on date xyz" which is not necessaraly related to when the
next message in the mailbox expires.

Though I also agree that the sanest way to do this is just with a
folder-wide attribute in IMAP, and leave sieve out of it.

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----


From owner-ietf-mta-filters Wed Mar 17 06:53:07 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEr72J008499;
	Wed, 17 Mar 2004 06:53:07 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2HEr7NK008498;
	Wed, 17 Mar 2004 06:53:07 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEr691008492
	for <ietf-mta-filters@mail.imc.org>; Wed, 17 Mar 2004 06:53:06 -0800 (PST)
	(envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8])
	(user=rjs3 mech=GSSAPI (0 bits))
	by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2HEr5kw029315;
	Wed, 17 Mar 2004 09:53:05 -0500
Date: Wed, 17 Mar 2004 09:53:06 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: ned.freed@mrochek.com
cc: Michael Haardt <michael@freenet-ag.de>, ietf-mta-filters@mail.imc.org
Subject: Re: Expiring/deleting old mail
In-Reply-To: <01L7TP54JFQS0027NR@mauve.mrochek.com>
Message-ID: <Pine.LNX.4.58-035.0403170952380.30170@sourcefour.andrew.cmu.edu>
References: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de> <01L7SX7NE6EA0027NR@mauve.mrochek.com>
 <Pine.LNX.4.58-035.0403170916061.30170@sourcefour.andrew.cmu.edu>
 <01L7TP54JFQS0027NR@mauve.mrochek.com>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Wed, 17 Mar 2004 ned.freed@mrochek.com wrote:

> > Though I also agree that the sanest way to do this is just with a
> > folder-wide attribute in IMAP, and leave sieve out of it.
>
> In other words, there are two fairly different models for how to handle
> expirations in a message store, and we need to pick the one that makes the most
> sense. Doesn't this sound like something store implementors might want to have
> a wee bit of say in?

Yes -- I agree that sieve is not the place to do this.  Certainly not at
first, anyway.

-Rob


-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----


From owner-ietf-mta-filters Wed Mar 17 06:50:45 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEoiu9008429;
	Wed, 17 Mar 2004 06:50:44 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2HEoiCf008428;
	Wed, 17 Mar 2004 06:50:44 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEoiMN008422
	for <ietf-mta-filters@mail.imc.org>; Wed, 17 Mar 2004 06:50:44 -0800 (PST)
	(envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243)
 id <01L7S9K1QH400027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org;
 Wed, 17 Mar 2004 06:50:44 -0800 (PST)
Date: Wed, 17 Mar 2004 06:48:16 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Expiring/deleting old mail
In-reply-to: "Your message dated Wed, 17 Mar 2004 09:17:52 -0500 (EST)"
 <Pine.LNX.4.58-035.0403170916061.30170@sourcefour.andrew.cmu.edu>
To: Rob Siemborski <rjs3@andrew.cmu.edu>
Cc: ned.freed@mrochek.com, Michael Haardt <michael@freenet-ag.de>,
        ietf-mta-filters@mail.imc.org
Message-id: <01L7TP54JFQS0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii
Content-transfer-encoding: 7BIT
References: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
 <01L7SX7NE6EA0027NR@mauve.mrochek.com>
 <Pine.LNX.4.58-035.0403170916061.30170@sourcefour.andrew.cmu.edu>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>



> On Tue, 16 Mar 2004 ned.freed@mrochek.com wrote:

> > I'm sorry, but these are simply folder-level attributes crammed in at the
> > message level because that's the mechanism sieve provides. But calling them
> > message atributes doesn't change their nature.

> I agree on the last one -- but message annotations can also be "this
> message expires on date xyz" which is not necessaraly related to when the
> next message in the mailbox expires.

Of course they can, but this is just the per-message way of doing it,
rather than the per-folder way.

> Though I also agree that the sanest way to do this is just with a
> folder-wide attribute in IMAP, and leave sieve out of it.

In other words, there are two fairly different models for how to handle
expirations in a message store, and we need to pick the one that makes the most
sense. Doesn't this sound like something store implementors might want to have
a wee bit of say in?

				Ned


From owner-ietf-mta-filters Wed Mar 17 07:38:08 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HFc8bj011246;
	Wed, 17 Mar 2004 07:38:08 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2HFc8Xp011245;
	Wed, 17 Mar 2004 07:38:08 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from winserver.com (mail.winserver.com [208.247.131.9])
	by above.proper.com (8.12.11/8.12.8) with SMTP id i2HFc7oH011236
	for <ietf-mta-filters@mail.imc.org>; Wed, 17 Mar 2004 07:38:07 -0800 (PST)
	(envelope-from winserver.support@winserver.com)
Received: by winserver.com (Wildcat! SMTP Router v5.7.450.9b13)
          for ietf-mta-filters@mail.imc.org; Wed, 17 Mar 2004 10:40:05 -0500
Received: from  ([68.211.139.123]) EHLO=hdev1
          by winserver.com (Wildcat! SMTP v5.7.450.9b13) with SMTP
          id 3990575500; Wed, 17 Mar 2004 10:40:04 -0500
Message-ID: <007d01c40c35$fc062e40$6401a8c0@hdev1>
From: "Hector Santos" <winserver.support@winserver.com>
To: <ietf-mta-filters@mail.imc.org>, "Michael Haardt" <michael@freenet-ag.de>
References: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
Subject: Re: Expiring/deleting old mail
Date: Wed, 17 Mar 2004 10:38:03 -0500
Organization: Santronics Software, Inc
MIME-Version: 1.0
Content-Type: text/plain;
	charset="Windows-1252"
Content-Transfer-Encoding: 7bit
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


Maybe these can offer some insight. These are our mail server mail policy
attributes (per conference AKA folder).  Our mail server automatically
maintains the mail once per day between 1am and 5am (adjustable).

o Maximum Messages:
o Message Number to Trigger Renumber:
o Days to Keep Read Private Mail:
o Days to Keep Unread Private or Public Mail:
o Days to keep external user mail : (outgoing mail created by your users).
o Delete external user mail once delivered by SMTP:

Other folder/user profile group based options  that can have an effect on
the mail tracking/maintance.

o Allow Mail Previewing (Non-POP3 devices)
o Mark downloaded (POP3) Mail as Received:  Yes/No

In general, users have no say in our product mail policy design.  POP3/WEB
mail access has changed that over the years with users now having some
"leave on server" options in their MUA to help them with roaming.   However,
tracking, mail maintenance, mail receipt request, etc (Subscribers can't
claim they didn't get an expiration notice) is still important so our design
compromise was to have two Receive bits. One that is always recorded for
internal purposes and one that is used for the user.  This allows them to
Preview mail on lets say the Web without marking it read, and then via MUA
download the mail with direct mail
pointers retrieving the "unread user mail."    Same idea with the MUA
(POP3), option to not mark receive allows them to roam to around to other
machines.   However, the internal received bit still prevails for the normal
mail packing/maintenance options (Days to Key UnRead/Read Private Mail
options).   Users have no say on how long mail stays in storage, unless of
course, it is shorter than the server limits, in which case,  the MUA can
delete the message.

I guess my point with the note, that whole concept present a very difficult
PR/system policy issue where MUA clients were demanding new behaviors
conflict with some of the product's traditional strong mail security,
tracking and maintenance policies.  The #1 being subscription notices could
not be bypass with user's previews or non-marking downloads, and the 2nd was
the increase mail storage requirements in large systems because the triggers
were being bypassed.

Hope this provide some engineering insights.

-- 
Hector Santos, Santronics Software, Inc.
http://www.santronics.com







----- Original Message ----- 
From: "Michael Haardt" <michael@freenet-ag.de>
To: <ietf-mta-filters@mail.imc.org>
Sent: Tuesday, March 16, 2004 8:22 AM
Subject: Expiring/deleting old mail


>
> Hello,
>
> let me summarise the recent discussion.  I hope this reflects most
> views expressed on the topic:
>
> Some mail systems allow the concept of "rolling/automatically expiring"
> mailboxes/folders which automatically remove old mail, which is useful
> for mailing lists and junk mail folders.  It is important that this
> function is not performed by the client, because clients usually don't
> clean up during vacation.
>
> For that reason, I suggest a Sieve extension, which allows the mail
> system to remove mail.  There are several ways to address the problem:
>
> Folder Attributes
>
> Sieve focuses on message delivery, so using sieve to control folder
> attributes would be using it for a purpose it was not intended for.
>
> Message Attributes
>
> This fits well into Sieve, it allows the richest set of features, but
> message expiration attributes are also the most complicated approach.
> Further, users might expect expiration dates to be met exactly and
> not be pleased about lazy expiration, adding further complexity for
> the implementation.  IMAP ANNOTATE may be the way to go for message
> attributes.
>
> Message removal at delivery
>
> This approach is easy to understand for users and easy to implement: It
> keeps removing mail, starting from the oldest, until the given criteria
> are matched.  It could be realised by adding an option to "fileinto"
> and probably "keep":
>
>   fileinto :max-days 7 "inbox.mailinglist";
>   fileinto :max-messages 100 "inbox.mailinglist";
>   fileinto :max-storage 1M "inbox.mailinglist";
>
> It is still open how the last action should behave when delivering
> a 2M message.  Perhaps there is a better name instead of "max-".
> This mechanism should not be called expiration, because people expect
> a different behaviour by that name.
>
> Michael
>
>



From owner-ietf-mta-filters Wed Mar 17 11:48:43 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HJmhB1029996;
	Wed, 17 Mar 2004 11:48:43 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2HJmh35029995;
	Wed, 17 Mar 2004 11:48:43 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40])
	by above.proper.com (8.12.11/8.12.8) with SMTP id i2HJmgrT029989
	for <ietf-mta-filters@imc.org>; Wed, 17 Mar 2004 11:48:42 -0800 (PST)
	(envelope-from mem@mv.mv.com)
Received: (qmail 21553 invoked from network); 17 Mar 2004 14:48:41 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17)
  by mercury.mv.net with SMTP; 17 Mar 2004 14:48:44 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40
  local-name mercury.mv.net
Received: (qmail 8887 invoked by uid 101); 17 Mar 2004 14:48:40 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Wed, 17 Mar 2004 14:48:40 -0500
To: Nigel Swinson <Nigel.Swinson@rockliffe.com>
Cc: Cyrus Daboo <daboo@cyrusoft.com>,
        IETF MTA Filters List <ietf-mta-filters@imc.org>
Subject: Re: Comments on draft-daboo-sieve-mime-00.txt
Message-ID: <20040317194840.GA13423@iridium.mv.net>
References: <104800.1076013775@ninevah.cyrusoft.com> <01L7HAGIBZLW0027NR@mauve.mrochek.com> <187472.1079362776@ninevah.cyrusoft.com> <016601c40aeb$17faa0f0$6401a8c0@nigelhome>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <016601c40aeb$17faa0f0$6401a8c0@nigelhome>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Tue, Mar 16, 2004 at 12:10:30AM -0000, Nigel Swinson wrote:

   [ alternative mime tests description ]

This all mostly sounds very good.  Some random reflections:


> If we think :value is too confusing for the "header value when with
> parameters" compared to the "whole header value", then perhaps we
> could use :valueonly, :noparameters or :mimevalue or something else?
> Maybe the prefix could be like a "namespace" defining the header
> parsing algorithm to use, and if we have other headers that have a
> common structure, we could define other namespaces that detail the
> header parsing method to use.

I too think that ":value" is not the best choice, for various reasons,
some of which have been already stated.  ":type" probably works for
the mime headers but might not be as meaningful if this is later used
to apply to other headers of similar form.  What there really are are
fixed parts and variable keyword=value parts.  This doesn't really
inspire any other good names, though.



> The above would test only in the "active body part" which is the top
> level body part, which is the email headers, which is what we've all
> been dealing with already.  It would NOT recursively look for headers
> in all child body parts.
   ...
> The second significant half of MIME permits us to recursively define
> body parts, which each have a set of headers, and content.  So any
> solution that we have needs to cope with the potential recursive
> nature of the MIME structure.  So what if we define a new tagged
> argument for use with all of our existing tests that specifies that we
> should recursively look in the body parts too?  Call it :bodyparts.
> So this means that if I write a test that says:
> 
>     if header :contains "Content-Type" "text/html"
> 
> Then this would only match if the message contains a single body part
> that is text/html.  However if I write the following, then this would
> match if there is ANY text/html body part anywhere in the legal MIME
> structure of the message:
> 
>     if header :bodyparts :contains "Content-Type" "text/html"

Do you intend :bodyparts to select the mime parts in the message body,
or in the entire message (i.e., does it include or exclude the message
header?)  My preference would be the body only, so that one can have
the most flexibility.


> Then if we combine this with allof(), we could further define that
> multiple tests within an allof() must apply to the same body part.  So
> if we say:
> 
>     if allof :bodyparts (header :value :contains "Content-Type" "image/jpeg",
>                                   size :over 100K)

Syntactically this is interesting, although as I've said before I think
a full-fledged notion of "views" would be more so (but obviously that's a
whole nother track).  I wonder how various implementors feel about
connecting "allof" with its contained tests in this way -- especially
if they are allowed to nest.


> > 6) Test for text in any parameter values only in a specific MIME header
> > 
> >     if (mimeheader :name "Content-Disposition" :parameter-value :contains 
> > ".exe")
> 
> if header :bodyparts :anyparameter :contains "Content-Disposition" ".exe"

Rather than introduce another keyword, I'd suggest using a special
parameter value string to match any actual parameter.  e.g.:

    if header :bodyparts :parameter "" :contains "Content-Disposition" ".exe"
or
    if header :bodyparts :parameter "*" :contains "Content-Disposition" ".exe"

Perhaps even say that the ":parameter" value is tested using a wildcard
match (a la :matches).



> What do you think?

Very nice..

mm


From owner-ietf-mta-filters Wed Mar 17 12:52:38 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HKqcAv039809;
	Wed, 17 Mar 2004 12:52:38 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2HKqc8s039808;
	Wed, 17 Mar 2004 12:52:38 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40])
	by above.proper.com (8.12.11/8.12.8) with SMTP id i2HKqbr1039801
	for <ietf-mta-filters@mail.imc.org>; Wed, 17 Mar 2004 12:52:37 -0800 (PST)
	(envelope-from mem@mv.mv.com)
Received: (qmail 7529 invoked from network); 17 Mar 2004 15:52:29 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17)
  by mercury.mv.net with SMTP; 17 Mar 2004 15:52:41 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40
  local-name mercury.mv.net
Received: (qmail 10917 invoked by uid 101); 17 Mar 2004 15:52:29 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Wed, 17 Mar 2004 15:52:28 -0500
To: Cyrus Daboo <daboo@cyrusoft.com>
Cc: Michael Haardt <michael@freenet-ag.de>, ietf-mta-filters@mail.imc.org
Subject: Re: Expiring/deleting old mail
Message-ID: <20040317205228.GG13423@iridium.mv.net>
References: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de> <243567.1079439063@ninevah.cyrusoft.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <243567.1079439063@ninevah.cyrusoft.com>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


On Tue, Mar 16, 2004 at 12:11:03PM -0500, Cyrus Daboo wrote:
> Hi Michael,
> 
> --On Tuesday, March 16, 2004 2:22 PM +0100 Michael Haardt 
> <michael@freenet-ag.de> wrote:
> 
> | Some mail systems allow the concept of "rolling/automatically expiring"
> | mailboxes/folders which automatically remove old mail, which is useful
> | for mailing lists and junk mail folders.  It is important that this
> | function is not performed by the client, because clients usually don't
> | clean up during vacation.
> |
> | For that reason, I suggest a Sieve extension, which allows the mail
> | system to remove mail.  There are several ways to address the problem:
> 
> I'm afraid I still think expiration like this belongs in the mailstore not 
> the delivery agent.

Unfortunately I can see both perspectives :-)

I do understand yours, or at least I think I do.  You want to have
mailstore attributes that control this particular combination of mail
folder operations.

The other one is that the agent acts just like I do, only I'm not
sitting at the keyboard.  I can sit down at my computer and access a
folder and make sure I have less than 100 messages in it when I
leave.  I do this using existing primitive access functions.
Similarly, I could tell my sieve-enabled LDA to follow this same
methodology.  The issue of "what if some other access access doesn't
do this" is a red herring.  I can manually open up the folder using a
mail client and treat the folder in a different way... so?  It's the
same thing: it's me doing the access whether I've told an agent to do
it, whether I access using my keyboard, or whether I told another
agent to do something else.  If I do conflicting things it's my
choice, and it may or may not be an error.  I don't think I need an
IMAP extension to allow primitive operations to be combined in these
ways.

Personally I wouldn't want to use a system that required me to
configure my folders for each kind of access I wanted to do, or each
way that I wanted to use them.  Nor would I want to use mail folders
that had side-effects when I accessed them.  I can respect that others
might want this, though-- it's just not my mindset.

I can also respect an opinion that SIEVE only operates on a single
message, and yeah, I see that point.  But if SIEVE is the filtering
language in my LDA of choice (and it is), and I would like to have
some interaction with an existing mailstore (and I do), some level of
access to an existing store is not really out of place.

Anyway, I'm not trying to repeat myself here, just providing what
I hope is a little more light.  I doubt anyone who has the other
perspective will be convinced, though.

Yours,
-mm-


From owner-ietf-mta-filters Wed Mar 17 13:47:58 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HLlwfm048636;
	Wed, 17 Mar 2004 13:47:58 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2HLlwQ0048634;
	Wed, 17 Mar 2004 13:47:58 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from vementry.enterprise.ucs.ed.ac.uk (vementry.enterprise.ucs.ed.ac.uk [129.215.200.96])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HLlvdw048626
	for <ietf-mta-filters@imc.org>; Wed, 17 Mar 2004 13:47:57 -0800 (PST)
	(envelope-from Nigel@swinson.com)
Received: from nigelhome (unverified [82.41.75.235]) by vementry.enterprise.ucs.ed.ac.uk
 (Rockliffe SMTPRA 6.0.9) with ESMTP id <B0000005254@vementry.enterprise.ucs.ed.ac.uk>;
 Wed, 17 Mar 2004 21:47:58 +0000
Message-ID: <001301c40c6a$764d2350$6401a8c0@nigelhome>
From: "Nigel Swinson" <Nigel@swinson.com>
To: "Mark E. Mallett" <mem@mv.mv.com>
Cc: "Cyrus Daboo" <daboo@cyrusoft.com>,
        "IETF MTA Filters List" <ietf-mta-filters@imc.org>
References: <104800.1076013775@ninevah.cyrusoft.com> <01L7HAGIBZLW0027NR@mauve.mrochek.com> <187472.1079362776@ninevah.cyrusoft.com> <016601c40aeb$17faa0f0$6401a8c0@nigelhome> <20040317194840.GA13423@iridium.mv.net>
Subject: Re: Comments on draft-daboo-sieve-mime-00.txt
Date: Wed, 17 Mar 2004 21:54:45 -0000
MIME-Version: 1.0
Content-Type: text/plain;
	charset="iso-8859-1"
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Content-Transfer-Encoding: 8bit
X-MIME-Autoconverted: from quoted-printable to 8bit by above.proper.com id i2HLlwdw048629
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


> This all mostly sounds very good.  Some random reflections:

Thanks Mark :o)

> I too think that ":value" is not the best choice, for various reasons,
> some of which have been already stated.  

To be honest I'm not a fan of :value either, so am more than happy for an alternative.

> ":type" probably works for
> the mime headers but might not be as meaningful if this is later used
> to apply to other headers of similar form.  What there really are are
> fixed parts and variable keyword=value parts.  This doesn't really
> inspire any other good names, though.

I don't mind :type but I'm wondering if :noparameters is best, as this pairs neatly with :parameters <string-list>?  

> >     if header :bodyparts :contains "Content-Type" "text/html"
> 
> Do you intend :bodyparts to select the mime parts in the message body,
> or in the entire message (i.e., does it include or exclude the message
> header?)  My preference would be the body only, so that one can have
> the most flexibility.

I had intended it to be the entire message, but not out of strong desire.  I guess if I was writing a test, I would care less about where in the email message the entity of interest was and more about it's prescense.  With our header test we aren't told about where in the headers the header is, and if you have a multipart/alternative structure or multipart/mixed then I'm not sure there is a logical distinction in the order.  So I think to neatly be able to say "is there any text/html body part in this email" is more useful than saying "is there a text/html body part in one of the child body parts?"

Were we to really need to know if the text/html body part was not the "root" body part, then we could use an allof test:

if allof (header :bodyparts :noparameters :contains "Content" "text/html",
          not header :noparameters :contains "Content" "text/html")

> > Then if we combine this with allof(), we could further define that
> > multiple tests within an allof() must apply to the same body part.  So
> > if we say:
> > 
> >     if allof :bodyparts (header :value :contains "Content-Type" "image/jpeg",
> >                                   size :over 100K)
> 
> Syntactically this is interesting, although as I've said before I think
> a full-fledged notion of "views" would be more so (but obviously that's a
> whole nother track).  I wonder how various implementors feel about
> connecting "allof" with its contained tests in this way -- especially
> if they are allowed to nest.

Originally I thought we should have a concept of "selection" of a body part and then be able to perform tests on it.  Couldn't get anywhere with the idea though, as I just thought it would end up in a hell of indexes into arrays of body parts, and also how would you "select" a body part?

> > > 6) Test for text in any parameter values only in a specific MIME header
> > > 
> > >     if (mimeheader :name "Content-Disposition" :parameter-value :contains 
> > > ".exe")
> > 
> > if header :bodyparts :anyparameter :contains "Content-Disposition" ".exe"
> 
> Rather than introduce another keyword, I'd suggest using a special
> parameter value string to match any actual parameter.  e.g.:
> 
>     if header :bodyparts :parameter "" :contains "Content-Disposition" ".exe"
> or
>     if header :bodyparts :parameter "*" :contains "Content-Disposition" ".exe"

Good ideas :o)  As I said, I'm not sure a concept of "anyparameter" or "anyheader" is particularly core to this extension so would think we'd have to justify it's usefulness before deciding to add it to the extension.  Certainly anyheader probably shouldn't be in a mime extension, but anyparameter might be.
 
> Perhaps even say that the ":parameter" value is tested using a wildcard
> match (a la :matches).

We haven't seen the facility for using wildcards on header names, so I'm not sure we need it for parameter names either as I think the two concepts are very similair...

Nigel


From owner-ietf-mta-filters Wed Mar 17 14:33:28 2004
Received: from above.proper.com (localhost.vpnc.org [127.0.0.1])
	by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HMXSjo057263;
	Wed, 17 Mar 2004 14:33:28 -0800 (PST)
	(envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost)
	by above.proper.com (8.12.11/8.12.9/Submit) id i2HMXSt5057262;
	Wed, 17 Mar 2004 14:33:28 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40])
	by above.proper.com (8.12.11/8.12.8) with SMTP id i2HMXR5T057255
	for <ietf-mta-filters@imc.org>; Wed, 17 Mar 2004 14:33:27 -0800 (PST)
	(envelope-from mem@mv.mv.com)
Received: (qmail 15295 invoked from network); 17 Mar 2004 17:33:32 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17)
  by mercury.mv.net with SMTP; 17 Mar 2004 17:33:32 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40
  local-name mercury.mv.net
Received: (qmail 640 invoked by uid 101); 17 Mar 2004 17:33:31 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Wed, 17 Mar 2004 17:33:31 -0500
To: Nigel Swinson <Nigel@Swinson.com>
Cc: "Mark E. Mallett" <mem@mv.mv.com>, Cyrus Daboo <daboo@cyrusoft.com>,
        IETF MTA Filters List <ietf-mta-filters@imc.org>
Subject: Re: Comments on draft-daboo-sieve-mime-00.txt
Message-ID: <20040317223331.GB26497@iridium.mv.net>
References: <104800.1076013775@ninevah.cyrusoft.com> <01L7HAGIBZLW0027NR@mauve.mrochek.com> <187472.1079362776@ninevah.cyrusoft.com> <016601c40aeb$17faa0f0$6401a8c0@nigelhome> <20040317194840.GA13423@iridium.mv.net> <001301c40c6a$764d2350$6401a8c0@nigelhome>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <001301c40c6a$764d2350$6401a8c0@nigelhome>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>


> > Do you intend :bodyparts to select the mime parts in the message body,
> > or in the entire message (i.e., does it include or exclude the message
> > header?)  My preference would be the body only, so that one can have
> > the most flexibility.
> 
> I had intended it to be the entire message, but not out of strong
> desire.  I guess if I was writing a test, I would care less about
> where in the email message the entity of interest was and more about
> it's prescense.  With our header test we aren't told about where in
> the headers the header is, and if you have a multipart/alternative
> structure or multipart/mixed then I'm not sure there is a logical
> distinction in the order.  So I think to neatly be able to say "is
> there any text/html body part in this email" is more useful than
> saying "is there a text/html body part in one of the child body parts?"

I tend to coss the toin in the direction of more options.  As you say,
it's hard to predict why one would want to exclude the message header,
however one can't always predict these sorts of things.  There's a
tradeoff: on one hand having :bodypart exclude the message header gives
more options, but on the other, one would have to use more SIEVE code
in the overwhelmingly common case.


> Originally I thought we should have a concept of "selection" of a
> body part and then be able to perform tests on it.  Couldn't get
> anywhere with the idea though, as I just thought it would end up in a
> hell of indexes into arrays of body parts, and also how would you
> "select" a body part?

I would like to see a mechanism for creating views (by whatever term)
that would have applicability for a number of sieve functions; were
this available, it could be used in conjunction with the mime
extension.  That's yet another conundrum tho: practically speaking, I
wouldn't want to hold up the mime extension for that, yet if the mime
extension includes its own selection facility, it could collide with a
future views capability.  (Not that I expect 'views' to have wide
support.)



> > Perhaps even say that the ":parameter" value is tested using a wildcard
> > match (a la :matches).
> 
> We haven't seen the facility for using wildcards on header names, so
> I'm not sure we need it for parameter names either as I think the two
> concepts are very similair...

I've actually had people ask for that- and have had occasion to
wish for it myself.  

mm



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HMXSjo057263; Wed, 17 Mar 2004 14:33:28 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2HMXSt5057262; Wed, 17 Mar 2004 14:33:28 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40]) by above.proper.com (8.12.11/8.12.8) with SMTP id i2HMXR5T057255 for <ietf-mta-filters@imc.org>; Wed, 17 Mar 2004 14:33:27 -0800 (PST) (envelope-from mem@mv.mv.com)
Received: (qmail 15295 invoked from network); 17 Mar 2004 17:33:32 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17) by mercury.mv.net with SMTP; 17 Mar 2004 17:33:32 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40 local-name mercury.mv.net
Received: (qmail 640 invoked by uid 101); 17 Mar 2004 17:33:31 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Wed, 17 Mar 2004 17:33:31 -0500
To: Nigel Swinson <Nigel@Swinson.com>
Cc: "Mark E. Mallett" <mem@mv.mv.com>, Cyrus Daboo <daboo@cyrusoft.com>, IETF MTA Filters List <ietf-mta-filters@imc.org>
Subject: Re: Comments on draft-daboo-sieve-mime-00.txt
Message-ID: <20040317223331.GB26497@iridium.mv.net>
References: <104800.1076013775@ninevah.cyrusoft.com> <01L7HAGIBZLW0027NR@mauve.mrochek.com> <187472.1079362776@ninevah.cyrusoft.com> <016601c40aeb$17faa0f0$6401a8c0@nigelhome> <20040317194840.GA13423@iridium.mv.net> <001301c40c6a$764d2350$6401a8c0@nigelhome>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <001301c40c6a$764d2350$6401a8c0@nigelhome>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> > Do you intend :bodyparts to select the mime parts in the message body,
> > or in the entire message (i.e., does it include or exclude the message
> > header?)  My preference would be the body only, so that one can have
> > the most flexibility.
> 
> I had intended it to be the entire message, but not out of strong
> desire.  I guess if I was writing a test, I would care less about
> where in the email message the entity of interest was and more about
> it's prescense.  With our header test we aren't told about where in
> the headers the header is, and if you have a multipart/alternative
> structure or multipart/mixed then I'm not sure there is a logical
> distinction in the order.  So I think to neatly be able to say "is
> there any text/html body part in this email" is more useful than
> saying "is there a text/html body part in one of the child body parts?"

I tend to coss the toin in the direction of more options.  As you say,
it's hard to predict why one would want to exclude the message header,
however one can't always predict these sorts of things.  There's a
tradeoff: on one hand having :bodypart exclude the message header gives
more options, but on the other, one would have to use more SIEVE code
in the overwhelmingly common case.


> Originally I thought we should have a concept of "selection" of a
> body part and then be able to perform tests on it.  Couldn't get
> anywhere with the idea though, as I just thought it would end up in a
> hell of indexes into arrays of body parts, and also how would you
> "select" a body part?

I would like to see a mechanism for creating views (by whatever term)
that would have applicability for a number of sieve functions; were
this available, it could be used in conjunction with the mime
extension.  That's yet another conundrum tho: practically speaking, I
wouldn't want to hold up the mime extension for that, yet if the mime
extension includes its own selection facility, it could collide with a
future views capability.  (Not that I expect 'views' to have wide
support.)



> > Perhaps even say that the ":parameter" value is tested using a wildcard
> > match (a la :matches).
> 
> We haven't seen the facility for using wildcards on header names, so
> I'm not sure we need it for parameter names either as I think the two
> concepts are very similair...

I've actually had people ask for that- and have had occasion to
wish for it myself.  

mm



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HLlwfm048636; Wed, 17 Mar 2004 13:47:58 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2HLlwQ0048634; Wed, 17 Mar 2004 13:47:58 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from vementry.enterprise.ucs.ed.ac.uk (vementry.enterprise.ucs.ed.ac.uk [129.215.200.96]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HLlvdw048626 for <ietf-mta-filters@imc.org>; Wed, 17 Mar 2004 13:47:57 -0800 (PST) (envelope-from Nigel@swinson.com)
Received: from nigelhome (unverified [82.41.75.235]) by vementry.enterprise.ucs.ed.ac.uk (Rockliffe SMTPRA 6.0.9) with ESMTP id <B0000005254@vementry.enterprise.ucs.ed.ac.uk>; Wed, 17 Mar 2004 21:47:58 +0000
Message-ID: <001301c40c6a$764d2350$6401a8c0@nigelhome>
From: "Nigel Swinson" <Nigel@swinson.com>
To: "Mark E. Mallett" <mem@mv.mv.com>
Cc: "Cyrus Daboo" <daboo@cyrusoft.com>, "IETF MTA Filters List" <ietf-mta-filters@imc.org>
References: <104800.1076013775@ninevah.cyrusoft.com> <01L7HAGIBZLW0027NR@mauve.mrochek.com> <187472.1079362776@ninevah.cyrusoft.com> <016601c40aeb$17faa0f0$6401a8c0@nigelhome> <20040317194840.GA13423@iridium.mv.net>
Subject: Re: Comments on draft-daboo-sieve-mime-00.txt
Date: Wed, 17 Mar 2004 21:54:45 -0000
MIME-Version: 1.0
Content-Type: text/plain; charset="iso-8859-1"
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Content-Transfer-Encoding: 8bit
X-MIME-Autoconverted: from quoted-printable to 8bit by above.proper.com id i2HLlwdw048629
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> This all mostly sounds very good.  Some random reflections:

Thanks Mark :o)

> I too think that ":value" is not the best choice, for various reasons,
> some of which have been already stated.  

To be honest I'm not a fan of :value either, so am more than happy for an alternative.

> ":type" probably works for
> the mime headers but might not be as meaningful if this is later used
> to apply to other headers of similar form.  What there really are are
> fixed parts and variable keyword=value parts.  This doesn't really
> inspire any other good names, though.

I don't mind :type but I'm wondering if :noparameters is best, as this pairs neatly with :parameters <string-list>?  

> >     if header :bodyparts :contains "Content-Type" "text/html"
> 
> Do you intend :bodyparts to select the mime parts in the message body,
> or in the entire message (i.e., does it include or exclude the message
> header?)  My preference would be the body only, so that one can have
> the most flexibility.

I had intended it to be the entire message, but not out of strong desire.  I guess if I was writing a test, I would care less about where in the email message the entity of interest was and more about it's prescense.  With our header test we aren't told about where in the headers the header is, and if you have a multipart/alternative structure or multipart/mixed then I'm not sure there is a logical distinction in the order.  So I think to neatly be able to say "is there any text/html body part in this email" is more useful than saying "is there a text/html body part in one of the child body parts?"

Were we to really need to know if the text/html body part was not the "root" body part, then we could use an allof test:

if allof (header :bodyparts :noparameters :contains "Content" "text/html",
          not header :noparameters :contains "Content" "text/html")

> > Then if we combine this with allof(), we could further define that
> > multiple tests within an allof() must apply to the same body part.  So
> > if we say:
> > 
> >     if allof :bodyparts (header :value :contains "Content-Type" "image/jpeg",
> >                                   size :over 100K)
> 
> Syntactically this is interesting, although as I've said before I think
> a full-fledged notion of "views" would be more so (but obviously that's a
> whole nother track).  I wonder how various implementors feel about
> connecting "allof" with its contained tests in this way -- especially
> if they are allowed to nest.

Originally I thought we should have a concept of "selection" of a body part and then be able to perform tests on it.  Couldn't get anywhere with the idea though, as I just thought it would end up in a hell of indexes into arrays of body parts, and also how would you "select" a body part?

> > > 6) Test for text in any parameter values only in a specific MIME header
> > > 
> > >     if (mimeheader :name "Content-Disposition" :parameter-value :contains 
> > > ".exe")
> > 
> > if header :bodyparts :anyparameter :contains "Content-Disposition" ".exe"
> 
> Rather than introduce another keyword, I'd suggest using a special
> parameter value string to match any actual parameter.  e.g.:
> 
>     if header :bodyparts :parameter "" :contains "Content-Disposition" ".exe"
> or
>     if header :bodyparts :parameter "*" :contains "Content-Disposition" ".exe"

Good ideas :o)  As I said, I'm not sure a concept of "anyparameter" or "anyheader" is particularly core to this extension so would think we'd have to justify it's usefulness before deciding to add it to the extension.  Certainly anyheader probably shouldn't be in a mime extension, but anyparameter might be.
 
> Perhaps even say that the ":parameter" value is tested using a wildcard
> match (a la :matches).

We haven't seen the facility for using wildcards on header names, so I'm not sure we need it for parameter names either as I think the two concepts are very similair...

Nigel



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HKqcAv039809; Wed, 17 Mar 2004 12:52:38 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2HKqc8s039808; Wed, 17 Mar 2004 12:52:38 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40]) by above.proper.com (8.12.11/8.12.8) with SMTP id i2HKqbr1039801 for <ietf-mta-filters@mail.imc.org>; Wed, 17 Mar 2004 12:52:37 -0800 (PST) (envelope-from mem@mv.mv.com)
Received: (qmail 7529 invoked from network); 17 Mar 2004 15:52:29 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17) by mercury.mv.net with SMTP; 17 Mar 2004 15:52:41 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40 local-name mercury.mv.net
Received: (qmail 10917 invoked by uid 101); 17 Mar 2004 15:52:29 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Wed, 17 Mar 2004 15:52:28 -0500
To: Cyrus Daboo <daboo@cyrusoft.com>
Cc: Michael Haardt <michael@freenet-ag.de>, ietf-mta-filters@mail.imc.org
Subject: Re: Expiring/deleting old mail
Message-ID: <20040317205228.GG13423@iridium.mv.net>
References: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de> <243567.1079439063@ninevah.cyrusoft.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <243567.1079439063@ninevah.cyrusoft.com>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Tue, Mar 16, 2004 at 12:11:03PM -0500, Cyrus Daboo wrote:
> Hi Michael,
> 
> --On Tuesday, March 16, 2004 2:22 PM +0100 Michael Haardt 
> <michael@freenet-ag.de> wrote:
> 
> | Some mail systems allow the concept of "rolling/automatically expiring"
> | mailboxes/folders which automatically remove old mail, which is useful
> | for mailing lists and junk mail folders.  It is important that this
> | function is not performed by the client, because clients usually don't
> | clean up during vacation.
> |
> | For that reason, I suggest a Sieve extension, which allows the mail
> | system to remove mail.  There are several ways to address the problem:
> 
> I'm afraid I still think expiration like this belongs in the mailstore not 
> the delivery agent.

Unfortunately I can see both perspectives :-)

I do understand yours, or at least I think I do.  You want to have
mailstore attributes that control this particular combination of mail
folder operations.

The other one is that the agent acts just like I do, only I'm not
sitting at the keyboard.  I can sit down at my computer and access a
folder and make sure I have less than 100 messages in it when I
leave.  I do this using existing primitive access functions.
Similarly, I could tell my sieve-enabled LDA to follow this same
methodology.  The issue of "what if some other access access doesn't
do this" is a red herring.  I can manually open up the folder using a
mail client and treat the folder in a different way... so?  It's the
same thing: it's me doing the access whether I've told an agent to do
it, whether I access using my keyboard, or whether I told another
agent to do something else.  If I do conflicting things it's my
choice, and it may or may not be an error.  I don't think I need an
IMAP extension to allow primitive operations to be combined in these
ways.

Personally I wouldn't want to use a system that required me to
configure my folders for each kind of access I wanted to do, or each
way that I wanted to use them.  Nor would I want to use mail folders
that had side-effects when I accessed them.  I can respect that others
might want this, though-- it's just not my mindset.

I can also respect an opinion that SIEVE only operates on a single
message, and yeah, I see that point.  But if SIEVE is the filtering
language in my LDA of choice (and it is), and I would like to have
some interaction with an existing mailstore (and I do), some level of
access to an existing store is not really out of place.

Anyway, I'm not trying to repeat myself here, just providing what
I hope is a little more light.  I doubt anyone who has the other
perspective will be convinced, though.

Yours,
-mm-



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HJmhB1029996; Wed, 17 Mar 2004 11:48:43 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2HJmh35029995; Wed, 17 Mar 2004 11:48:43 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40]) by above.proper.com (8.12.11/8.12.8) with SMTP id i2HJmgrT029989 for <ietf-mta-filters@imc.org>; Wed, 17 Mar 2004 11:48:42 -0800 (PST) (envelope-from mem@mv.mv.com)
Received: (qmail 21553 invoked from network); 17 Mar 2004 14:48:41 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17) by mercury.mv.net with SMTP; 17 Mar 2004 14:48:44 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40 local-name mercury.mv.net
Received: (qmail 8887 invoked by uid 101); 17 Mar 2004 14:48:40 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Wed, 17 Mar 2004 14:48:40 -0500
To: Nigel Swinson <Nigel.Swinson@rockliffe.com>
Cc: Cyrus Daboo <daboo@cyrusoft.com>, IETF MTA Filters List <ietf-mta-filters@imc.org>
Subject: Re: Comments on draft-daboo-sieve-mime-00.txt
Message-ID: <20040317194840.GA13423@iridium.mv.net>
References: <104800.1076013775@ninevah.cyrusoft.com> <01L7HAGIBZLW0027NR@mauve.mrochek.com> <187472.1079362776@ninevah.cyrusoft.com> <016601c40aeb$17faa0f0$6401a8c0@nigelhome>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <016601c40aeb$17faa0f0$6401a8c0@nigelhome>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Tue, Mar 16, 2004 at 12:10:30AM -0000, Nigel Swinson wrote:

   [ alternative mime tests description ]

This all mostly sounds very good.  Some random reflections:


> If we think :value is too confusing for the "header value when with
> parameters" compared to the "whole header value", then perhaps we
> could use :valueonly, :noparameters or :mimevalue or something else?
> Maybe the prefix could be like a "namespace" defining the header
> parsing algorithm to use, and if we have other headers that have a
> common structure, we could define other namespaces that detail the
> header parsing method to use.

I too think that ":value" is not the best choice, for various reasons,
some of which have been already stated.  ":type" probably works for
the mime headers but might not be as meaningful if this is later used
to apply to other headers of similar form.  What there really are are
fixed parts and variable keyword=value parts.  This doesn't really
inspire any other good names, though.



> The above would test only in the "active body part" which is the top
> level body part, which is the email headers, which is what we've all
> been dealing with already.  It would NOT recursively look for headers
> in all child body parts.
   ...
> The second significant half of MIME permits us to recursively define
> body parts, which each have a set of headers, and content.  So any
> solution that we have needs to cope with the potential recursive
> nature of the MIME structure.  So what if we define a new tagged
> argument for use with all of our existing tests that specifies that we
> should recursively look in the body parts too?  Call it :bodyparts.
> So this means that if I write a test that says:
> 
>     if header :contains "Content-Type" "text/html"
> 
> Then this would only match if the message contains a single body part
> that is text/html.  However if I write the following, then this would
> match if there is ANY text/html body part anywhere in the legal MIME
> structure of the message:
> 
>     if header :bodyparts :contains "Content-Type" "text/html"

Do you intend :bodyparts to select the mime parts in the message body,
or in the entire message (i.e., does it include or exclude the message
header?)  My preference would be the body only, so that one can have
the most flexibility.


> Then if we combine this with allof(), we could further define that
> multiple tests within an allof() must apply to the same body part.  So
> if we say:
> 
>     if allof :bodyparts (header :value :contains "Content-Type" "image/jpeg",
>                                   size :over 100K)

Syntactically this is interesting, although as I've said before I think
a full-fledged notion of "views" would be more so (but obviously that's a
whole nother track).  I wonder how various implementors feel about
connecting "allof" with its contained tests in this way -- especially
if they are allowed to nest.


> > 6) Test for text in any parameter values only in a specific MIME header
> > 
> >     if (mimeheader :name "Content-Disposition" :parameter-value :contains 
> > ".exe")
> 
> if header :bodyparts :anyparameter :contains "Content-Disposition" ".exe"

Rather than introduce another keyword, I'd suggest using a special
parameter value string to match any actual parameter.  e.g.:

    if header :bodyparts :parameter "" :contains "Content-Disposition" ".exe"
or
    if header :bodyparts :parameter "*" :contains "Content-Disposition" ".exe"

Perhaps even say that the ":parameter" value is tested using a wildcard
match (a la :matches).



> What do you think?

Very nice..

mm



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HFc8bj011246; Wed, 17 Mar 2004 07:38:08 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2HFc8Xp011245; Wed, 17 Mar 2004 07:38:08 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from winserver.com (mail.winserver.com [208.247.131.9]) by above.proper.com (8.12.11/8.12.8) with SMTP id i2HFc7oH011236 for <ietf-mta-filters@mail.imc.org>; Wed, 17 Mar 2004 07:38:07 -0800 (PST) (envelope-from winserver.support@winserver.com)
Received: by winserver.com (Wildcat! SMTP Router v5.7.450.9b13) for ietf-mta-filters@mail.imc.org; Wed, 17 Mar 2004 10:40:05 -0500
Received: from  ([68.211.139.123]) EHLO=hdev1 by winserver.com (Wildcat! SMTP v5.7.450.9b13) with SMTP id 3990575500; Wed, 17 Mar 2004 10:40:04 -0500
Message-ID: <007d01c40c35$fc062e40$6401a8c0@hdev1>
From: "Hector Santos" <winserver.support@winserver.com>
To: <ietf-mta-filters@mail.imc.org>, "Michael Haardt" <michael@freenet-ag.de>
References: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
Subject: Re: Expiring/deleting old mail
Date: Wed, 17 Mar 2004 10:38:03 -0500
Organization: Santronics Software, Inc
MIME-Version: 1.0
Content-Type: text/plain; charset="Windows-1252"
Content-Transfer-Encoding: 7bit
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

Maybe these can offer some insight. These are our mail server mail policy
attributes (per conference AKA folder).  Our mail server automatically
maintains the mail once per day between 1am and 5am (adjustable).

o Maximum Messages:
o Message Number to Trigger Renumber:
o Days to Keep Read Private Mail:
o Days to Keep Unread Private or Public Mail:
o Days to keep external user mail : (outgoing mail created by your users).
o Delete external user mail once delivered by SMTP:

Other folder/user profile group based options  that can have an effect on
the mail tracking/maintance.

o Allow Mail Previewing (Non-POP3 devices)
o Mark downloaded (POP3) Mail as Received:  Yes/No

In general, users have no say in our product mail policy design.  POP3/WEB
mail access has changed that over the years with users now having some
"leave on server" options in their MUA to help them with roaming.   However,
tracking, mail maintenance, mail receipt request, etc (Subscribers can't
claim they didn't get an expiration notice) is still important so our design
compromise was to have two Receive bits. One that is always recorded for
internal purposes and one that is used for the user.  This allows them to
Preview mail on lets say the Web without marking it read, and then via MUA
download the mail with direct mail
pointers retrieving the "unread user mail."    Same idea with the MUA
(POP3), option to not mark receive allows them to roam to around to other
machines.   However, the internal received bit still prevails for the normal
mail packing/maintenance options (Days to Key UnRead/Read Private Mail
options).   Users have no say on how long mail stays in storage, unless of
course, it is shorter than the server limits, in which case,  the MUA can
delete the message.

I guess my point with the note, that whole concept present a very difficult
PR/system policy issue where MUA clients were demanding new behaviors
conflict with some of the product's traditional strong mail security,
tracking and maintenance policies.  The #1 being subscription notices could
not be bypass with user's previews or non-marking downloads, and the 2nd was
the increase mail storage requirements in large systems because the triggers
were being bypassed.

Hope this provide some engineering insights.

-- 
Hector Santos, Santronics Software, Inc.
http://www.santronics.com







----- Original Message ----- 
From: "Michael Haardt" <michael@freenet-ag.de>
To: <ietf-mta-filters@mail.imc.org>
Sent: Tuesday, March 16, 2004 8:22 AM
Subject: Expiring/deleting old mail


>
> Hello,
>
> let me summarise the recent discussion.  I hope this reflects most
> views expressed on the topic:
>
> Some mail systems allow the concept of "rolling/automatically expiring"
> mailboxes/folders which automatically remove old mail, which is useful
> for mailing lists and junk mail folders.  It is important that this
> function is not performed by the client, because clients usually don't
> clean up during vacation.
>
> For that reason, I suggest a Sieve extension, which allows the mail
> system to remove mail.  There are several ways to address the problem:
>
> Folder Attributes
>
> Sieve focuses on message delivery, so using sieve to control folder
> attributes would be using it for a purpose it was not intended for.
>
> Message Attributes
>
> This fits well into Sieve, it allows the richest set of features, but
> message expiration attributes are also the most complicated approach.
> Further, users might expect expiration dates to be met exactly and
> not be pleased about lazy expiration, adding further complexity for
> the implementation.  IMAP ANNOTATE may be the way to go for message
> attributes.
>
> Message removal at delivery
>
> This approach is easy to understand for users and easy to implement: It
> keeps removing mail, starting from the oldest, until the given criteria
> are matched.  It could be realised by adding an option to "fileinto"
> and probably "keep":
>
>   fileinto :max-days 7 "inbox.mailinglist";
>   fileinto :max-messages 100 "inbox.mailinglist";
>   fileinto :max-storage 1M "inbox.mailinglist";
>
> It is still open how the last action should behave when delivering
> a 2M message.  Perhaps there is a better name instead of "max-".
> This mechanism should not be called expiration, because people expect
> a different behaviour by that name.
>
> Michael
>
>




Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEr72J008499; Wed, 17 Mar 2004 06:53:07 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2HEr7NK008498; Wed, 17 Mar 2004 06:53:07 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEr691008492 for <ietf-mta-filters@mail.imc.org>; Wed, 17 Mar 2004 06:53:06 -0800 (PST) (envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8]) (user=rjs3 mech=GSSAPI (0 bits)) by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2HEr5kw029315; Wed, 17 Mar 2004 09:53:05 -0500
Date: Wed, 17 Mar 2004 09:53:06 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: ned.freed@mrochek.com
cc: Michael Haardt <michael@freenet-ag.de>, ietf-mta-filters@mail.imc.org
Subject: Re: Expiring/deleting old mail
In-Reply-To: <01L7TP54JFQS0027NR@mauve.mrochek.com>
Message-ID: <Pine.LNX.4.58-035.0403170952380.30170@sourcefour.andrew.cmu.edu>
References: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de> <01L7SX7NE6EA0027NR@mauve.mrochek.com> <Pine.LNX.4.58-035.0403170916061.30170@sourcefour.andrew.cmu.edu> <01L7TP54JFQS0027NR@mauve.mrochek.com>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Wed, 17 Mar 2004 ned.freed@mrochek.com wrote:

> > Though I also agree that the sanest way to do this is just with a
> > folder-wide attribute in IMAP, and leave sieve out of it.
>
> In other words, there are two fairly different models for how to handle
> expirations in a message store, and we need to pick the one that makes the most
> sense. Doesn't this sound like something store implementors might want to have
> a wee bit of say in?

Yes -- I agree that sieve is not the place to do this.  Certainly not at
first, anyway.

-Rob


-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEoiu9008429; Wed, 17 Mar 2004 06:50:44 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2HEoiCf008428; Wed, 17 Mar 2004 06:50:44 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEoiMN008422 for <ietf-mta-filters@mail.imc.org>; Wed, 17 Mar 2004 06:50:44 -0800 (PST) (envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01L7S9K1QH400027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org; Wed, 17 Mar 2004 06:50:44 -0800 (PST)
Date: Wed, 17 Mar 2004 06:48:16 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Expiring/deleting old mail
In-reply-to: "Your message dated Wed, 17 Mar 2004 09:17:52 -0500 (EST)" <Pine.LNX.4.58-035.0403170916061.30170@sourcefour.andrew.cmu.edu>
To: Rob Siemborski <rjs3@andrew.cmu.edu>
Cc: ned.freed@mrochek.com, Michael Haardt <michael@freenet-ag.de>, ietf-mta-filters@mail.imc.org
Message-id: <01L7TP54JFQS0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii
Content-transfer-encoding: 7BIT
References: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de> <01L7SX7NE6EA0027NR@mauve.mrochek.com> <Pine.LNX.4.58-035.0403170916061.30170@sourcefour.andrew.cmu.edu>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> On Tue, 16 Mar 2004 ned.freed@mrochek.com wrote:

> > I'm sorry, but these are simply folder-level attributes crammed in at the
> > message level because that's the mechanism sieve provides. But calling them
> > message atributes doesn't change their nature.

> I agree on the last one -- but message annotations can also be "this
> message expires on date xyz" which is not necessaraly related to when the
> next message in the mailbox expires.

Of course they can, but this is just the per-message way of doing it,
rather than the per-folder way.

> Though I also agree that the sanest way to do this is just with a
> folder-wide attribute in IMAP, and leave sieve out of it.

In other words, there are two fairly different models for how to handle
expirations in a message store, and we need to pick the one that makes the most
sense. Doesn't this sound like something store implementors might want to have
a wee bit of say in?

				Ned



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEJKvV006584; Wed, 17 Mar 2004 06:19:20 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2HEJK4I006583; Wed, 17 Mar 2004 06:19:20 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEJJp5006577 for <ietf-mta-filters@mail.imc.org>; Wed, 17 Mar 2004 06:19:19 -0800 (PST) (envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8]) (user=rjs3 mech=GSSAPI (0 bits)) by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2HEJIkw029238; Wed, 17 Mar 2004 09:19:18 -0500
Date: Wed, 17 Mar 2004 09:19:19 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: Michael Haardt <michael@freenet-ag.de>
cc: ietf-mta-filters@mail.imc.org
Subject: Re: Expiring/deleting old mail
In-Reply-To: <E1B3YxC-00062d-RI@nostromo.freenet-ag.de>
Message-ID: <Pine.LNX.4.58-035.0403170918510.30170@sourcefour.andrew.cmu.edu>
References: <E1B3YxC-00062d-RI@nostromo.freenet-ag.de>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Wed, 17 Mar 2004, Michael Haardt wrote:

> That makes sense for folder or message attributes.  I don't want
> any attributes, because I do not like their overhead.  To answer the
> previous asked question of conflicting actions: There are no conflicts.
> "max-days 7" followed by a "max-days 6" leaves the last six days mail
> in the folder.

This seems like a very fast way for script authors to shoot themselves in
the foot.

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEHsqA006520; Wed, 17 Mar 2004 06:17:54 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2HEHsUi006519; Wed, 17 Mar 2004 06:17:54 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HEHrqG006513 for <ietf-mta-filters@mail.imc.org>; Wed, 17 Mar 2004 06:17:53 -0800 (PST) (envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8]) (user=rjs3 mech=GSSAPI (0 bits)) by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2HEHpkw029231; Wed, 17 Mar 2004 09:17:51 -0500
Date: Wed, 17 Mar 2004 09:17:52 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: ned.freed@mrochek.com
cc: Michael Haardt <michael@freenet-ag.de>, ietf-mta-filters@mail.imc.org
Subject: Re: Expiring/deleting old mail
In-Reply-To: <01L7SX7NE6EA0027NR@mauve.mrochek.com>
Message-ID: <Pine.LNX.4.58-035.0403170916061.30170@sourcefour.andrew.cmu.edu>
References: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de> <01L7SX7NE6EA0027NR@mauve.mrochek.com>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Tue, 16 Mar 2004 ned.freed@mrochek.com wrote:

> I'm sorry, but these are simply folder-level attributes crammed in at the
> message level because that's the mechanism sieve provides. But calling them
> message atributes doesn't change their nature.

I agree on the last one -- but message annotations can also be "this
message expires on date xyz" which is not necessaraly related to when the
next message in the mailbox expires.

Though I also agree that the sanest way to do this is just with a
folder-wide attribute in IMAP, and leave sieve out of it.

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HBBKJx091484; Wed, 17 Mar 2004 03:11:20 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2HBBKm0091483; Wed, 17 Mar 2004 03:11:20 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mout2.freenet.de (mout2.freenet.de [194.97.50.155]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2HBBJcp091475 for <ietf-mta-filters@mail.imc.org>; Wed, 17 Mar 2004 03:11:19 -0800 (PST) (envelope-from michael@freenet-ag.de)
Received: from [194.97.50.138] (helo=mx0.freenet.de) by mout2.freenet.de with asmtp (Exim 4.30) id 1B3YxD-0007DI-Bt for ietf-mta-filters@mail.imc.org; Wed, 17 Mar 2004 12:11:19 +0100
Received: from nostromo.freenet-ag.de ([194.97.7.6]) by mx0.freenet.de with esmtp (TLSv1:AES256-SHA:256) (Exim 4.303 #2) id 1B3YxD-0002Hu-7J for ietf-mta-filters@mail.imc.org; Wed, 17 Mar 2004 12:11:19 +0100
Received: from michael by nostromo.freenet-ag.de with local (ID michael) (Exim 4.303 #3) id 1B3YxC-00062d-RI for ietf-mta-filters@mail.imc.org; Wed, 17 Mar 2004 12:11:18 +0100
To: ietf-mta-filters@mail.imc.org
Subject: Re: Expiring/deleting old mail
Message-Id: <E1B3YxC-00062d-RI@nostromo.freenet-ag.de>
From: Michael Haardt <michael@freenet-ag.de>
Date: Wed, 17 Mar 2004 12:11:18 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> > Message removal at delivery
>
> > This approach is easy to understand for users and easy to implement: It
> > keeps removing mail, starting from the oldest, until the given criteria
> > are matched.  It could be realised by adding an option to "fileinto"
> > and probably "keep":
>
> >   fileinto :max-days 7 "inbox.mailinglist";
> >   fileinto :max-messages 100 "inbox.mailinglist";
> >   fileinto :max-storage 1M "inbox.mailinglist";
>
> > It is still open how the last action should behave when delivering
> > a 2M message.  Perhaps there is a better name instead of "max-".
> > This mechanism should not be called expiration, because people expect
> > a different behaviour by that name.
>
> I'm sorry, but these are simply folder-level attributes crammed in at the
> message level because that's the mechanism sieve provides. But calling them
> message atributes doesn't change their nature.

This last approach does not add message or folder flags in any way.
The previous one did.  This is a modified action, which first cleans up
the folder and then delivers a message to it.

I could imagine to move that functionality into a new action (cleanup?),
but until I see where it could be useful apart from a following fileinto,
I talk about it as fileinto extension.

> I'm opposed to all of these approaches and strongly opposed to the last one. If
> you want to do this, do it right - specify an IMAP extension and then, if it
> makes sense, specify a sieve extension that can be used to control the
> mechanism.

That makes sense for folder or message attributes.  I don't want
any attributes, because I do not like their overhead.  To answer the
previous asked question of conflicting actions: There are no conflicts.
"max-days 7" followed by a "max-days 6" leaves the last six days mail
in the folder.

Michael



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2H3PlDk083736; Tue, 16 Mar 2004 19:25:47 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2H3Pl30083735; Tue, 16 Mar 2004 19:25:47 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2H3Pkne083729 for <ietf-mta-filters@imc.org>; Tue, 16 Mar 2004 19:25:46 -0800 (PST) (envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01L7S9K1QH400027NR@mauve.mrochek.com> for ietf-mta-filters@imc.org; Tue, 16 Mar 2004 19:25:51 -0800 (PST)
Date: Tue, 16 Mar 2004 19:20:26 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Comments on draft-daboo-sieve-mime-00.txt
In-reply-to: "Your message dated Mon, 15 Mar 2004 14:59:36 -0500" <187472.1079362776@ninevah.cyrusoft.com>
To: Cyrus Daboo <daboo@cyrusoft.com>
Cc: ned.freed@mrochek.com, IETF MTA Filters List <ietf-mta-filters@imc.org>
Message-id: <01L7T180GS8E0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii; format=flowed
Content-transfer-encoding: 7BIT
References: <104800.1076013775@ninevah.cyrusoft.com> <01L7HAGIBZLW0027NR@mauve.mrochek.com> <187472.1079362776@ninevah.cyrusoft.com>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> Hi Ned,
> Thanks for your comments:

> --On Monday, March 8, 2004 9:22 AM -0800 ned.freed@mrochek.com wrote:

> | Having said that, I think the specifics of how this was done aren't
> | right. First, as presently written this specification only extends the
> | header test, and it does so by creating an entirely new test. But there
> | are two other tests that are equally applicable to inner headers: exists
> | and address. Either similar "mimeexists" and "mimeaddress" tests need to
> | be added (and perhaps "mime" changed to "mimeheader"), or this needs to
> | be done within the existing tests by adding a :mime parameter. I'm
> | indifferent as to which one of these approaches is chosen, but we do need
> | one of them.
> |
> | Second, I really don't like the use of an optional middle parameter to
> | specify that the test is to be performed on a parameter value. This sort
> | of thing is why we have labelled parameters: It should be done as
> | :parameter or something similar. As for the use of a null parameter-names
> | value to indicate a test of non-paramer material, this can done with
> | :parameter as well, but I do worry that this is a bit tricky. OTOH, I
> | haven't been able to come up with a differenent way to do it that I like
> | better.

> OK - here is another solution to the syntax. What I'm proposing is a
> mimeheader test that takes the following parameters:

> :name - the name of a specific MIME header to test (can be a list of names)
> :parameter-name - the name of a specific parameter name to test (can be a
> list)

> :exists - test the existence of the specified items

> :text - do comparisons against the content of the entire MIME header
> selected
> :value - do comparisons against the value of the MIME header, excluding
> parameters
> :parameter-value - do comparisons on parameter values only

I really don't care for this at all. Like it or not, sieve opted to define
three tests that act on headers: header/exists/address. Unless there is a very
compelling reason to alter this model - and I've seen no evidence that there is
such a reason - I think we should stick with it. And this argues for either of
the proposals I made previously: mimeheader/mimeexists/mimeaddress or an
additional parameter on the existing tests. NIgel has expressed a preference
for the latter, but I'm happy with either.

Think of it this way: Changing an existing script that employs tests on
the outer header to one that tests all headers in the MIME structure
shouldn't require switching to a completely different sort of test.
A simple addition should be sufficient, and whether that addition is
a test name prefix or a new parameter makes no difference to me.

				Ned



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2H3JpEU082673; Tue, 16 Mar 2004 19:19:51 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2H3JpKv082672; Tue, 16 Mar 2004 19:19:51 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2H3Jopj082659 for <ietf-mta-filters@imc.org>; Tue, 16 Mar 2004 19:19:51 -0800 (PST) (envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01L7S9K1QH400027NR@mauve.mrochek.com> for ietf-mta-filters@imc.org; Tue, 16 Mar 2004 19:19:54 -0800 (PST)
Date: Tue, 16 Mar 2004 18:34:42 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Comments on draft-daboo-sieve-mime-00.txt
In-reply-to: "Your message dated Tue, 16 Mar 2004 00:10:30 +0000" <016601c40aeb$17faa0f0$6401a8c0@nigelhome>
To: Nigel Swinson <Nigel.Swinson@rockliffe.com>
Cc: Cyrus Daboo <daboo@cyrusoft.com>, IETF MTA Filters List <ietf-mta-filters@imc.org>
Message-id: <01L7T10MCTYK0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; charset=iso-8859-1
Content-transfer-encoding: 7BIT
References: <104800.1076013775@ninevah.cyrusoft.com> <01L7HAGIBZLW0027NR@mauve.mrochek.com> <187472.1079362776@ninevah.cyrusoft.com> <016601c40aeb$17faa0f0$6401a8c0@nigelhome>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> I've spent quite a lot of time thinking about this particular extension too
> and can't wait to implement it, but have never really felt comfortable with a
> set of syntax, and don't feel comfortable with any of the proposals so far; so
> here's another to throw into the pool for thought:

I like this proposal. But this is hardly surprising, since it differs only
slightly from some of the alternatives I proposed.

> I think MIME consists of two significant parts here; there's a set of new
> headers, and then there's the facility for multiple body parts.  Looking at the
> list of new headers, most of them seem to fit neatly into our existing tests
> (Mime-Version, Content-Id, etc), however the only one that has additional
> significant structure is the Content-Type header, which is defined as:

>      content := "Content-Type" ":" type "/" subtype
>                 *(";" parameter)
>                 ; Matching of media type and subtype
>                 ; is ALWAYS case-insensitive.

> Then looking more generically we've also got:

>      disposition := "Content-Disposition" ":"
>                     disposition-type
>                     *(";" disposition-parm)

> And there's probably others.  So we have this syntax.

>      mime-header := header-name ":"
>                     header-value
>                     *(";" param-name "=" param-value)

> So lets provide a tagged argument to the header, exists, address tests that
> parses out this structure and allows us to select exactly which bits we want
> to test against:

I think this particular extension only belongs on header.

>    Syntax:   header [HEADER-PART] [COMPARATOR] [MATCH-TYPE]
>              <header-names: string-list> <key-list: string-list>

>     HEADER-PART: ":value" / ":parameter" <param-names: string-list>

:parameter is fine but there's a problem with :value - it is already
defined in a different way by RFC 3431. How about :type instead?

> - If we specify ":value" as the optional header-part parameter, then the test
> only operates on the header-value.

> - If we specify the :parameter optional header-part parameter, then the
> string list describes the list of parameter values that we should search in.

Both of these sound good.

> - If neither optional parameter is specified, the header test operates on the
> entire header value as normal.

Has to be this way for backwards compatibility.

> - Other HEADER-PARTS could be defined in the future if we have other headers
> with a different defined structure.

Right, but it also seems reasonable that if future attr=value sorts of headers
are defined it will be done with a similar syntax to the ones that already
exist and that the same tests can be brought to bear on them.

> If we think :value is too confusing for the "header value when with
> parameters" compared to the "whole header value", then perhaps we could use
> :valueonly, :noparameters or :mimevalue or something else?

I like :type. It matches up well with "type of disposition" and "media type".

> Maybe the prefix
> could be like a "namespace" defining the header parsing algorithm to use, and
> if we have other headers that have a common structure, we could define other
> namespaces that detail the header parsing method to use.

I think this probably goes too far.

> The above would test only in the "active body part" which is the top level
> body part, which is the email headers, which is what we've all been dealing
> with already.  It would NOT recursively look for headers in all child body
> parts.  That would be done with the second half of my proposal.  Where a server
> doesn't have a mime parser, or was worried about the extra overhead of parsing
> the mime structure, it wouldn't support this second part, but could still
> support Header-Parts.

The notion of two separate extension is interesting. I personally have no need
to make the distinction, but I have no problem with the split if others
think it is useful.

> The second significant half of MIME permits us to recursively define body
> parts, which each have a set of headers, and content.  So any solution that we
> have needs to cope with the potential recursive nature of the MIME structure. 
> So what if we define a new tagged argument for use with all of our existing
> tests that specifies that we should recursively look in the body parts too? 
> Call it :bodyparts.  So this means that if I write a test that says:

>     if header :contains "Content-Type" "text/html"

> Then this would only match if the message contains a single body part that is
> text/html.  However if I write the following, then this would match if there is
> ANY text/html body part anywhere in the legal MIME structure of the message:

>     if header :bodyparts :contains "Content-Type" "text/html"

Modulo the name of the parameter (which I don't particularly care about)
this is one of the alternatives I proposed.

> With our new mimeheader test this would become more correctly:

>     if header :bodyparts :value :contains "Content-Type" "text/html"

> Then if we combine this with allof(), we could further define that multiple tests within an allof() must apply to the same body part.  So if we say:

>     if allof :bodyparts (header :value :contains "Content-Type" "image/jpeg",
>                                   size :over 100K)

> Then this would catch all messages that contain a image/jpeg body part that is over 100K.  However if we say the following, then this would catch any message that contained a body part that was image/jpeg and a body part (potentially different) which was over 100K in size.:

>     if allof (header :bodyparts :value :contains "Content-Type" "image/jpeg",
>                 size :bodyparts :over 100K)

> This then very neatly fits with the body extention, and we get a test like this which would test for all messages that contain a text body part that contains the word "Spam":

>     if allof :bodyparts (header :value :contains "Content-Type" "text",
>                                   body :contains "Spam")

> For more examples, I'll go through Cyrus examples and show how they would
> look for this proposal.  However before I do, I note that many look for an "in
> any header value" or an "in any parameter value" concept.  We currently haven't
> found a need for these, and I'm not sure we need them.  If we do, then I'd
> propose we have new tests like "anyheader", "anyexists" and a new header-part
> of ":anyparameter".

This all sounds reasonable, but as you say, let's wait for the demand before
we add it.

				Ned



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2H1UvHL076927; Tue, 16 Mar 2004 17:30:57 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2H1UvxG076926; Tue, 16 Mar 2004 17:30:57 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2H1Uul0076920 for <ietf-mta-filters@mail.imc.org>; Tue, 16 Mar 2004 17:30:56 -0800 (PST) (envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01L7S9K1QH400027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org; Tue, 16 Mar 2004 17:31:02 -0800 (PST)
Date: Tue, 16 Mar 2004 17:12:04 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Expiring/deleting old mail
In-reply-to: "Your message dated Tue, 16 Mar 2004 14:22:36 +0100" <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
To: Michael Haardt <michael@freenet-ag.de>
Cc: ietf-mta-filters@mail.imc.org
Message-id: <01L7SX7NE6EA0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii
Content-transfer-encoding: 7BIT
References: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> Hello,

> let me summarise the recent discussion.  I hope this reflects most
> views expressed on the topic:

> Some mail systems allow the concept of "rolling/automatically expiring"
> mailboxes/folders which automatically remove old mail, which is useful
> for mailing lists and junk mail folders.  It is important that this
> function is not performed by the client, because clients usually don't
> clean up during vacation.

> For that reason, I suggest a Sieve extension, which allows the mail
> system to remove mail.  There are several ways to address the problem:

Including nailing down the semantics of this as an IMAP extension first,
and once that's done worrying the sieve issues if appropriate.

Note that semantics specified as part of an IMAP extension can be used outside
of IMAP.

> Folder Attributes

> Sieve focuses on message delivery, so using sieve to control folder
> attributes would be using it for a purpose it was not intended for.

> Message Attributes

> This fits well into Sieve, it allows the richest set of features, but
> message expiration attributes are also the most complicated approach.
> Further, users might expect expiration dates to be met exactly and
> not be pleased about lazy expiration, adding further complexity for
> the implementation.  IMAP ANNOTATE may be the way to go for message
> attributes.

> Message removal at delivery

> This approach is easy to understand for users and easy to implement: It
> keeps removing mail, starting from the oldest, until the given criteria
> are matched.  It could be realised by adding an option to "fileinto"
> and probably "keep":

>   fileinto :max-days 7 "inbox.mailinglist";
>   fileinto :max-messages 100 "inbox.mailinglist";
>   fileinto :max-storage 1M "inbox.mailinglist";

> It is still open how the last action should behave when delivering
> a 2M message.  Perhaps there is a better name instead of "max-".
> This mechanism should not be called expiration, because people expect
> a different behaviour by that name.

I'm sorry, but these are simply folder-level attributes crammed in at the
message level because that's the mechanism sieve provides. But calling them
message atributes doesn't change their nature.

I'm opposed to all of these approaches and strongly opposed to the last one. If
you want to do this, do it right - specify an IMAP extension and then, if it
makes sense, specify a sieve extension that can be used to control the
mechanism.

				Ned



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2GHB5a1045429; Tue, 16 Mar 2004 09:11:05 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2GHB5Z0045428; Tue, 16 Mar 2004 09:11:05 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from darius.cyrusoft.com (darius.cyrusoft.com [63.163.82.2]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2GHB4j8045422 for <ietf-mta-filters@mail.imc.org>; Tue, 16 Mar 2004 09:11:05 -0800 (PST) (envelope-from daboo@cyrusoft.com)
Received: from ninevah.cyrusoft.com (ninevah.cyrusoft.com [63.163.82.9]) (authenticated bits=0) by darius.cyrusoft.com (8.12.9/8.12.9) with ESMTP id i2GH4ek3016492 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 16 Mar 2004 12:04:41 -0500
Date: Tue, 16 Mar 2004 12:11:03 -0500
From: Cyrus Daboo <daboo@cyrusoft.com>
To: Michael Haardt <michael@freenet-ag.de>, ietf-mta-filters@mail.imc.org
Subject: Re: Expiring/deleting old mail
Message-ID: <243567.1079439063@ninevah.cyrusoft.com>
In-Reply-To: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
References:  <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
X-Mailer: Mulberry/3.2.0a1 (Mac OS X)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

Hi Michael,

--On Tuesday, March 16, 2004 2:22 PM +0100 Michael Haardt 
<michael@freenet-ag.de> wrote:

| Some mail systems allow the concept of "rolling/automatically expiring"
| mailboxes/folders which automatically remove old mail, which is useful
| for mailing lists and junk mail folders.  It is important that this
| function is not performed by the client, because clients usually don't
| clean up during vacation.
|
| For that reason, I suggest a Sieve extension, which allows the mail
| system to remove mail.  There are several ways to address the problem:

I'm afraid I still think expiration like this belongs in the mailstore not 
the delivery agent. There are other ways for messages to be delivered into 
mailboxes other than sieve and expiration policy for those is just as 
relevant as it is for mailboxes with sieve delivery occurring. e.g. 
Mailboxes that are targets of IMAP COPY and APPEND commands should be able 
to have expiration behaviour as you describe.

So I think the right approach is to define an IMAP extension for setting 
expiration policies on mailboxes, utilizing ANNOTEMORE for controlling the 
per-mailbox settings. The expiration test/action would be triggered by any 
action that could change the mailbox (COPY, APPEND, SELECT and external 
delivery) or, if a server chooses to implement it, an automated timed 
expiry check at an interval specified by the user or dictated by the system.

Note that one could be quite sophisticated about the expiry checks - e.g. 
IMAP SEARCH criteria could be used in the annotation to specify which 
messages are to be expired - so I could setup criteria to exclude messages 
that have the important (\Flagged) flag set etc.

-- 
Cyrus Daboo



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2GGkBsd043837; Tue, 16 Mar 2004 08:46:11 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2GGkBc0043836; Tue, 16 Mar 2004 08:46:11 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2GGk9eM043828 for <ietf-mta-filters@mail.imc.org>; Tue, 16 Mar 2004 08:46:10 -0800 (PST) (envelope-from rjs3@andrew.cmu.edu)
Received: from GEL-FRAME.andrew.cmu.edu (GEL-FRAME.andrew.cmu.edu [128.2.120.54]) (user=rjs3 mech=GSSAPI (0 bits)) by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2GGk9kw026513; Tue, 16 Mar 2004 11:46:09 -0500
Date: Tue, 16 Mar 2004 11:46:09 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: Michael Haardt <michael@freenet-ag.de>
cc: ietf-mta-filters@mail.imc.org
Subject: Re: Expiring/deleting old mail
In-Reply-To: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
Message-ID: <Pine.LNX.4.58-035.0403161145350.7839@gel-frame.andrew.cmu.edu>
References: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Tue, 16 Mar 2004, Michael Haardt wrote:

>   fileinto :max-days 7 "inbox.mailinglist";
>   fileinto :max-messages 100 "inbox.mailinglist";
>   fileinto :max-storage 1M "inbox.mailinglist";
>
> It is still open how the last action should behave when delivering
> a 2M message.  Perhaps there is a better name instead of "max-".
> This mechanism should not be called expiration, because people expect
> a different behaviour by that name.

I'd say that discussion is also needed about how to treat multiple,
conflicting, fileinto commands.

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2GDMgw5030359; Tue, 16 Mar 2004 05:22:42 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2GDMgc3030358; Tue, 16 Mar 2004 05:22:42 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mout0.freenet.de (exim@mout0.freenet.de [194.97.50.131]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2GDMfKi030348 for <ietf-mta-filters@mail.imc.org>; Tue, 16 Mar 2004 05:22:41 -0800 (PST) (envelope-from michael@freenet-ag.de)
Received: from [194.97.50.138] (helo=mx0.freenet.de) by mout0.freenet.de with asmtp (Exim 4.303) id 1B3EWj-000445-Oa for ietf-mta-filters@mail.imc.org; Tue, 16 Mar 2004 14:22:37 +0100
Received: from nostromo.freenet-ag.de ([194.97.7.6]) by mx0.freenet.de with esmtp (TLSv1:AES256-SHA:256) (Exim 4.303 #2) id 1B3EWj-0000iA-Mp for ietf-mta-filters@mail.imc.org; Tue, 16 Mar 2004 14:22:37 +0100
Received: from michael by nostromo.freenet-ag.de with local (ID michael) (Exim 4.303 #3) id 1B3EWi-0004JS-Oz for ietf-mta-filters@mail.imc.org; Tue, 16 Mar 2004 14:22:36 +0100
To: ietf-mta-filters@mail.imc.org
Subject: Expiring/deleting old mail
Message-Id: <E1B3EWi-0004JS-Oz@nostromo.freenet-ag.de>
From: Michael Haardt <michael@freenet-ag.de>
Date: Tue, 16 Mar 2004 14:22:36 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

Hello,

let me summarise the recent discussion.  I hope this reflects most
views expressed on the topic:

Some mail systems allow the concept of "rolling/automatically expiring"
mailboxes/folders which automatically remove old mail, which is useful
for mailing lists and junk mail folders.  It is important that this
function is not performed by the client, because clients usually don't
clean up during vacation.

For that reason, I suggest a Sieve extension, which allows the mail
system to remove mail.  There are several ways to address the problem:

Folder Attributes

Sieve focuses on message delivery, so using sieve to control folder
attributes would be using it for a purpose it was not intended for.

Message Attributes

This fits well into Sieve, it allows the richest set of features, but
message expiration attributes are also the most complicated approach.
Further, users might expect expiration dates to be met exactly and
not be pleased about lazy expiration, adding further complexity for
the implementation.  IMAP ANNOTATE may be the way to go for message
attributes.

Message removal at delivery

This approach is easy to understand for users and easy to implement: It
keeps removing mail, starting from the oldest, until the given criteria
are matched.  It could be realised by adding an option to "fileinto"
and probably "keep":

  fileinto :max-days 7 "inbox.mailinglist";
  fileinto :max-messages 100 "inbox.mailinglist";
  fileinto :max-storage 1M "inbox.mailinglist";

It is still open how the last action should behave when delivering
a 2M message.  Perhaps there is a better name instead of "max-".
This mechanism should not be called expiration, because people expect
a different behaviour by that name.

Michael



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2G03j1Q006332; Mon, 15 Mar 2004 16:03:45 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2G03jS7006331; Mon, 15 Mar 2004 16:03:45 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from vementry.enterprise.ucs.ed.ac.uk (vementry.enterprise.ucs.ed.ac.uk [129.215.200.96]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2G03hgU006324 for <ietf-mta-filters@imc.org>; Mon, 15 Mar 2004 16:03:44 -0800 (PST) (envelope-from Nigel.Swinson@rockliffe.com)
Received: from nigelhome (unverified [82.41.75.235]) by vementry.enterprise.ucs.ed.ac.uk (Rockliffe SMTPRA 6.0.9) with ESMTP id <B0000005077@vementry.enterprise.ucs.ed.ac.uk>; Tue, 16 Mar 2004 00:03:42 +0000
Message-ID: <016601c40aeb$17faa0f0$6401a8c0@nigelhome>
From: "Nigel Swinson" <Nigel.Swinson@rockliffe.com>
To: "Cyrus Daboo" <daboo@cyrusoft.com>
Cc: "IETF MTA Filters List" <ietf-mta-filters@imc.org>
References: <104800.1076013775@ninevah.cyrusoft.com> <01L7HAGIBZLW0027NR@mauve.mrochek.com> <187472.1079362776@ninevah.cyrusoft.com>
Subject: Re: Comments on draft-daboo-sieve-mime-00.txt
Date: Tue, 16 Mar 2004 00:10:30 -0000
MIME-Version: 1.0
Content-Type: text/plain; charset="iso-8859-1"
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Content-Transfer-Encoding: 8bit
X-MIME-Autoconverted: from quoted-printable to 8bit by above.proper.com id i2G03igU006326
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

I've spent quite a lot of time thinking about this particular extension too and can't wait to implement it, but have never really felt comfortable with a set of syntax, and don't feel comfortable with any of the proposals so far; so here's another to throw into the pool for thought:

I think MIME consists of two significant parts here; there's a set of new headers, and then there's the facility for multiple body parts.  Looking at the list of new headers, most of them seem to fit neatly into our existing tests (Mime-Version, Content-Id, etc), however the only one that has additional significant structure is the Content-Type header, which is defined as:

     content := "Content-Type" ":" type "/" subtype
                *(";" parameter)
                ; Matching of media type and subtype
                ; is ALWAYS case-insensitive.

Then looking more generically we've also got:

     disposition := "Content-Disposition" ":"
                    disposition-type
                    *(";" disposition-parm)

And there's probably others.  So we have this syntax.

     mime-header := header-name ":"
                    header-value
                    *(";" param-name "=" param-value)

So lets provide a tagged argument to the header, exists, address tests that parses out this structure and allows us to select exactly which bits we want to test against:

   Syntax:   header [HEADER-PART] [COMPARATOR] [MATCH-TYPE]
             <header-names: string-list> <key-list: string-list>

    HEADER-PART: ":value" / ":parameter" <param-names: string-list>

- If we specify ":value" as the optional header-part parameter, then the test only operates on the header-value.  
- If we specify the :parameter optional header-part parameter, then the string list describes the list of parameter values that we should search in.  
- If neither optional parameter is specified, the header test operates on the entire header value as normal.
- Other HEADER-PARTS could be defined in the future if we have other headers with a different defined structure.

If we think :value is too confusing for the "header value when with parameters" compared to the "whole header value", then perhaps we could use :valueonly, :noparameters or :mimevalue or something else?  Maybe the prefix could be like a "namespace" defining the header parsing algorithm to use, and if we have other headers that have a common structure, we could define other namespaces that detail the header parsing method to use.


The above would test only in the "active body part" which is the top level body part, which is the email headers, which is what we've all been dealing with already.  It would NOT recursively look for headers in all child body parts.  That would be done with the second half of my proposal.  Where a server doesn't have a mime parser, or was worried about the extra overhead of parsing the mime structure, it wouldn't support this second part, but could still support Header-Parts.

The second significant half of MIME permits us to recursively define body parts, which each have a set of headers, and content.  So any solution that we have needs to cope with the potential recursive nature of the MIME structure.  So what if we define a new tagged argument for use with all of our existing tests that specifies that we should recursively look in the body parts too?  Call it :bodyparts.  So this means that if I write a test that says:

    if header :contains "Content-Type" "text/html"

Then this would only match if the message contains a single body part that is text/html.  However if I write the following, then this would match if there is ANY text/html body part anywhere in the legal MIME structure of the message:

    if header :bodyparts :contains "Content-Type" "text/html"

With our new mimeheader test this would become more correctly:

    if header :bodyparts :value :contains "Content-Type" "text/html"

Then if we combine this with allof(), we could further define that multiple tests within an allof() must apply to the same body part.  So if we say:

    if allof :bodyparts (header :value :contains "Content-Type" "image/jpeg",
                                  size :over 100K)

Then this would catch all messages that contain a image/jpeg body part that is over 100K.  However if we say the following, then this would catch any message that contained a body part that was image/jpeg and a body part (potentially different) which was over 100K in size.:

    if allof (header :bodyparts :value :contains "Content-Type" "image/jpeg",
                size :bodyparts :over 100K)

This then very neatly fits with the body extention, and we get a test like this which would test for all messages that contain a text body part that contains the word "Spam":

    if allof :bodyparts (header :value :contains "Content-Type" "text",
                                  body :contains "Spam")

For more examples, I'll go through Cyrus examples and show how they would look for this proposal.  However before I do, I note that many look for an "in any header value" or an "in any parameter value" concept.  We currently haven't found a need for these, and I'm not sure we need them.  If we do, then I'd propose we have new tests like "anyheader", "anyexists" and a new header-part of ":anyparameter".

Also to strictly "like for like" Cyrus's examples, I have to use my :bodypart parameter on them all, even though that wouldn't be necessary, and to remove it may actually create a better test.

> 1) Test the presence of a specific MIME header:
> 
>     if (mimeheader :name "Content-Foo" :exists)

if exists :bodyparts "Content-Foo"

(Reads as: If there is any "Content-Foo" header in any body part)

> 2) Test the presence of a specific parameter in any MIME header:
> 
>     if (mimeheader :parameter-name "filename" :exists)

if anyexists :bodyparts :parameter "filename"

(Reads as: If there is any header in any body part which has a filename parameter)

> 3) Test the presence of a specific parameter in a specific MIME header:
> 
>     if (mimeheader :name "Content-Disposition" :parameter-name "filename" 
> :exists)

if exists :bodyparts :parameter "filename" "Content-Disposition"

(Reads as: If there is a Content-Disposition header in any body part which has a filename parameter)

> 4) Test for text anywhere in a specific MIME header
> 
>     if (mimeheader :name "Content-Disposition" :text :contains ".exe")

if header :bodyparts :contains "Content-Disposition" ".exe"

(Reads as: If there is a Content-Disposition header in any body part which contains the string ".exe")

> 5) Test for text only in the value (not parameters) in a specific MIME 
> header
> 
>     if (mimeheader :name "Content-Disposition" :value :contains "attach")

if header :bodyparts :value :contains "Content-Disposition" "attach"

(Reads as: If there is a Content-Disposition header in any body part which contains the string "attach" in the value excluding the parameters)

> 6) Test for text in any parameter values only in a specific MIME header
> 
>     if (mimeheader :name "Content-Disposition" :parameter-value :contains 
> ".exe")

if header :bodyparts :anyparameter :contains "Content-Disposition" ".exe"
 
(Reads as: If there is a Content-Disposition header in any body part which contains the string ".exe" in any parameter)

> 7) Test for text in a specific parameter value only in a specific MIME 
> header
> 
>     if (mimeheader :name "Content-Disposition" :parameter-name "filename" 
> :parameter-value :contains ".exe")

if header :bodypart :contains :parameter "filename" "Content-Disposition" ".exe"

(Reads as: If there is a Content-Disposition header in any body part which contains the string ".exe" in the filename parameter)

> 8) Test for text in any MIME header
> 
>     if (mimeheader :text :contains ".exe")

if anyheader :bodypart :contains ".exe"

(Reads as: If there is any header in any body part which contains the string ".exe")

I'd imagine this to be more useful though:

if anyof :bodyparts (header :anyparameter :contains "Content-Disposition" ".exe",
                                header :anyparameter :contains "Content-Type" ".exe")
 
> 9) Test for text only in the value (not parameters) in any MIME header
> 
>     if (mimeheader :value :contains "7bit")

if anyheader :bodyparts :value :contains "7bit"

(Reads as: If there is a header in any body part which contains the string "7bit" in the value not including the parameters)

> 10) Test for text in any parameter values only in any MIME header
> 
>     if (mimeheader :parameter-value :contains "us-ascii")

if anyheader :bodyparts :anyparameter :contains "us-ascii"
 
(Reads as: If there is any header in any body part which contains the string "us-ascii" in any parameter)

> 11) Test for text in a specific parameter value only in any MIME header
> 
>     if (mimeheader :parameter-name "filename" :parameter-value :contains 
> ".exe")

if anyheader :bodyparts :parameters "filename" :contains ".exe"


(Reads as: If there is any header in any body part which contains the string ".exe" in any "filename" parameter)


What do you think?

Nigel



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2FJxZCK090981; Mon, 15 Mar 2004 11:59:35 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2FJxZl7090980; Mon, 15 Mar 2004 11:59:35 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from darius.cyrusoft.com (darius.cyrusoft.com [63.163.82.2]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2FJxYrk090974 for <ietf-mta-filters@imc.org>; Mon, 15 Mar 2004 11:59:35 -0800 (PST) (envelope-from daboo@cyrusoft.com)
Received: from ninevah.cyrusoft.com (ninevah.cyrusoft.com [63.163.82.9]) (authenticated bits=0) by darius.cyrusoft.com (8.12.9/8.12.9) with ESMTP id i2FJrKk3029794 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 15 Mar 2004 14:53:22 -0500
Date: Mon, 15 Mar 2004 14:59:36 -0500
From: Cyrus Daboo <daboo@cyrusoft.com>
To: ned.freed@mrochek.com
cc: IETF MTA Filters List <ietf-mta-filters@imc.org>
Subject: Re: Comments on draft-daboo-sieve-mime-00.txt
Message-ID: <187472.1079362776@ninevah.cyrusoft.com>
In-Reply-To: <01L7HAGIBZLW0027NR@mauve.mrochek.com>
References: <104800.1076013775@ninevah.cyrusoft.com> <01L7HAGIBZLW0027NR@mauve.mrochek.com>
X-Mailer: Mulberry/3.2.0a1 (Mac OS X)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

Hi Ned,
Thanks for your comments:

--On Monday, March 8, 2004 9:22 AM -0800 ned.freed@mrochek.com wrote:

| Having said that, I think the specifics of how this was done aren't
| right. First, as presently written this specification only extends the
| header test, and it does so by creating an entirely new test. But there
| are two other tests that are equally applicable to inner headers: exists
| and address. Either similar "mimeexists" and "mimeaddress" tests need to
| be added (and perhaps "mime" changed to "mimeheader"), or this needs to
| be done within the existing tests by adding a :mime parameter. I'm
| indifferent as to which one of these approaches is chosen, but we do need
| one of them.
|
| Second, I really don't like the use of an optional middle parameter to
| specify that the test is to be performed on a parameter value. This sort
| of thing is why we have labelled parameters: It should be done as
| :parameter or something similar. As for the use of a null parameter-names
| value to indicate a test of non-paramer material, this can done with
| :parameter as well, but I do worry that this is a bit tricky. OTOH, I
| haven't been able to come up with a differenent way to do it that I like
| better.

OK - here is another solution to the syntax. What I'm proposing is a 
mimeheader test that takes the following parameters:

:name - the name of a specific MIME header to test (can be a list of names)
:parameter-name - the name of a specific parameter name to test (can be a 
list)

:exists - test the existence of the specified items

:text - do comparisons against the content of the entire MIME header 
selected
:value - do comparisons against the value of the MIME header, excluding 
parameters
:parameter-value - do comparisons on parameter values only

In the case of the later three parameters a comparator and text to compare 
against are also required, in the case of :exists, no additional items 
appear.

What I've done below is to enumerate the type of tests one might want to do 
with MIME headers together with new sample syntax for how those would 
appear in a SIEVE script:

1) Test the presence of a specific MIME header:

    if (mimeheader :name "Content-Foo" :exists)

2) Test the presence of a specific parameter in any MIME header:

    if (mimeheader :parameter-name "filename" :exists)

3) Test the presence of a specific parameter in a specific MIME header:

    if (mimeheader :name "Content-Disposition" :parameter-name "filename" 
:exists)

4) Test for text anywhere in a specific MIME header

    if (mimeheader :name "Content-Disposition" :text :contains ".exe")

5) Test for text only in the value (not parameters) in a specific MIME 
header

    if (mimeheader :name "Content-Disposition" :value :contains "attach")

6) Test for text in any parameter values only in a specific MIME header

    if (mimeheader :name "Content-Disposition" :parameter-value :contains 
".exe")

7) Test for text in a specific parameter value only in a specific MIME 
header

    if (mimeheader :name "Content-Disposition" :parameter-name "filename" 
:parameter-value :contains ".exe")

8) Test for text in any MIME header

    if (mimeheader :text :contains ".exe")

9) Test for text only in the value (not parameters) in any MIME header

    if (mimeheader :value :contains "7bit")

10) Test for text in any parameter values only in any MIME header

    if (mimeheader :parameter-value :contains "us-ascii")

11) Test for text in a specific parameter value only in any MIME header

    if (mimeheader :parameter-name "filename" :parameter-value :contains 
".exe")

I think the above deals with the issues you describe, except for the 
'address' test. Arguably there are several different formats for header 
content that one might want to test against, so I wonder whether we need 
this to be extensible in some way. Certainly for the time being we could 
have a 'address [ADDRESS-PART]' parameter in mimeheader as well.

| Third, some references probably needs to be made to RFC 2231 and how to
| handle encoded parameters. I think the right answer here is to handle
| this the same way we already require that encoded words be handled.
|

Is it OK to simply require the concatenation of parameter value 
continuations that have been split according to 2231 syntax? Would you want 
a test to specifically look for the language information?

-- 
Cyrus Daboo



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2E54D4D028477; Sat, 13 Mar 2004 21:04:13 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2E54DJu028476; Sat, 13 Mar 2004 21:04:13 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2E54Bx0028470 for <ietf-mta-filters@imc.org>; Sat, 13 Mar 2004 21:04:11 -0800 (PST) (envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01L7O54WXJ740027NR@mauve.mrochek.com> for ietf-mta-filters@imc.org; Sat, 13 Mar 2004 21:04:16 -0800 (PST)
Date: Sat, 13 Mar 2004 20:37:59 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: New Sieve extension "refuse" proposal - draft-elvey-refuse-sieve-01h - Request for feedback on Open Issues.
In-reply-to: "Your message dated Sat, 13 Mar 2004 18:44:22 -0800" <4053C706.9060306@elvey.fastmail.fm>
To: "Matthew Elvey (FM)" <matthew@elvey.fastmail.fm>
Cc: ietf-mta-filters@imc.org
Message-id: <01L7OXRZNS240027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; charset=ISO-8859-1; format=flowed
Content-transfer-encoding: 7BIT
References: <402BDB3F.1090808@elvey.fastmail.fm> <4053C706.9060306@elvey.fastmail.fm>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> First of all, thanks to all for all the feedback so far.

> Alexey and I didn't receive any feedback on Section 13 'Open Issues for
> Discussion', items 2 or 3, so I'm sending this email to
> ask folks (who may have missed it because it was at the end after the
> boring boilerplate) to comment.

I note in passing that item 2 only appears in the -01 revision on your
web site - people looking at the -00 revision in the I-D directory
may be confused when they only find two open issues, not three.

Regarding item 2 -

   2) Should the following text be added to the draft? (Section 4.? ?)
   
   Systems that support the extension must encourage use (by their
   users) of "refuse" over "discard" and "reject" where it is an
   appropriate alternative.

I'm not entirely sure what it means to "encourage use", but I guess it could
refer to offering refuse actions preferentially in a GUI or something similar.
If so, I regard this as a somewhat dangerous promotion of nonportable scripts,
since refuse as presently constituted is an MTA-only sort of thing.

The real problem here has nothing to do with sieve and everything to do with
the architecture of email itself: For a variety of reasons the most effective
way to deal with spam is to reject it at the SMTP level prior to final
delivery, but an MUA by definition operates after that point. So even if
you "fix" the portability "problem" you do not and cannot get the desired
behavior on an MUA.

The logical direction this leads is that sieves are best run on MTAs just
before or during final delivery. But do we really want to say this? Perhaps
it would make sense to say it in a BCP talking about spam filtering best
practices, but not, I think, in a technical specification of a sieve
extension.

And regarding item 3 -

   3) Explicitly supporting Enhanced Error Codes (RFC 2034).
   
The suggested text talking about how to generate an appropriate enhanced error
code is definitely appropriate and should IMO be included in the document. The
broader question of whether or not it is appropriate to give users control over
what code is inserted is the interesting one here. After thinking about this
I've concluded that the benefits just don't outweigh the risks - there really
aren't that many other codes that would be appropriate to use with refuse. If
this were to be supported at all there would have to be a list of the codes a
user is allowed to specify, and anything else would be ignored.

This is a shame, because there are a few other codes that make some amount of
sense, e.g. 5.2.3, "message length exceeds administrative limit". There are
even some 4.x.y codes that make sense, e.g. 4.4.4, "unable to route", when,
say, a presence check fails and an urgent message needs to be returned
immediately. (Note that this last case is one where a 5xy 4.a.b sort of
response indicating "message returned due to a transient problem" may be
appropriate - one of the things done in the revision of the NOTARY document when
they moved to draft was to make it clear such combinations are allowed.)

				Ned



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2E2iLfW021533; Sat, 13 Mar 2004 18:44:21 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2E2iLFW021532; Sat, 13 Mar 2004 18:44:21 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from out2.smtp.messagingengine.com (out2.smtp.messagingengine.com [66.111.4.26]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2E2iJxE021525 for <ietf-mta-filters@imc.org>; Sat, 13 Mar 2004 18:44:21 -0800 (PST) (envelope-from matthew@elvey.fastmail.fm)
X-Sasl-enc: Vsb3m86BGudLBUt2xvwtJg 1079232263
Received: from elvey.fastmail.fm (adsl-69-104-63-158.dsl.pltn13.pacbell.net [69.104.63.158]) by mail.messagingengine.com (Postfix) with ESMTP id 6D5376E235B for <ietf-mta-filters@imc.org>; Sat, 13 Mar 2004 21:44:22 -0500 (EST)
Message-ID: <4053C706.9060306@elvey.fastmail.fm>
Date: Sat, 13 Mar 2004 18:44:22 -0800
From: "Matthew Elvey (FM)" <matthew@elvey.fastmail.fm>
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.6b) Gecko/20031205 Thunderbird/0.4
X-Accept-Language: en-us, en
MIME-Version: 1.0
Cc: ietf-mta-filters@imc.org
Subject: Re: New Sieve extension "refuse" proposal - draft-elvey-refuse-sieve-01h - Request for feedback on Open Issues.
References: <402BDB3F.1090808@elvey.fastmail.fm>
In-Reply-To: <402BDB3F.1090808@elvey.fastmail.fm>
X-Habeas-SWE-1: winter into spring
X-Habeas-SWE-2: brightly anticipated
X-Habeas-SWE-3: like Habeas SWE (tm)
X-Habeas-SWE-4: Copyright 2002 Habeas (tm)
X-Habeas-SWE-5: Sender Warranted Email (SWE) (tm). The sender of this
X-Habeas-SWE-6: email in exchange for a license for this Habeas
X-Habeas-SWE-7: warrant mark warrants that this is a Habeas Compliant
X-Habeas-SWE-8: Message (HCM) and not spam. Please report use of this
X-Habeas-SWE-9: mark in spam to <http://www.habeas.com/report/>.
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

First of all, thanks to all for all the feedback so far.

Alexey and I didn't receive any feedback on Section 13 'Open Issues for 
Discussion', items 2 or 3, so I'm sending this email to
ask folks (who may have missed it because it was at the end after the 
boring boilerplate) to comment.

We'll have a new draft out shortly (It's just waiting for any changes 
this post my lead to.)

On 2/12/2004 11:59 AM, Matthew Elvey (FM) sent forth electrons to convey:

>
> Hello, folks.  Please review and provide feedback on the "refuse" 
> extension, designed to mostly replace Sieve's "reject" command.
>
> ... please review and comment on what's at
> <http://www.elvey.com/it/sieve/draft-elvey-refuse-sieve-01h.txt>
>
> We welcome feedback, particularly
>  -   changes that include replacement text or
>  -   suggestions from Sieve implementers.
>
> ...
>
> -Matthew & Alexey
>



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2D0GnTp075407; Fri, 12 Mar 2004 16:16:49 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2D0Gn5X075406; Fri, 12 Mar 2004 16:16:49 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2D0GmVw075400 for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 16:16:48 -0800 (PST) (envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01L7N5EITY1S0027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org; Fri, 12 Mar 2004 16:16:52 -0800 (PST)
Date: Fri, 12 Mar 2004 16:04:41 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Sieve extension to expire mails?
In-reply-to: "Your message dated Fri, 12 Mar 2004 18:49:55 -0500" <20040312234955.GG6308@iridium.mv.net>
To: "Mark E. Mallett" <mem@mv.mv.com>
Cc: ned.freed@mrochek.com, "Mark E. Mallett" <mem@mv.mv.com>, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Message-id: <01L7N9GBS1480027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii
Content-transfer-encoding: 7BIT
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net> <01L7LYRALADE0027NR@mauve.mrochek.com> <20040312203142.GD2223@iridium.mv.net> <01L7N7DG3T7Q0027NR@mauve.mrochek.com> <20040312234955.GG6308@iridium.mv.net>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> On Fri, Mar 12, 2004 at 03:13:51PM -0800, ned.freed@mrochek.com wrote:

> > Sure it does. Folders normally retain messages until they are deleted.
> > This changes that semantics rather completely, don't you think?

> I don't think so, and that's an opinion that I was trying to convey.
> Perhaps there's a distinction centering around "deleted by whom?"

Yes, and it is a very significant one. If I have a specialized client that
prowls through some set of folders and deletes things based on some criteria or
other, its operational parameters are by definition a client concern.  Clients
the semantics and so the issue of consistent semantics for store-based deletion
doesn't arise.

If, on the other hand, a store implements some sort of message expiration
system, it almost certainly will be provided to multiple users who will  want
to use multiple clients to control and manipulate the facility on multiple
servers. Failure to nail down the semantics properly is likely to lead to
problems -- messages won't be deleted when they should have been, and worse,
messages might be deleted when they should not have been. One of the reasons we
have standards is to try and prevent this sort of thing from happening.

It is entirely reasonable to talk about using sieve to control either
a client or server side expiration facility. But a client side facility
would logically be controlled through the use of private headers or
annotations or something similar. The only thing that would need to
be standardized in this case is the means to add headers or annotations
or whatever in sieve.

A server side facility, on the other hand, needs to have the server
side semantics nailed down first. I have alredy explained why I believe
this is the case in considerable detail.

> My
> attitude is that the owner of a mailbox could legitimately instruct a
> delivery agent to manipulate that mailbox as part of delivery.  One of
> those instructions could be "delete the oldest message [under some
> condition]".  I see no philosophical difference between that
> instruction and manually hitting the 'd' key.  This introduces no new
> storage semantics nor any new operational semantics.  It does wrap up
> a few primitive operations into a higher level function, but that
> doesn't make those operations new.  (Making them more granular would
> actually be to my liking.)

> Just me, I guess?

It certainly is not a view I share, nor is it a view that I feel is
likely to lead to a successful sieve extension. Again, I have
explained why I think this is the case.

				Ned



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CNoqdu074333; Fri, 12 Mar 2004 15:50:52 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2CNoqGY074332; Fri, 12 Mar 2004 15:50:52 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40]) by above.proper.com (8.12.11/8.12.8) with SMTP id i2CNopDO074326 for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 15:50:51 -0800 (PST) (envelope-from mem@mv.mv.com)
Received: (qmail 13890 invoked from network); 12 Mar 2004 18:50:56 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17) by mercury.mv.net with SMTP; 12 Mar 2004 18:50:56 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40 local-name mercury.mv.net
Received: (qmail 18783 invoked by uid 101); 12 Mar 2004 18:49:55 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Fri, 12 Mar 2004 18:49:55 -0500
To: ned.freed@mrochek.com
Cc: "Mark E. Mallett" <mem@mv.mv.com>, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
Message-ID: <20040312234955.GG6308@iridium.mv.net>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net> <01L7LYRALADE0027NR@mauve.mrochek.com> <20040312203142.GD2223@iridium.mv.net> <01L7N7DG3T7Q0027NR@mauve.mrochek.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <01L7N7DG3T7Q0027NR@mauve.mrochek.com>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Fri, Mar 12, 2004 at 03:13:51PM -0800, ned.freed@mrochek.com wrote:

> Sure it does. Folders normally retain messages until they are deleted.
> This changes that semantics rather completely, don't you think?

I don't think so, and that's an opinion that I was trying to convey.
Perhaps there's a distinction centering around "deleted by whom?"  My
attitude is that the owner of a mailbox could legitimately instruct a
delivery agent to manipulate that mailbox as part of delivery.  One of
those instructions could be "delete the oldest message [under some
condition]".  I see no philosophical difference between that
instruction and manually hitting the 'd' key.  This introduces no new
storage semantics nor any new operational semantics.  It does wrap up
a few primitive operations into a higher level function, but that
doesn't make those operations new.  (Making them more granular would
actually be to my liking.)

Just me, I guess?

-mm-



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CNHICS072202; Fri, 12 Mar 2004 15:17:18 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2CNHIHb072201; Fri, 12 Mar 2004 15:17:18 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CNHEwh072192 for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 15:17:14 -0800 (PST) (envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01L7N5EITY1S0027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org; Fri, 12 Mar 2004 15:17:17 -0800 (PST)
Date: Fri, 12 Mar 2004 15:13:51 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Sieve extension to expire mails?
In-reply-to: "Your message dated Fri, 12 Mar 2004 15:31:42 -0500" <20040312203142.GD2223@iridium.mv.net>
To: "Mark E. Mallett" <mem@mv.mv.com>
Cc: ned.freed@mrochek.com, "Mark E. Mallett" <mem@mv.mv.com>, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Message-id: <01L7N7DG3T7Q0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii
Content-transfer-encoding: 7BIT
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net> <01L7LYRALADE0027NR@mauve.mrochek.com> <20040312203142.GD2223@iridium.mv.net>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> On Thu, Mar 11, 2004 at 05:34:36PM -0800, ned.freed@mrochek.com wrote:
> >
> > >     fileinto :keep-maximum-messages 100 "somefolder";
> > > or
> > >     fileinto :keep-maximum-storage 100k "somefolder";
> > > (or both).
> >
> > Or how about limits on an entire folder tree? Or limits expressed in terms of
> > messages with different characteristics? (These are not theoretical -- I've
> > seen requests for both of these.) The list goes on and on and on.

> One can always theorize extreme tangents for any discussion.

But these weren't extremes. They are both quite reasonable requests.

> Even so,
> it could be useful to have fundamental access to operations on
> existing mailstore when storing a new message.

Again, it depends on how those operations are organized. And the way to make
sure they are properly organized is to work out the semantics in a venue
appropriate for mail store semantic discussions. This isn't that venue.

> > Like it or not, this is digging deep into the general area of message store
> > semantics and brings up any number of fairly subtle issues, e.g., are the
> > criteria met by deleting old messages, deleting the largest messages, holding
> > new messages, bouncing new messages, etc. etc.

> Obviously we disagree, because (re "like it or not") I do
> like it :-)  In the case of a rolling mailbox, the issues are not
> subtle.  One has a sliding window of the mailbox, where old
> messages are dropped to make room for new ones.  This is really
> not an outlandish idea, nor does it introduce any new folder
> semantics.

Sure it does. Folders normally retain messages until they are deleted.
This changes that semantics rather completely, don't you think?

				Ned



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CMGw1A068980; Fri, 12 Mar 2004 14:16:58 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2CMGw4B068979; Fri, 12 Mar 2004 14:16:58 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CMGvVL068973 for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 14:16:57 -0800 (PST) (envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8]) (user=rjs3 mech=GSSAPI (0 bits)) by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2CMGwkw017588; Fri, 12 Mar 2004 17:16:58 -0500
Date: Fri, 12 Mar 2004 17:16:59 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: "Mark E. Mallett" <mem@mv.mv.com>
cc: ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
In-Reply-To: <20040312221219.GD6308@iridium.mv.net>
Message-ID: <Pine.LNX.4.58-035.0403121714200.22156@sourcefour.andrew.cmu.edu>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net> <Pine.LNX.4.55L-032.0403120008290.12781@mute.wrct.org> <20040312204103.GE2223@iridium.mv.net> <Pine.LNX.4.58-035.0403121648590.13082@sourcefour.andrew.cmu.edu> <20040312221219.GD6308@iridium.mv.net>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Fri, 12 Mar 2004, Mark E. Mallett wrote:

> > > That does look like that is what that script would do, and no, it's
> > > probably not useful.  I would call that a bad script.
> >
> > Well-defined syntax shouldn't let you write a "bad script".
>
> I would have to flat-out disagree with that.  But that's a whole
> nother conversation.

Semantics.  It's a syntacticly correct script that even has a valid
interpretation, which is logical, even if its not necessaraly what the
user would expect.  That does not at all make it a "bad script", as you
say.

> On a related note: do people who will be confused by languages write
> scripts by hand, anyway?

Its possible to write code in any language that is confusing, the point is
to minimize the confusion.  Even experienced users might not see what is
going on in a script that is a thousand lines long, with fileintos
into the same mailbox separated by a few hundred lines.

> I imagine that those people use some interface that generates scripts
> for them, and "power users" will write scripts by hand.  Neither of
> these groups should object to having powerful underlying facilities.

But they might object to the language making it easy to make mistakes.

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CMEKmZ068864; Fri, 12 Mar 2004 14:14:20 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2CMEKYH068863; Fri, 12 Mar 2004 14:14:20 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40]) by above.proper.com (8.12.11/8.12.8) with SMTP id i2CMEJZj068853 for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 14:14:19 -0800 (PST) (envelope-from mem@mv.mv.com)
Received: (qmail 3678 invoked from network); 12 Mar 2004 17:12:20 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17) by mercury.mv.net with SMTP; 12 Mar 2004 17:14:21 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40 local-name mercury.mv.net
Received: (qmail 734 invoked by uid 101); 12 Mar 2004 17:12:19 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Fri, 12 Mar 2004 17:12:19 -0500
To: Rob Siemborski <rjs3@andrew.cmu.edu>
Cc: "Mark E. Mallett" <mem@mv.mv.com>, ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
Message-ID: <20040312221219.GD6308@iridium.mv.net>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net> <Pine.LNX.4.55L-032.0403120008290.12781@mute.wrct.org> <20040312204103.GE2223@iridium.mv.net> <Pine.LNX.4.58-035.0403121648590.13082@sourcefour.andrew.cmu.edu>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <Pine.LNX.4.58-035.0403121648590.13082@sourcefour.andrew.cmu.edu>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> > That does look like that is what that script would do, and no, it's
> > probably not useful.  I would call that a bad script.
> 
> Well-defined syntax shouldn't let you write a "bad script".

I would have to flat-out disagree with that.  But that's a whole
nother conversation.


>  I'd argue
> that this particular addition to sieve is likely to be extraordinarly
> confusing to users.  If I have 10 places in a script where I can file into
> a particular mailbox, I shouldn't need to remember that in each of those
> places I need to set the *same* max storage limit.

I can sympathize with those comments even if I don't necessarily have
the same perspective as you.  Mine is to give the power to the script
writer, not protect them from that power.  On a related note: do people
who will be confused by languages write scripts by hand, anyway?  I
imagine that those people use some interface that generates scripts
for them, and "power users" will write scripts by hand.  Neither of
these groups should object to having powerful underlying facilities.

BTW I am not pushing this as a proposal; note that I am commenting in
a thread started by someone else.  But I do believe it is a good idea
that could either be implemented as-is or incorporated into a more
complete extension somewhere down the line.

Yours,
-mm-



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CLotv2067221; Fri, 12 Mar 2004 13:50:55 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2CLotJv067220; Fri, 12 Mar 2004 13:50:55 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CLosN9067214 for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 13:50:54 -0800 (PST) (envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8]) (user=rjs3 mech=GSSAPI (0 bits)) by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2CLoukw017528; Fri, 12 Mar 2004 16:50:56 -0500
Date: Fri, 12 Mar 2004 16:50:56 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: "Mark E. Mallett" <mem@mv.mv.com>
cc: ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
In-Reply-To: <20040312204103.GE2223@iridium.mv.net>
Message-ID: <Pine.LNX.4.58-035.0403121648590.13082@sourcefour.andrew.cmu.edu>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net> <Pine.LNX.4.55L-032.0403120008290.12781@mute.wrct.org> <20040312204103.GE2223@iridium.mv.net>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

I suppose that's what I get for hitting the send key at the wrong time...

Let's try this again.

On Fri, 12 Mar 2004, Mark E. Mallett wrote:

>
> On Fri, Mar 12, 2004 at 12:11:19AM -0500, Rob Siemborski wrote:
> > In addition to Ned's comments (which I tend to agree with), does
> > implementing this sort of folder semantic on a per-message basis even
> > make any sense?
> >
> > Let's presume the script:
> >
> > if envelope :all :contains "to" "rjs3+a@" {
> >         fileinto "INBOX.foo";
> > } elsif envelope :all :contains "to" "rjs3+b@" {
> >         fileinto :keep-maximum-storage 100k "INBOX.foo";
> > }
> >
> > Does this mean the script only enforces the limit when an "rjs3+b" message
> > arrives?  If so, is that even useful?
>
> That does look like that is what that script would do, and no, it's
> probably not useful.  I would call that a bad script.

Well-defined syntax shouldn't let you write a "bad script".  I'd argue
that this particular addition to sieve is likely to be extraordinarly
confusing to users.  If I have 10 places in a script where I can file into
a particular mailbox, I shouldn't need to remember that in each of those
places I need to set the *same* max storage limit.

> There's always a conflict between exposing and encapsulating language
> facilities.  For example, the original poster had the notion of adding
> a folder definition that would ensure that all operations into that
> folder would operate the same way.  I wouldn't want that: I generally
> go for the low-level granularity that lets the script writer have
> complete control (and responsibility for their own errors).

If such an overriding defaults system existed, this problem wouldn't
exist.  You could even have both a default value, *and* allow people to
override it.

Though, in the end, I think this is something best left as a folder
attribute.

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CLmKcx067096; Fri, 12 Mar 2004 13:48:20 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2CLmK2F067095; Fri, 12 Mar 2004 13:48:20 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CLmGOu067086 for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 13:48:16 -0800 (PST) (envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8]) (user=rjs3 mech=GSSAPI (0 bits)) by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2CLmGkw017515; Fri, 12 Mar 2004 16:48:16 -0500
Date: Fri, 12 Mar 2004 16:48:16 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: "Mark E. Mallett" <mem@mv.mv.com>
cc: ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
In-Reply-To: <20040312204103.GE2223@iridium.mv.net>
Message-ID: <Pine.LNX.4.58-035.0403121647270.13082@sourcefour.andrew.cmu.edu>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net> <Pine.LNX.4.55L-032.0403120008290.12781@mute.wrct.org> <20040312204103.GE2223@iridium.mv.net>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Fri, 12 Mar 2004, Mark E. Mallett wrote:

> On Fri, Mar 12, 2004 at 12:11:19AM -0500, Rob Siemborski wrote:
> > In addition to Ned's comments (which I tend to agree with), does
> > implementing this sort of folder semantic on a per-message basis even
> > make any sense?
> >
> > Let's presume the script:
> >
> > if envelope :all :contains "to" "rjs3+a@" {
> >         fileinto "INBOX.foo";
> > } elsif envelope :all :contains "to" "rjs3+b@" {
> >         fileinto :keep-maximum-storage 100k "INBOX.foo";
> > }
> >
> > Does this mean the script only enforces the limit when an "rjs3+b" message
> > arrives?  If so, is that even useful?
>
> That does look like that is what that script would do, and no, it's
> probably not useful.  I would call that a bad script.

Well-defined syntax shouldn't let you write a "bad script".

> When one
> provides facilities in a language, one is not personally expected to
> debug every script that can be written in it.



> There's always a conflict between exposing and encapsulating language
> facilities.  For example, the original poster had the notion of adding
> a folder definition that would ensure that all operations into that
> folder would operate the same way.  I wouldn't want that: I generally
> go for the low-level granularity that lets the script writer have
> complete control (and responsibility for their own errors).
>
> (In my own implementation I have other ways of dealing with that
> conflict anyway.)
>
> mm
>
>
>

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CKf5Yc063696; Fri, 12 Mar 2004 12:41:05 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2CKf5GM063695; Fri, 12 Mar 2004 12:41:05 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40]) by above.proper.com (8.12.11/8.12.8) with SMTP id i2CKf4lX063689 for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 12:41:04 -0800 (PST) (envelope-from mem@mv.mv.com)
Received: (qmail 27901 invoked from network); 12 Mar 2004 15:41:04 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17) by mercury.mv.net with SMTP; 12 Mar 2004 15:41:06 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40 local-name mercury.mv.net
Received: (qmail 16696 invoked by uid 101); 12 Mar 2004 15:41:03 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Fri, 12 Mar 2004 15:41:03 -0500
To: Rob Siemborski <rjs3@andrew.cmu.edu>
Cc: "Mark E. Mallett" <mem@mv.mv.com>, ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
Message-ID: <20040312204103.GE2223@iridium.mv.net>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net> <Pine.LNX.4.55L-032.0403120008290.12781@mute.wrct.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <Pine.LNX.4.55L-032.0403120008290.12781@mute.wrct.org>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Fri, Mar 12, 2004 at 12:11:19AM -0500, Rob Siemborski wrote:
> In addition to Ned's comments (which I tend to agree with), does
> implementing this sort of folder semantic on a per-message basis even
> make any sense?
> 
> Let's presume the script:
> 
> if envelope :all :contains "to" "rjs3+a@" {
>         fileinto "INBOX.foo";
> } elsif envelope :all :contains "to" "rjs3+b@" {
>         fileinto :keep-maximum-storage 100k "INBOX.foo";
> }
> 
> Does this mean the script only enforces the limit when an "rjs3+b" message
> arrives?  If so, is that even useful?

That does look like that is what that script would do, and no, it's
probably not useful.  I would call that a bad script.  When one
provides facilities in a language, one is not personally expected to
debug every script that can be written in it.

There's always a conflict between exposing and encapsulating language
facilities.  For example, the original poster had the notion of adding
a folder definition that would ensure that all operations into that
folder would operate the same way.  I wouldn't want that: I generally
go for the low-level granularity that lets the script writer have
complete control (and responsibility for their own errors).

(In my own implementation I have other ways of dealing with that
conflict anyway.)

mm



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CKVin5063281; Fri, 12 Mar 2004 12:31:44 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2CKVi5w063280; Fri, 12 Mar 2004 12:31:44 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40]) by above.proper.com (8.12.11/8.12.8) with SMTP id i2CKVd7U063270 for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 12:31:39 -0800 (PST) (envelope-from mem@mv.mv.com)
Received: (qmail 14841 invoked from network); 12 Mar 2004 15:31:42 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17) by mercury.mv.net with SMTP; 12 Mar 2004 15:31:42 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40 local-name mercury.mv.net
Received: (qmail 13260 invoked by uid 101); 12 Mar 2004 15:31:42 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Fri, 12 Mar 2004 15:31:42 -0500
To: ned.freed@mrochek.com
Cc: "Mark E. Mallett" <mem@mv.mv.com>, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
Message-ID: <20040312203142.GD2223@iridium.mv.net>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net> <01L7LYRALADE0027NR@mauve.mrochek.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <01L7LYRALADE0027NR@mauve.mrochek.com>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Thu, Mar 11, 2004 at 05:34:36PM -0800, ned.freed@mrochek.com wrote:
> 
> >     fileinto :keep-maximum-messages 100 "somefolder";
> > or
> >     fileinto :keep-maximum-storage 100k "somefolder";
> > (or both).
> 
> Or how about limits on an entire folder tree? Or limits expressed in terms of
> messages with different characteristics? (These are not theoretical -- I've
> seen requests for both of these.) The list goes on and on and on.

One can always theorize extreme tangents for any discussion.  Even so,
it could be useful to have fundamental access to operations on
existing mailstore when storing a new message.



> Like it or not, this is digging deep into the general area of message store
> semantics and brings up any number of fairly subtle issues, e.g., are the
> criteria met by deleting old messages, deleting the largest messages, holding
> new messages, bouncing new messages, etc. etc.

Obviously we disagree, because (re "like it or not") I do
like it :-)  In the case of a rolling mailbox, the issues are not
subtle.  One has a sliding window of the mailbox, where old
messages are dropped to make room for new ones.  This is really
not an outlandish idea, nor does it introduce any new folder
semantics.  If it sparks other ideas or other ways to access mail
folders, so much the better-- any way to give owner of a mailstore
a little more control at delivery time.  That's one of the things
SIEVE is for.

mm



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CA4Hl8017296; Fri, 12 Mar 2004 02:04:17 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2CA4Hp2017295; Fri, 12 Mar 2004 02:04:17 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from relay.unizar.es (piedra.unizar.es [155.210.11.65]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2CA4F9D017288 for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 02:04:16 -0800 (PST) (envelope-from 462931@celes.unizar.es)
Received: from localhost (mesa.unizar.es [155.210.11.66]) by relay.unizar.es (8.12.6/8.12.3) with ESMTP id i2C9tums004556 for <ietf-mta-filters@mail.imc.org>; Fri, 12 Mar 2004 10:55:56 +0100
Received: from 155.210.155.171 ( [155.210.155.171]) as user 462931@155.210.11.71 by webmail.unizar.es with HTTP; Fri, 12 Mar 2004 10:55:20 +0100
Message-ID: <1079085320.405189089b8b4@webmail.unizar.es>
Date: Fri, 12 Mar 2004 10:55:20 +0100
From: =?ISO-8859-1?B?RGF2aWQgU+FuY2hleiBQ6XJleg==?= <462931@celes.unizar.es>
To: Sieve list <ietf-mta-filters@mail.imc.org>
Subject: Sieve to Maildrop
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
User-Agent: Internet Messaging Program (IMP) 3.1
X-Originating-IP: 155.210.155.171
X-Virus-Scanned: TAMIZ + Sophos en unizar.es
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

Hello
I'd like to know if there is a tool for translating Sieve to Maildrop.

              Thanks
                 DvD





P.D.: Sorry my bad english



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2C5BHdQ022550; Thu, 11 Mar 2004 21:11:17 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2C5BHmK022549; Thu, 11 Mar 2004 21:11:17 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2C5BGhE022543 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 21:11:16 -0800 (PST) (envelope-from rjs3@andrew.cmu.edu)
Received: from MUTE.WRCT.ORG (MUTE.WRCT.ORG [128.2.39.39]) (user=rjs3 mech=GSSAPI (0 bits)) by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2C5BJkw015789; Fri, 12 Mar 2004 00:11:19 -0500
Date: Fri, 12 Mar 2004 00:11:19 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
X-X-Sender: rjs3@mute.wrct.org
To: "Mark E. Mallett" <mem@mv.mv.com>
cc: ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
In-Reply-To: <20040311233735.GC23860@iridium.mv.net>
Message-ID: <Pine.LNX.4.55L-032.0403120008290.12781@mute.wrct.org>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Thu, 11 Mar 2004, Mark E. Mallett wrote:

> The thing that I would like to see is more of limiting the volume
> of a folder, either in terms of total data size or of number of messages.
> So either
>
>     fileinto :keep-maximum-messages 100 "somefolder";
> or
>     fileinto :keep-maximum-storage 100k "somefolder";
> (or both).

In addition to Ned's comments (which I tend to agree with), does
implementing this sort of folder semantic on a per-message basis even
make any sense?

Let's presume the script:

if envelope :all :contains "to" "rjs3+a@" {
        fileinto "INBOX.foo";
} elsif envelope :all :contains "to" "rjs3+b@" {
        fileinto :keep-maximum-storage 100k "INBOX.foo";
}

Does this mean the script only enforces the limit when an "rjs3+b" message
arrives?  If so, is that even useful?

Its entirely unclear to me that folder-wide attributes are useful to
employ in a sieve script.  Per-message expiration dates (and even generic
annotation-setting) seems fine, but folder-wide attributes just don't seem
like a good fit.

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2C1xYpc011704; Thu, 11 Mar 2004 17:59:34 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2C1xY8p011703; Thu, 11 Mar 2004 17:59:34 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2C1xTb4011696 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 17:59:29 -0800 (PST) (envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01L7KTEM74YO0027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 17:59:34 -0800 (PST)
Date: Thu, 11 Mar 2004 17:34:36 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Sieve extension to expire mails?
In-reply-to: "Your message dated Thu, 11 Mar 2004 18:37:35 -0500" <20040311233735.GC23860@iridium.mv.net>
To: "Mark E. Mallett" <mem@mv.mv.com>
Cc: ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Message-id: <01L7LYRALADE0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii
Content-transfer-encoding: 7BIT
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <20040311233735.GC23860@iridium.mv.net>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> > > If sieve makes the promise that a a mailbox should contain only the past
> > > seven days' mail, users might reasonably rely on that. If, then, no
> > > mail is delivered in seven days, the mailbox should STILL contain the
> > > past seven days' mail (that is, it should be empty). If expiry happens
> > > as part of delivery, older mail will still be retrievable.

> > I guess I have no problem per se with having per-folder or per-mailbox
> > expirations. But sieve operates per-message, not per-folder or per-mailbox.
> > Supporting per-message expirations is considerably more difficult than
> > per-folder or per-mailbox, and I doubt if the benefits are worth the cost.

> Just to back up a little bit: I've got a similar item on my own
> todo/wish list, so I do support a related concept.  However I don't
> look at it as a sieve agent managing mailbox expirations.  Pure mailbox
> expirations are, I would agree, more of an external maintenance function.
> The thing that I would like to see is more of limiting the volume
> of a folder, either in terms of total data size or of number of messages.
> So either

>     fileinto :keep-maximum-messages 100 "somefolder";
> or
>     fileinto :keep-maximum-storage 100k "somefolder";
> (or both).

Or how about limits on an entire folder tree? Or limits expressed in terms of
messages with different characteristics? (These are not theoretical -- I've
seen requests for both of these.) The list goes on and on and on.

Like it or not, this is digging deep into the general area of message store
semantics and brings up any number of fairly subtle issues, e.g., are the
criteria met by deleting old messages, deleting the largest messages, holding
new messages, bouncing new messages, etc. etc.

I will again repeat that this is an area that sieve has previously succeeded in
avoiding, and given that we have at least two active working groups (IMAPEXT
and LEMONADE) playing in this general area, plus one  inactive one that has
come fairly close to this space (ACAP) I think it is unlikely in the extreme
that sieve work on such things will be uncontroversial. Remember, we made an
intentional choice not to be an IETF working group, and that choice  has
consequences, both good and bad.

> One comment raised was along the lines of "sieve deals with messages,
> not with folders."  I would contend that sieve is a language that can
> operate inside of many contexts, one of which is local delivery.  With
> local delivery, the distinction is blurred.  I own my incoming mail,
> and I own my stored folders, and I want to be able to tell my delivery
> agent how to manage both of them and resolve a storage/quota issue in
> a reasonably understandable way.  This sort of thing (which I think of
> as "rolling mailboxes") would be a nice facility for quarantining
> incoming messages which, without the facility, one might otherwise
> simply delete.

> Also, I understand the philosophy that says that this sort of thing
> should be an attribute of a folder.  However I don't agree that every
> operation that you might want to do on a folder should be expressed as
> a folder attribute, especially one with magic side effects.  There's
> really nothing wrong with expressing folder limits as a control over
> delivery; the distinction is where and how you express it.  Expressing
> it inside a delivery script is as much setting a folder/delivery
> attribute as is expressing it in some parameter attached to the
> folder.  BTW I have nothing against either.  (This is kind of like the
> way that various OSes differ in their treatment of files: in some, one
> configures files to behave in a certain way; in others, one writes
> programs to treat files in different ways.)

> > But regardless of the expiration model, this proposal seems to me to be
> > putting the cart before the horse - we'd need to define an IMAP expiration
> > extension before it is reasonable to extend sieve to support it. And such a
> > sieve extension only makes sense if the model chosen for expirations is
> > per-message.

> I don't really see why IMAP should drive SIEVE (then again, I'm no
> longer talking about "expiration" so this may not be a disagreement.)
> SIEVE is a filtering language, IMAP is a folder access protocol.

The reason IMAP should drive sieve in this area is because IMAP is,
in addition to being a protocol, the way we've chosen to capture
a consistent set of message store semantics.

> They
> are not the same, although I understand that for some, they are
> intertwined.

The implementation intertwining of the two is largely irrelevant as far as I'm
concerned. My concern is that this group isn't the right place to define
significant extensions to message store semantics. Even if we do it and do it
right I suspect the IESG won't like it one bit. (I base this assessment on the
LEMONADE chartering experience, where the IESG required explicit language
restricting the group's activities to IMAP and also called for close
coordination with IMAPEXT.)

> But I wouldn't use that subset of circumstances as a
> driver for SIEVE functionality.  (If I'm misunderstanding, I'm happy
> to be educated.)

> Bottom line: I don't (necessarily) support sieve dictating folder
> expiration, but would look forward to a "rolling mailbox" sort of
> facility.

Well, as others have previously pointed out, one way to get this sort of
functionality is through the specification of an extension that hooks into
the IMAP ANNOTATE or ANNOTATEMORE extensions. Nothing would prevent someone
from using such an extension in a non-IMAP environment.

				Ned



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BNc7MR004765; Thu, 11 Mar 2004 15:38:08 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BNc7wa004764; Thu, 11 Mar 2004 15:38:07 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mercury.mv.net (mercury.mv.net [199.125.85.40]) by above.proper.com (8.12.11/8.12.8) with SMTP id i2BNc2kl004756 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 15:38:02 -0800 (PST) (envelope-from mem@mv.mv.com)
Received: (qmail 10022 invoked from network); 11 Mar 2004 18:37:36 -0500
Received: from iridium.mv.net (HELO mv.mv.com) (199.125.85.17) by mercury.mv.net with SMTP; 11 Mar 2004 18:38:07 -0500
X-Peer-Info: remote-ip 199.125.85.17 local-ip 199.125.85.40 local-name mercury.mv.net
Received: (qmail 24788 invoked by uid 101); 11 Mar 2004 18:37:35 -0500
From: "Mark E. Mallett" <mem@mv.mv.com>
Date: Thu, 11 Mar 2004 18:37:35 -0500
To: ned.freed@mrochek.com
Cc: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
Message-ID: <20040311233735.GC23860@iridium.mv.net>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <01L7LBH2PFU40027NR@mauve.mrochek.com>
User-Agent: Mutt/1.4.2.1i
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Thu, Mar 11, 2004 at 06:42:24AM -0800, ned.freed@mrochek.com wrote:
> 
> >Michael Haardt writes:
> 
> >If sieve makes the promise that a a mailbox should contain only the past
> >seven days' mail, users might reasonably rely on that. If, then, no
> >mail is delivered in seven days, the mailbox should STILL contain the
> >past seven days' mail (that is, it should be empty). If expiry happens
> >as part of delivery, older mail will still be retrievable.
> 
> I guess I have no problem per se with having per-folder or per-mailbox
> expirations. But sieve operates per-message, not per-folder or per-mailbox.
> Supporting per-message expirations is considerably more difficult than
> per-folder or per-mailbox, and I doubt if the benefits are worth the cost.

Just to back up a little bit: I've got a similar item on my own
todo/wish list, so I do support a related concept.  However I don't
look at it as a sieve agent managing mailbox expirations.  Pure mailbox
expirations are, I would agree, more of an external maintenance function.
The thing that I would like to see is more of limiting the volume
of a folder, either in terms of total data size or of number of messages.
So either

    fileinto :keep-maximum-messages 100 "somefolder";
or
    fileinto :keep-maximum-storage 100k "somefolder";
(or both).

One comment raised was along the lines of "sieve deals with messages,
not with folders."  I would contend that sieve is a language that can
operate inside of many contexts, one of which is local delivery.  With
local delivery, the distinction is blurred.  I own my incoming mail,
and I own my stored folders, and I want to be able to tell my delivery
agent how to manage both of them and resolve a storage/quota issue in
a reasonably understandable way.  This sort of thing (which I think of
as "rolling mailboxes") would be a nice facility for quarantining
incoming messages which, without the facility, one might otherwise
simply delete.

Also, I understand the philosophy that says that this sort of thing
should be an attribute of a folder.  However I don't agree that every
operation that you might want to do on a folder should be expressed as
a folder attribute, especially one with magic side effects.  There's
really nothing wrong with expressing folder limits as a control over
delivery; the distinction is where and how you express it.  Expressing
it inside a delivery script is as much setting a folder/delivery
attribute as is expressing it in some parameter attached to the
folder.  BTW I have nothing against either.  (This is kind of like the
way that various OSes differ in their treatment of files: in some, one
configures files to behave in a certain way; in others, one writes
programs to treat files in different ways.)


> But regardless of the expiration model, this proposal seems to me to be
> putting the cart before the horse - we'd need to define an IMAP expiration
> extension before it is reasonable to extend sieve to support it. And such a
> sieve extension only makes sense if the model chosen for expirations is
> per-message.

I don't really see why IMAP should drive SIEVE (then again, I'm no
longer talking about "expiration" so this may not be a disagreement.)
SIEVE is a filtering language, IMAP is a folder access protocol.  They
are not the same, although I understand that for some, they are
intertwined.  But I wouldn't use that subset of circumstances as a
driver for SIEVE functionality.  (If I'm misunderstanding, I'm happy
to be educated.)

Bottom line: I don't (necessarily) support sieve dictating folder
expiration, but would look forward to a "rolling mailbox" sort of
facility.

Yours,
-mm-



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BHEv4R079660; Thu, 11 Mar 2004 09:14:57 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BHEvfL079659; Thu, 11 Mar 2004 09:14:57 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BHEuv9079653 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 09:14:56 -0800 (PST) (envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01L7KTEM74YO0027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 09:14:58 -0800 (PST)
Date: Thu, 11 Mar 2004 09:06:31 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Sieve extension to expire mails?
In-reply-to: "Your message dated Thu, 11 Mar 2004 10:24:55 -0500 (EST)" <Pine.LNX.4.58-035.0403111022500.23108@sourcefour.andrew.cmu.edu>
To: Rob Siemborski <rjs3@andrew.cmu.edu>
Cc: ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Message-id: <01L7LGFVMRCI0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii
Content-transfer-encoding: 7BIT
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <Pine.LNX.4.58-035.0403111022500.23108@sourcefour.andrew.cmu.edu>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> On Thu, 11 Mar 2004 ned.freed@mrochek.com wrote:

> > But regardless of the expiration model, this proposal seems to me to be
> > putting the cart before the horse - we'd need to define an IMAP expiration
> > extension before it is reasonable to extend sieve to support it. And such a
> > sieve extension only makes sense if the model chosen for expirations is
> > per-message.

> There's nothing that says we need an IMAP extension for expiration before
> defining a sieve extension for expiration.  Sieve can work in enviornments
> other than IMAP.

Perhaps, but if we decide on this course it will be the first time we've
created an action in sieve that isn't bound to a well understand protocol
semantic defined elsewhere. Every existing action (keep, reject, fileinto,
discard, redirect, and even addheader and refuse) depends normatively
on these sorts of semantics.

For example, folders exist independent of IMAP, but having IMAP there to define
the essential semantics of folders is very useful. Failing to capture the
semantics of message expiration outside the context of sieve would IMO be a
mistake.

> You could also have a sieve implementation that ran against the current
> contents of a mailbox iteratively, and threw out (or refiled) all messages
> older than the expiration date, for example [though I suppose this relies
> more on a date comparison extension than any particular "Expire"
> extension].

Sure, and I'm reasonably comfortable with this, although to be fair it does
extent the applicability of sieve past the use on or around the time of
delivery.

				Ned



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFqcWw073584; Thu, 11 Mar 2004 07:52:38 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BFqcwQ073583; Thu, 11 Mar 2004 07:52:38 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from kalyani.oryx.com (kalyani.oryx.com [212.125.101.207]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFqbnx073577 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 07:52:38 -0800 (PST) (envelope-from arnt@gulbrandsen.priv.no)
Received: from libertango.oryx.com (libertango.oryx.com [195.30.94.163]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by kalyani.oryx.com (Postfix) with ESMTP id AFA251BDE70 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 16:52:37 +0100 (CET)
Message-Id: <llTNzoWCn6UC5XBystZ9Jw.md5@libertango.oryx.com>
From: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>
To: ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <Pine.LNX.4.58-035.0403111022500.23108@sourcefour.andrew.cmu.edu>
In-Reply-To: <Pine.LNX.4.58-035.0403111022500.23108@sourcefour.andrew.cmu.edu>
Content-Type: text/plain; format=flowed
MIME-Version: 1.0
Date: Thu, 11 Mar 2004 16:53:37 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

Rob Siemborski writes:
> On Thu, 11 Mar 2004 ned.freed@mrochek.com wrote:
>
>>  But regardless of the expiration model, this proposal seems to me to 
>>  be putting the cart before the horse - we'd need to define an IMAP 
>>  expiration extension before it is reasonable to extend sieve to 
>>  support it. And such a sieve extension only makes sense if the 
>>  model chosen for expirations is per-message.
>
> There's nothing that says we need an IMAP extension for expiration 
> before defining a sieve extension for expiration. Sieve can work in 
> enviornments other than IMAP.

It can. But since the two tend to go together in practice, I'd say that 
extensions should too, if only to lessen the chance of future gotchas. 
I would hate to stumble into another maze like ACL/2.

As I read the ANNOTATE draft, Freenet is free to say that 
/vendor/freenet/expiry is an integer containing some number of days, 
counting from the INTERNALDATE. No extension needed.

Arnt



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFlFGg073362; Thu, 11 Mar 2004 07:47:15 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BFlFtK073361; Thu, 11 Mar 2004 07:47:15 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFlFY8073355 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 07:47:15 -0800 (PST) (envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01L7KTEM74YO0027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 07:47:17 -0800 (PST)
Date: Thu, 11 Mar 2004 07:36:32 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Sieve extension to expire mails?
In-reply-to: "Your message dated Thu, 11 Mar 2004 08:05:27 -0700" <40508037.6080600@avaya.com>
To: Rick Block <rickblock@avaya.com>
Cc: ned.freed@mrochek.com, Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Message-id: <01L7LDD65YBO0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii; format=flowed
Content-transfer-encoding: 7BIT
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com> <40508037.6080600@avaya.com>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> > But regardless of the expiration model, this proposal seems to me to be
> > putting the cart before the horse - we'd need to define an IMAP expiration
> > extension before it is reasonable to extend sieve to support it. And such a
> > sieve extension only makes sense if the model chosen for expirations is
> > per-message.

> Expiration based on message age is common in voicemail systems.  Some
> such systems warn users about messages about to expire and allow users
> to "renew" messages, so although the expiration interval is typically
> per mailbox/folder the expiry process must be driven by a writable
> per message property (one of effective date or expiration date).

First, the fact that some (but by no means all) voice mail systems work this
way doesn't make it a good idea for email systems to work this way. My
voicemail is seriously stressed by my having 20 stored messages in it. In
contrast, my email handles more than 2,000,000 stored messages without
incident, and I routinely put more than 20,000 messages in a single folder.
Per-message expirations could easily have a deleterious effect on this sort of
scalability.

Second, even assuming per-message expiries are a good idea doesn't change the
fact that this proposal is being made in the wrong venue. An IMAP extension
needs to be specified first. Only after that is in place does it make sense to
consider whether or not a sieve extension makes sense. And this in turn
breaks down into three cases:

(1) Expiration is done per-folder or per-mailbox. Sieve deals with messages,
    not folders or mailboxes, so an extension is inappropriate.

(2) Expiration is done per-message using annotations. A sieve extension
    to deal with annotations makes sense in this case; a sieve extension
    to deal with expiration specifically does not.

(3) Expiration is done separately from annotations. A sieve extension may
    make sense in this case, but the odds of this being the way expirations
    get implemented are very, very low.

				Ned



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFOuTm072122; Thu, 11 Mar 2004 07:24:56 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BFOuAq072121; Thu, 11 Mar 2004 07:24:56 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFOt43072114 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 07:24:55 -0800 (PST) (envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8]) (user=rjs3 mech=GSSAPI (0 bits)) by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2BFOtkw014373; Thu, 11 Mar 2004 10:24:55 -0500
Date: Thu, 11 Mar 2004 10:24:55 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: ned.freed@mrochek.com
cc: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
In-Reply-To: <01L7LBH2PFU40027NR@mauve.mrochek.com>
Message-ID: <Pine.LNX.4.58-035.0403111022500.23108@sourcefour.andrew.cmu.edu>
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Thu, 11 Mar 2004 ned.freed@mrochek.com wrote:

> But regardless of the expiration model, this proposal seems to me to be
> putting the cart before the horse - we'd need to define an IMAP expiration
> extension before it is reasonable to extend sieve to support it. And such a
> sieve extension only makes sense if the model chosen for expirations is
> per-message.

There's nothing that says we need an IMAP extension for expiration before
defining a sieve extension for expiration.  Sieve can work in enviornments
other than IMAP.

You could also have a sieve implementation that ran against the current
contents of a mailbox iteratively, and threw out (or refiled) all messages
older than the expiration date, for example [though I suppose this relies
more on a date comparison extension than any particular "Expire"
extension].

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFMnqO072022; Thu, 11 Mar 2004 07:22:49 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BFMnpf072021; Thu, 11 Mar 2004 07:22:49 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from lin1.andrew.cmu.edu (LIN1.andrew.cmu.edu [128.2.6.59]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFMmqa072015 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 07:22:48 -0800 (PST) (envelope-from rjs3@andrew.cmu.edu)
Received: from SOURCEFOUR.andrew.cmu.edu (SOURCEFOUR.andrew.cmu.edu [128.2.122.8]) (user=rjs3 mech=GSSAPI (0 bits)) by lin1.andrew.cmu.edu (8.12.10/8.12.10) with ESMTP id i2BFMjkw014366; Thu, 11 Mar 2004 10:22:45 -0500
Date: Thu, 11 Mar 2004 10:22:46 -0500 (EST)
From: Rob Siemborski <rjs3@andrew.cmu.edu>
To: ned.freed@mrochek.com
cc: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
In-Reply-To: <01L7LC73VQZ40027NR@mauve.mrochek.com>
Message-ID: <Pine.LNX.4.58-035.0403111021250.23108@sourcefour.andrew.cmu.edu>
References: <E1B1QkD-0001eg-T3@nostromo.freenet-ag.de> <oVQ+E0hsQtDcieakBsIt5w.md5@libertango.oryx.com> <01L7LC73VQZ40027NR@mauve.mrochek.com>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

On Thu, 11 Mar 2004 ned.freed@mrochek.com wrote:

> Yes, a sieve extension to interface with the IMAP ANNOTATE extension makes
> sense, assuming of course that IMAP ANNOTATE is approved. But it only makes
> sense to use annotations for storying expiry information if it is done
> per-message. And even then a separate IMAP extension would need to be defined.

I suspect it makes more sense (in general) to ahve a per-folder
(ANNOTATEMORE) entry to perform expiration (Cyrus IMAP provides this now
using a vendor annotation).  I suppose a per-folder annotation could just
be used as a default value for a per-message annotation too, however..

[as we venture off-topic]...

-Rob

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Rob Siemborski | Andrew Systems Group * Research Systems Programmer
PGP:0x5CE32FCC | Cyert Hall 207 * rjs3@andrew.cmu.edu * 412.268.7456
-----BEGIN GEEK CODE BLOCK----
Version: 3.12
GCS/IT/CM/PA d- s+: a-- C++++$ ULS++++$ P+++$ L+++ E W+ N(-) o? K- w-- O-
M-- V-- PS+ PE+ Y+ PGP+ t+@ 5+++ X- R@ tv-- b+ DI+++ D++ G e++ h+ r- y?
------END GEEK CODE BLOCK-----



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFDLJA071700; Thu, 11 Mar 2004 07:13:21 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BFDLD0071699; Thu, 11 Mar 2004 07:13:21 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BFDK7T071693 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 07:13:20 -0800 (PST) (envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01L7KTEM74YO0027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 07:13:22 -0800 (PST)
Date: Thu, 11 Mar 2004 07:04:01 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Sieve extension to expire mails?
In-reply-to: "Your message dated Thu, 11 Mar 2004 15:28:38 +0100" <oVQ+E0hsQtDcieakBsIt5w.md5@libertango.oryx.com>
To: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>
Cc: ietf-mta-filters@mail.imc.org
Message-id: <01L7LC73VQZ40027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii; format=flowed
Content-transfer-encoding: 7BIT
References: <E1B1QkD-0001eg-T3@nostromo.freenet-ag.de> <oVQ+E0hsQtDcieakBsIt5w.md5@libertango.oryx.com>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> > That's a point I can understand. If Sieve focuses only on messages,
> > then manipulating persistent folder attributes would be simply out of
> > scope. Does it focus strictly on messages, not folders, despite
> > folders containing messages?

> Yes. Sieve ignores folders almost entirely. (Except that fileinto may
> create a folder.)

And IMAP's folder-level capabilities are somewhat limited.

> > If so, how about message attributes to allow expiration to happen?

> Much better.

> Such attributes are called annotations in IMAPspeak, and they're
> supported by the ANNOTATE extension, which is itself still a draft and
> not terribly widely implemented. If there isn't yet a sieve extension
> to set a message annotation, there certainly should be.

Yes, a sieve extension to interface with the IMAP ANNOTATE extension makes
sense, assuming of course that IMAP ANNOTATE is approved. But it only makes
sense to use annotations for storying expiry information if it is done
per-message. And even then a separate IMAP extension would need to be defined.

				Ned



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BF4Tml070972; Thu, 11 Mar 2004 07:04:29 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BF4TTu070971; Thu, 11 Mar 2004 07:04:29 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from tierw.net.avaya.com (tierw.net.avaya.com [198.152.13.100]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BF4Op8070957 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 07:04:24 -0800 (PST) (envelope-from rickblock@avaya.com)
Received: from tierw.net.avaya.com (localhost [127.0.0.1]) by tierw.net.avaya.com (Switch-3.1.2/Switch-3.1.0) with ESMTP id i2BF0DE0028155; Thu, 11 Mar 2004 10:00:13 -0500 (EST)
Received: from bighorn.dr.avaya.com (h135-9-1-59.avaya.com [135.9.1.59]) by tierw.net.avaya.com (Switch-3.1.2/Switch-3.1.0) with SMTP id i2BF0BE0028111; Thu, 11 Mar 2004 10:00:12 -0500 (EST)
Received: from avaya.com by bighorn.dr.avaya.com (SMI-8.6/EMS-1.5 sol2) id IAA18336; Thu, 11 Mar 2004 08:04:20 -0700
Message-ID: <40508037.6080600@avaya.com>
Date: Thu, 11 Mar 2004 08:05:27 -0700
From: Rick Block <rickblock@avaya.com>
User-Agent: Mozilla/5.0 (Windows; U; Win98; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax)
X-Accept-Language: en-us, en
MIME-Version: 1.0
To: ned.freed@mrochek.com
CC: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>, ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com> <01L7LBH2PFU40027NR@mauve.mrochek.com>
In-Reply-To: <01L7LBH2PFU40027NR@mauve.mrochek.com>
Content-Type: text/plain; charset=us-ascii; format=flowed
Content-Transfer-Encoding: 7bit
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

ned.freed@mrochek.com wrote:
> But regardless of the expiration model, this proposal seems to me to be
> putting the cart before the horse - we'd need to define an IMAP expiration
> extension before it is reasonable to extend sieve to support it. And such a
> sieve extension only makes sense if the model chosen for expirations is
> per-message.

Expiration based on message age is common in voicemail systems.  Some
such systems warn users about messages about to expire and allow users
to "renew" messages, so although the expiration interval is typically
per mailbox/folder the expiry process must be driven by a writable
per message property (one of effective date or expiration date).

-Rick



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BEr995069385; Thu, 11 Mar 2004 06:53:09 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BEr9aa069384; Thu, 11 Mar 2004 06:53:09 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BEr89L069378 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 06:53:08 -0800 (PST) (envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01L7KTEM74YO0027NR@mauve.mrochek.com> for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 06:53:09 -0800 (PST)
Date: Thu, 11 Mar 2004 06:42:24 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Re: Sieve extension to expire mails?
In-reply-to: "Your message dated Thu, 11 Mar 2004 14:08:52 +0100" <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com>
To: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>
Cc: ietf-mta-filters@mail.imc.org
Message-id: <01L7LBH2PFU40027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii; format=flowed
Content-transfer-encoding: 7BIT
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de> <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> Michael Haardt writes:
> > The idea of a folder property versus a message property is
> > interesting, but indeed I thought about a folder property to be
> > specified by Sieve. Expiring mails on delivery is way more efficient
> > than daily jobs, because on many systems (e.g. maildir) the folder
> > contents are already in the page cache. Sieve, as MDA filter,
> > controls local delivery on my systems and if local delivery includes
> > expiration, it feels natural to control that, too.

> Sieve, as a language/protocol, must be held to stricter standards than
> any single implementation.

I agree 100%

> If sieve makes the promise that a a mailbox should contain only the past
> seven days' mail, users might reasonably rely on that. If, then, no
> mail is delivered in seven days, the mailbox should STILL contain the
> past seven days' mail (that is, it should be empty). If expiry happens
> as part of delivery, older mail will still be retrievable.

I guess I have no problem per se with having per-folder or per-mailbox
expirations. But sieve operates per-message, not per-folder or per-mailbox.
Supporting per-message expirations is considerably more difficult than
per-folder or per-mailbox, and I doubt if the benefits are worth the cost.

But regardless of the expiration model, this proposal seems to me to be
putting the cart before the horse - we'd need to define an IMAP expiration
extension before it is reasonable to extend sieve to support it. And such a
sieve extension only makes sense if the model chosen for expirations is
per-message.

> If your implementation confuses delivery and expiry, that's okay. You
> have a privacy/security issue, that's all. But if the sieve language
> confuses them, all implementations do. Much worse.

> FWIW, I also don't like the idea of sieve managing folder properties.
> That seems to be out of scope for sieve.

Exactly right. If the expiration model is per-folder or per-mailbox sieve
has no business trying to muck with it.

				Ned



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BEVm2b068237; Thu, 11 Mar 2004 06:31:48 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BEVmx1068236; Thu, 11 Mar 2004 06:31:48 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from quasar.skima.is (quasar.skima.is [212.30.200.205]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BEVkdf068230 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 06:31:47 -0800 (PST) (envelope-from gsh@centrum.is)
Received: from AZ01663 ([192.147.34.142] [192.147.34.142]) by quasar.skima.is with ESMTP; Thu, 11 Mar 2004 14:31:48 Z
Message-Id: <017601c40775$95ef9110$2a4115ac@siminn.is>
From: "=?iso-8859-1?Q?Gu=F0bj=F6rn_S._Hreinsson?=" <gsh@centrum.is>
To: <ietf-mta-filters@mail.imc.org>, "Michael Haardt" <michael@freenet-ag.de>
References: <E1B1QkD-0001eg-T3@nostromo.freenet-ag.de>
Subject: Re: Sieve extension to expire mails?
Date: Thu, 11 Mar 2004 14:31:48 -0000
MIME-Version: 1.0
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: 7bit
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> If so, how about message attributes to allow expiration to happen?

Nothing wrong with that. You could maintain messages in the users 
maildir (however you store them) and maintain information about 
thoses messages in a db, like sleepycat for instance. Relatively simple 
and cheap to read that db for messages that need to be expired and 
expire those that are due...

Rgds,
-GSH



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BEReTx067960; Thu, 11 Mar 2004 06:27:40 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BERenf067959; Thu, 11 Mar 2004 06:27:40 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from kalyani.oryx.com (kalyani.oryx.com [212.125.101.207]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BERd6j067953 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 06:27:39 -0800 (PST) (envelope-from arnt@gulbrandsen.priv.no)
Received: from libertango.oryx.com (libertango.oryx.com [195.30.94.163]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by kalyani.oryx.com (Postfix) with ESMTP id 016FE1BDE6B for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 15:27:39 +0100 (CET)
Message-Id: <oVQ+E0hsQtDcieakBsIt5w.md5@libertango.oryx.com>
From: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>
To: ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
References: <E1B1QkD-0001eg-T3@nostromo.freenet-ag.de>
In-Reply-To: <E1B1QkD-0001eg-T3@nostromo.freenet-ag.de>
Content-Type: text/plain; format=flowed
MIME-Version: 1.0
Date: Thu, 11 Mar 2004 15:28:38 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

Michael Haardt writes:
> If Sieve makes that promise, yes, but that's not what I was talking 
> about. I didn't talk about a privacy feature, either, but about a 
> convenience feature, and that's why I don't have a "privacy/security 
> issue".

It's a privacy/security issue the moment a user misunderstands, and 
relies on the feature.

>>  FWIW, I also don't like the idea of sieve managing folder 
>>  properties. That seems to be out of scope for sieve.
>
> That's a point I can understand. If Sieve focuses only on messages, 
> then manipulating persistent folder attributes would be simply out of 
> scope. Does it focus strictly on messages, not folders, despite 
> folders containing messages?

Yes. Sieve ignores folders almost entirely. (Except that fileinto may 
create a folder.)

> If so, how about message attributes to allow expiration to happen?

Much better.

Such attributes are called annotations in IMAPspeak, and they're 
supported by the ANNOTATE extension, which is itself still a draft and 
not terribly widely implemented. If there isn't yet a sieve extension 
to set a message annotation, there certainly should be.

Arnt



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BE1AqU066835; Thu, 11 Mar 2004 06:01:10 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BE1Add066834; Thu, 11 Mar 2004 06:01:10 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mout1.freenet.de (mout1.freenet.de [194.97.50.132]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BE199l066826 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 06:01:10 -0800 (PST) (envelope-from michael@freenet-ag.de)
Received: from [194.97.55.147] (helo=mx4.freenet.de) by mout1.freenet.de with asmtp (Exim 4.30) id 1B1QkE-00009x-8J for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 15:01:06 +0100
Received: from nostromo.freenet-ag.de ([194.97.7.6]) by mx4.freenet.de with esmtp (TLSv1:AES256-SHA:256) (Exim 4.303 #3) id 1B1QkE-000598-5R for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 15:01:06 +0100
Received: from michael by nostromo.freenet-ag.de with local (ID michael) (Exim 4.303 #3) id 1B1QkD-0001eg-T3 for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 15:01:05 +0100
To: ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
Message-Id: <E1B1QkD-0001eg-T3@nostromo.freenet-ag.de>
From: Michael Haardt <michael@freenet-ag.de>
Date: Thu, 11 Mar 2004 15:01:05 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> Sieve, as a language/protocol, must be held to stricter standards than 
> any single implementation.

I gave an example, where I know that expiry on delivery would be almost
for free, to show that there are alternatives to a regular cleanup job.
That's why I would allow both.

> If sieve makes the promise that a a mailbox should contain only the past 
> seven days' mail, users might reasonably rely on that.

If Sieve makes that promise, yes, but that's not what I was talking about.
I didn't talk about a privacy feature, either, but about a convenience
feature, and that's why I don't have a "privacy/security issue".

The feature I described is: Hey, MDA, you can throw messages in this
folder away after n days.  A great thing for subscribed newsletters.

> FWIW, I also don't like the idea of sieve managing folder properties. 
> That seems to be out of scope for sieve.

That's a point I can understand.  If Sieve focuses only on messages,
then manipulating persistent folder attributes would be simply out
of scope.  Does it focus strictly on messages, not folders, despite
folders containing messages?

If so, how about message attributes to allow expiration to happen?

Michael



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BD8AJS064540; Thu, 11 Mar 2004 05:08:10 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BD8Au6064539; Thu, 11 Mar 2004 05:08:10 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from kalyani.oryx.com (kalyani.oryx.com [212.125.101.207]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BD85WB064530 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 05:08:09 -0800 (PST) (envelope-from arnt@gulbrandsen.priv.no)
Received: from libertango.oryx.com (libertango.oryx.com [195.30.94.163]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by kalyani.oryx.com (Postfix) with ESMTP id 7F2001BDE23 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 14:07:53 +0100 (CET)
Message-Id: <T8/QRDrNYayQBwZkyBZVPw.md5@libertango.oryx.com>
From: Arnt Gulbrandsen <arnt@gulbrandsen.priv.no>
To: ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
References: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
In-Reply-To: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
Content-Type: text/plain; format=flowed
MIME-Version: 1.0
Date: Thu, 11 Mar 2004 14:08:52 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

Michael Haardt writes:
> The idea of a folder property versus a message property is 
> interesting, but indeed I thought about a folder property to be 
> specified by Sieve. Expiring mails on delivery is way more efficient 
> than daily jobs, because on many systems (e.g. maildir) the folder 
> contents are already in the page cache. Sieve, as MDA filter, 
> controls local delivery on my systems and if local delivery includes 
> expiration, it feels natural to control that, too.

Sieve, as a language/protocol, must be held to stricter standards than 
any single implementation.

If sieve makes the promise that a a mailbox should contain only the past 
seven days' mail, users might reasonably rely on that. If, then, no 
mail is delivered in seven days, the mailbox should STILL contain the 
past seven days' mail (that is, it should be empty). If expiry happens 
as part of delivery, older mail will still be retrievable.

If your implementation confuses delivery and expiry, that's okay. You 
have a privacy/security issue, that's all. But if the sieve language 
confuses them, all implementations do. Much worse.

FWIW, I also don't like the idea of sieve managing folder properties. 
That seems to be out of scope for sieve.

Arnt



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BBCPTw057544; Thu, 11 Mar 2004 03:12:27 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BBCPcN057543; Thu, 11 Mar 2004 03:12:25 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mout2.freenet.de (mout2.freenet.de [194.97.50.155]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BBCOAI057537 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 03:12:25 -0800 (PST) (envelope-from michael@freenet-ag.de)
Received: from [194.97.50.138] (helo=mx0.freenet.de) by mout2.freenet.de with asmtp (Exim 4.30) id 1B1O6y-0007ab-TK for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 12:12:24 +0100
Received: from nostromo.freenet-ag.de ([194.97.7.6]) by mx0.freenet.de with esmtp (TLSv1:AES256-SHA:256) (Exim 4.303 #2) id 1B1O6y-0000xJ-RG for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 12:12:24 +0100
Received: from michael by nostromo.freenet-ag.de with local (ID michael) (Exim 4.303 #3) id 1B1O6y-0001VV-9z for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 12:12:24 +0100
To: ietf-mta-filters@mail.imc.org
Subject: Re: Sieve extension to expire mails?
Message-Id: <E1B1O6y-0001VV-9z@nostromo.freenet-ag.de>
From: Michael Haardt <michael@freenet-ag.de>
Date: Thu, 11 Mar 2004 12:12:24 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> This is usually a folder property that a mailstore process removes messages
> based on. Do you want this to be a message property? I really see no reason
> why a sieve extension is needed for this, if you mark a message and the user
> prefers to remove such messages after x hours/days then it should be a
> function
> in the delivery process and mailstore cleanup?
>
> Or is sieve now more than a mta filter language?

The idea of a folder property versus a message property is interesting,
but indeed I thought about a folder property to be specified by Sieve.
Expiring mails on delivery is way more efficient than daily jobs, because
on many systems (e.g. maildir) the folder contents are already in the page
cache.  Sieve, as MDA filter, controls local delivery on my systems and if
local delivery includes expiration, it feels natural to control that, too.

Michael



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BAZH8b055063; Thu, 11 Mar 2004 02:35:17 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BAZHoQ055062; Thu, 11 Mar 2004 02:35:17 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from quasar.skima.is (quasar.skima.is [212.30.200.205]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BAZGpp055054 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 02:35:17 -0800 (PST) (envelope-from gsh@centrum.is)
Received: from AZ01663 ([192.147.34.142] [192.147.34.142]) by quasar.skima.is with ESMTP; Thu, 11 Mar 2004 10:35:09 Z
Message-Id: <003f01c40754$873b8a50$2a4115ac@siminn.is>
From: "=?iso-8859-1?Q?Gu=F0bj=F6rn_S._Hreinsson?=" <gsh@centrum.is>
To: <ietf-mta-filters@mail.imc.org>, "Michael Haardt" <michael@freenet-ag.de>
References: <E1B1NBa-0001RG-O0@nostromo.freenet-ag.de>
Subject: Re: Sieve extension to expire mails?
Date: Thu, 11 Mar 2004 10:35:09 -0000
MIME-Version: 1.0
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: 7bit
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

This is usually a folder property that a mailstore process removes messages
based on. Do you want this to be a message property? I really see no reason
why a sieve extension is needed for this, if you mark a message and the user
prefers to remove such messages after x hours/days then it should be a
function
in the delivery process and mailstore cleanup?

Or is sieve now more than a mta filter language?

Rgds,
-GSH

----- Original Message ----- 
From: "Michael Haardt" <michael@freenet-ag.de>
To: <ietf-mta-filters@mail.imc.org>
Sent: Thursday, March 11, 2004 10:13 AM
Subject: Sieve extension to expire mails?


>
> Hello,
>
> I use a spam scanner which tags mail, Sieve to filter it in folders and
> IMAP to access the folders, but I miss the function "keep mail up to n
> days in this folder", as offered by some mail providers, badly.
>
> For that reason, I would like opinions about a Sieve extension, which
> allows the mail system to expire mails older than a set amount of time.
> I say "allow", as the time of removal should not be specified.  Some
> systems may do so in daily cleanup jobs, others when delivering the mail.
>
> It is important that this function is not performed by the client,
> because I would like to come back from a longer vacation and have the
> last 7 days of a mailing list archived, not my mailbox flooded with it.
>
> I can think of different ways right now:
>
> Add an option to fileinto and keep, like:
>
>   fileinto :expire 7 "inbox.mailinglist";
>
> The advantage is probably easy implementation for cleanup on delivery,
> but the disadvantage is having to specify it multiple times, if a script
> files mail into that folder at different places, and more complicated
> implementation of daily clenaup jobs.  This approach is the opposite:
>
>   expire 7 "inbox.mailinglist";
>   [actual filter code inclduing fileinto ... ]
>
> Using expire to specify expiration times once at the beginning of the
> script is more modular.  Periodic jobs could extract that information
> easily and it separates folder attributes and filter logic.
>
> In case more attributes of folders are required, perhaps a generic
> statement would be useful:
>
>   folder :expire 7 "inbox.mailinglist";
>
> Do we need a better granularity than days? Does anybody have a better
> idea how to add this feature to Sieve?
>
> Michael
>
>



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BADHIb053927; Thu, 11 Mar 2004 02:13:17 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i2BADHW4053926; Thu, 11 Mar 2004 02:13:17 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mout1.freenet.de (exim@mout1.freenet.de [194.97.50.132]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i2BADEV4053908 for <ietf-mta-filters@mail.imc.org>; Thu, 11 Mar 2004 02:13:16 -0800 (PST) (envelope-from michael@freenet-ag.de)
Received: from [194.97.55.147] (helo=mx4.freenet.de) by mout1.freenet.de with asmtp (Exim 4.30) id 1B1NBb-0002Av-EG for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 11:13:07 +0100
Received: from nostromo.freenet-ag.de ([194.97.7.6]) by mx4.freenet.de with esmtp (TLSv1:AES256-SHA:256) (Exim 4.303 #3) id 1B1NBb-0001OH-Cm for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 11:13:07 +0100
Received: from michael by nostromo.freenet-ag.de with local (ID michael) (Exim 4.303 #3) id 1B1NBa-0001RG-O0 for ietf-mta-filters@mail.imc.org; Thu, 11 Mar 2004 11:13:06 +0100
To: ietf-mta-filters@mail.imc.org
Subject: Sieve extension to expire mails?
Message-Id: <E1B1NBa-0001RG-O0@nostromo.freenet-ag.de>
From: Michael Haardt <michael@freenet-ag.de>
Date: Thu, 11 Mar 2004 11:13:06 +0100
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

Hello,

I use a spam scanner which tags mail, Sieve to filter it in folders and
IMAP to access the folders, but I miss the function "keep mail up to n
days in this folder", as offered by some mail providers, badly.

For that reason, I would like opinions about a Sieve extension, which
allows the mail system to expire mails older than a set amount of time.
I say "allow", as the time of removal should not be specified.  Some
systems may do so in daily cleanup jobs, others when delivering the mail.

It is important that this function is not performed by the client,
because I would like to come back from a longer vacation and have the
last 7 days of a mailing list archived, not my mailbox flooded with it.

I can think of different ways right now:

Add an option to fileinto and keep, like:

  fileinto :expire 7 "inbox.mailinglist";

The advantage is probably easy implementation for cleanup on delivery,
but the disadvantage is having to specify it multiple times, if a script
files mail into that folder at different places, and more complicated
implementation of daily clenaup jobs.  This approach is the opposite:

  expire 7 "inbox.mailinglist";
  [actual filter code inclduing fileinto ... ]

Using expire to specify expiration times once at the beginning of the
script is more modular.  Periodic jobs could extract that information
easily and it separates folder attributes and filter logic.

In case more attributes of folders are required, perhaps a generic
statement would be useful:

  folder :expire 7 "inbox.mailinglist";

Do we need a better granularity than days? Does anybody have a better
idea how to add this feature to Sieve? 

Michael



Received: from above.proper.com (localhost.vpnc.org [127.0.0.1]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i28HeTLp084733; Mon, 8 Mar 2004 09:40:29 -0800 (PST) (envelope-from owner-ietf-mta-filters@mail.imc.org)
Received: (from majordom@localhost) by above.proper.com (8.12.11/8.12.9/Submit) id i28HeTFD084732; Mon, 8 Mar 2004 09:40:29 -0800 (PST)
X-Authentication-Warning: above.proper.com: majordom set sender to owner-ietf-mta-filters@mail.imc.org using -f
Received: from mauve.mrochek.com ([209.55.107.55]) by above.proper.com (8.12.11/8.12.8) with ESMTP id i28HeSod084726 for <ietf-mta-filters@imc.org>; Mon, 8 Mar 2004 09:40:28 -0800 (PST) (envelope-from ned.freed@mrochek.com)
Received: from mauve.mrochek.com by mauve.mrochek.com (PMDF V6.1-1 #35243) id <01L7DP2016Q80027NR@mauve.mrochek.com> for ietf-mta-filters@imc.org; Mon, 08 Mar 2004 09:40:30 -0800 (PST)
Date: Mon, 08 Mar 2004 09:22:25 -0800 (PST)
From: ned.freed@mrochek.com
Subject: Comments on draft-daboo-sieve-mime-00.txt
In-reply-to: "Your message dated Thu, 05 Feb 2004 20:42:55 -0500" <104800.1076013775@ninevah.cyrusoft.com>
To: Cyrus Daboo <daboo@cyrusoft.com>
Cc: IETF MTA Filters List <ietf-mta-filters@imc.org>
Message-id: <01L7HAGIBZLW0027NR@mauve.mrochek.com>
MIME-version: 1.0
Content-type: TEXT/PLAIN; CHARSET=us-ascii; format=flowed
Content-transfer-encoding: 7BIT
References: <104800.1076013775@ninevah.cyrusoft.com>
Sender: owner-ietf-mta-filters@mail.imc.org
Precedence: bulk
List-Archive: <http://www.imc.org/ietf-mta-filters/mail-archive/>
List-ID: <ietf-mta-filters.imc.org>
List-Unsubscribe: <mailto:ietf-mta-filters-request@imc.org?body=unsubscribe>

> FYI - the following is a draft for a new SIEVE operation for testing the
> content of MIME part headers. Comments welcome...

First let me say that I think the scope of this extension is right
on target - a simple mechanism that allows searching through embedded
part and message headers and which provides for simple checks against
media type and content disposition parammters is something we need.

Having said that, I think the specifics of how this was done aren't right.
First, as presently written this specification only extends the header test,
and it does so by creating an entirely new test. But there are two other tests
that are equally applicable to inner headers: exists and address. Either
similar "mimeexists" and "mimeaddress" tests need to be added (and perhaps
"mime" changed to "mimeheader"), or this needs to be done within the existing
tests by adding a :mime parameter. I'm indifferent as to which one of these
approaches is chosen, but we do need one of them.

Second, I really don't like the use of an optional middle parameter to specify
that the test is to be performed on a parameter value. This sort of thing is
why we have labelled parameters: It should be done as :parameter or something
similar. As for the use of a null parameter-names value to indicate a test of
non-paramer material, this can done with :parameter as well, but I do worry
that this is a bit tricky. OTOH, I haven't been able to come up with a
differenent way to do it that I like better.

Third, some references probably needs to be made to RFC 2231 and how to handle
encoded parameters. I think the right answer here is to handle this the same
way we already require that encoded words be handled.

A final implementation note. I threw together an implementation of this the
other day and I've already found it to be very useful. IMO this is an
extension we should try and advance sooner rather than later.

				Ned


