
From glen@amsl.com  Mon Nov  8 17:20:28 2010
Return-Path: <glen@amsl.com>
X-Original-To: tools-team@core3.amsl.com
Delivered-To: tools-team@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id CE5493A691A; Mon,  8 Nov 2010 17:20:28 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.599
X-Spam-Level: 
X-Spam-Status: No, score=-102.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Get7Fd3ZV5kr; Mon,  8 Nov 2010 17:20:27 -0800 (PST)
Received: from mail.amsl.com (mail.amsl.com [64.170.98.20]) by core3.amsl.com (Postfix) with ESMTP id DE8B83A689D; Mon,  8 Nov 2010 17:20:27 -0800 (PST)
Received: from localhost (localhost [127.0.0.1]) by c1a.amsl.com (Postfix) with ESMTP id E9942E08C2; Mon,  8 Nov 2010 17:20:50 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
Received: from c1a.amsl.com ([127.0.0.1]) by localhost (c1a.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7CAdijP5jQC7; Mon,  8 Nov 2010 17:20:50 -0800 (PST)
Received: from [192.168.1.100] (173-8-133-91-SFBA.hfc.comcastbusiness.net [173.8.133.91]) by c1a.amsl.com (Postfix) with ESMTPSA id 9FA6BE076A; Mon,  8 Nov 2010 17:20:50 -0800 (PST)
Message-ID: <4CD8A1EA.2050109@amsl.com>
Date: Mon, 08 Nov 2010 17:20:42 -0800
From: Glen Barney <glen@amsl.com>
Organization: AMS
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.12) Gecko/20101027 Lightning/1.0b2 Thunderbird/3.1.6
MIME-Version: 1.0
To: Henrik Levkowetz <henrik@levkowetz.com>,  "codesprints@ietf.org" <codesprints@ietf.org>, tools-development@ietf.org, tools-team@ietf.org
X-Enigmail-Version: 1.1.1
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Cc: Russ Housley <housley@vigilsec.com>
Subject: [Tools-team] Problem with I-D Announcements / Recent Datatracker Update
X-BeenThere: tools-team@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: "The purpose of the TOOLS team is to provide IETF feedback and guidance during the development of software tools to support various parts of IETF activities." <tools-team.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tools-team>
List-Post: <mailto:tools-team@ietf.org>
List-Help: <mailto:tools-team-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Nov 2010 01:20:28 -0000

Tools Team -

Please forgive the crossposting, but this is urgent.

We are getting reports that I-D-Announcements are not going out
correctly to the list.

One complainant indicated that the MIME headers were going out
malformed.  Other evidence suggests that some digest readers are getting
the digests, but individual list subscribers are getting no mail, or
blank mail, or invalid mail.

The old ID Submission Tool uses "NextPart" as a MIME boundary, which is
obviously very bad... but it has been doing that for the past 3+ years
with no problem.

Mailman has also been correctly handling those things for several years,
also with no problem.

The only thing which has changed in the processing chain recently is
that the Django Datatracker is now handling the processing of "Send
Scheduled Announcements" via this cron job:

*/15 * * * *    /a/www/ietf-datatracker/web/ietf/bin/send-scheduled-mail all

We implemented that change during the upload blackout before the IETF
meeting; all announcements since uploading reopened yesterday appear to
be problematic.

This is the reason I'm contacting these lists.  If someone could have a
look at this quickly, and determine what needs to be fixed, that would
be very helpful.

Thank you,
Glen


From glen@amsl.com  Mon Nov  8 17:54:44 2010
Return-Path: <glen@amsl.com>
X-Original-To: tools-team@core3.amsl.com
Delivered-To: tools-team@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 9E8C33A6928; Mon,  8 Nov 2010 17:54:44 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.599
X-Spam-Level: 
X-Spam-Status: No, score=-102.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0vcn5Cp7Vj7h; Mon,  8 Nov 2010 17:54:43 -0800 (PST)
Received: from mail.amsl.com (mail.amsl.com [64.170.98.20]) by core3.amsl.com (Postfix) with ESMTP id E8AB13A6898; Mon,  8 Nov 2010 17:54:43 -0800 (PST)
Received: from localhost (localhost [127.0.0.1]) by c1a.amsl.com (Postfix) with ESMTP id 45FFDE08C2; Mon,  8 Nov 2010 17:43:51 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
Received: from c1a.amsl.com ([127.0.0.1]) by localhost (c1a.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id kEo3DWjrt8pe; Mon,  8 Nov 2010 17:43:51 -0800 (PST)
Received: from [192.168.1.100] (173-8-133-91-SFBA.hfc.comcastbusiness.net [173.8.133.91]) by c1a.amsl.com (Postfix) with ESMTPSA id E8C93E0834; Mon,  8 Nov 2010 17:43:50 -0800 (PST)
Message-ID: <4CD8A74E.8050609@amsl.com>
Date: Mon, 08 Nov 2010 17:43:42 -0800
From: Glen Barney <glen@amsl.com>
Organization: AMS
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.12) Gecko/20101027 Lightning/1.0b2 Thunderbird/3.1.6
MIME-Version: 1.0
To: Henrik Levkowetz <henrik@levkowetz.com>,  "codesprints@ietf.org" <codesprints@ietf.org>, tools-development@ietf.org, tools-team@ietf.org
X-Enigmail-Version: 1.1.1
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Cc: Russ Housley <housley@vigilsec.com>
Subject: [Tools-team] Details Re: Problem with I-D Announcements / Recent Datatracker Update
X-BeenThere: tools-team@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: "The purpose of the TOOLS team is to provide IETF feedback and guidance during the development of software tools to support various parts of IETF activities." <tools-team.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tools-team>
List-Post: <mailto:tools-team@ietf.org>
List-Help: <mailto:tools-team-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Nov 2010 01:54:44 -0000

Further analysis shows that the I-D-Announcements, which are being sent
through the datatracker, are having their Content-type header case-squashed.

So the MIME boundary used by the current IDST is "NextPart".  But the
headers going out since we started using the datatracker sender are
squashed to "nextpart".  As a result, the NextPart boundaries are not
being recognized, and the message is going out with incorrect formatting.

More to follow!

Glen

From glen@amsl.com  Mon Nov  8 17:57:27 2010
Return-Path: <glen@amsl.com>
X-Original-To: tools-team@core3.amsl.com
Delivered-To: tools-team@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id DD6A63A68EF; Mon,  8 Nov 2010 17:57:27 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.599
X-Spam-Level: 
X-Spam-Status: No, score=-102.599 tagged_above=-999 required=5 tests=[AWL=0.000, BAYES_00=-2.599, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id fNvokZvrZK3W; Mon,  8 Nov 2010 17:57:27 -0800 (PST)
Received: from mail.amsl.com (mail.amsl.com [64.170.98.20]) by core3.amsl.com (Postfix) with ESMTP id 2E8513A6862; Mon,  8 Nov 2010 17:57:27 -0800 (PST)
Received: from localhost (localhost [127.0.0.1]) by c1a.amsl.com (Postfix) with ESMTP id 4FCACE08C2; Mon,  8 Nov 2010 17:57:50 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
Received: from c1a.amsl.com ([127.0.0.1]) by localhost (c1a.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id I08Y+1EzgOFp; Mon,  8 Nov 2010 17:57:50 -0800 (PST)
Received: from [192.168.1.100] (173-8-133-91-SFBA.hfc.comcastbusiness.net [173.8.133.91]) by c1a.amsl.com (Postfix) with ESMTPSA id F28B5E08C1; Mon,  8 Nov 2010 17:57:49 -0800 (PST)
Message-ID: <4CD8AA95.3010409@amsl.com>
Date: Mon, 08 Nov 2010 17:57:41 -0800
From: Glen Barney <glen@amsl.com>
Organization: AMS
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.12) Gecko/20101027 Lightning/1.0b2 Thunderbird/3.1.6
MIME-Version: 1.0
To: Henrik Levkowetz <henrik@levkowetz.com>,  "codesprints@ietf.org" <codesprints@ietf.org>, tools-development@ietf.org, tools-team@ietf.org
References: <4CD8A74E.8050609@amsl.com>
In-Reply-To: <4CD8A74E.8050609@amsl.com>
X-Enigmail-Version: 1.1.1
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Cc: Russ Housley <housley@vigilsec.com>
Subject: [Tools-team] [IETF] Re: Details Re: Problem with I-D Announcements / Recent Datatracker Update Update
X-BeenThere: tools-team@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: "The purpose of the TOOLS team is to provide IETF feedback and guidance during the development of software tools to support various parts of IETF activities." <tools-team.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tools-team>
List-Post: <mailto:tools-team@ietf.org>
List-Help: <mailto:tools-team-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Nov 2010 01:57:28 -0000

Let's try that again, shall we?  Thunderbird preselected the wrong address.

On 11/8/2010 5:43 PM, Glen Barney wrote:
> Further analysis shows that the I-D-Announcements, which are being sent
> through the datatracker, are having their Content-type header case-squashed.

As an emergency fix attempt, I have patched this file:
	ietf-datatracker/web/ietf/announcements/send_scheduled.py

I am going to monitor the next transmissions to see if this fixes anything.

More to follow,
Glen


From glen@amsl.com  Mon Nov  8 18:10:54 2010
Return-Path: <glen@amsl.com>
X-Original-To: tools-team@core3.amsl.com
Delivered-To: tools-team@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 4A6083A6911; Mon,  8 Nov 2010 18:10:54 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.599
X-Spam-Level: 
X-Spam-Status: No, score=-102.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id RFBsmI+l2j5s; Mon,  8 Nov 2010 18:10:53 -0800 (PST)
Received: from mail.amsl.com (mail.amsl.com [64.170.98.20]) by core3.amsl.com (Postfix) with ESMTP id 5C23A3A6A09; Mon,  8 Nov 2010 18:10:53 -0800 (PST)
Received: from localhost (localhost [127.0.0.1]) by c1a.amsl.com (Postfix) with ESMTP id 81229E08C2; Mon,  8 Nov 2010 18:11:16 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
Received: from c1a.amsl.com ([127.0.0.1]) by localhost (c1a.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YCRRT88IOBKz; Mon,  8 Nov 2010 18:11:16 -0800 (PST)
Received: from [192.168.1.100] (173-8-133-91-SFBA.hfc.comcastbusiness.net [173.8.133.91]) by c1a.amsl.com (Postfix) with ESMTPSA id 39BFEE0834; Mon,  8 Nov 2010 18:11:16 -0800 (PST)
Message-ID: <4CD8ADBB.8060909@amsl.com>
Date: Mon, 08 Nov 2010 18:11:07 -0800
From: Glen Barney <glen@amsl.com>
Organization: AMS
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.12) Gecko/20101027 Lightning/1.0b2 Thunderbird/3.1.6
MIME-Version: 1.0
To: ietf-announce@ietf.org, i-d-announce@ietf.org
X-Enigmail-Version: 1.1.1
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
X-Mailman-Approved-At: Mon, 08 Nov 2010 18:15:45 -0800
Subject: [Tools-team] Draft Announcement Service Restored
X-BeenThere: tools-team@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: "The purpose of the TOOLS team is to provide IETF feedback and guidance during the development of software tools to support various parts of IETF activities." <tools-team.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tools-team>
List-Post: <mailto:tools-team@ietf.org>
List-Help: <mailto:tools-team-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Nov 2010 02:10:54 -0000

All -

I have been unable to contact the Tools Team (they are probably all in
sessions right now!), so I put in a very unorthodox live patch to the
live datatracker, and that appears to have fixed the problem with broken
announcements.

To ensure that everyone receives everything, I am going to requeue all
the draft announcements that went out today.  I will continue to monitor
this, and will send a report to the tools team to let them know what I did.

Thank you all for your patience with this matter.

Glen
Glen Barney
IT Director
AMS (IETF Secretariat)

From glen@amsl.com  Mon Nov  8 18:31:59 2010
Return-Path: <glen@amsl.com>
X-Original-To: tools-team@core3.amsl.com
Delivered-To: tools-team@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 50CF528C18B; Mon,  8 Nov 2010 18:31:54 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.599
X-Spam-Level: 
X-Spam-Status: No, score=-102.599 tagged_above=-999 required=5 tests=[AWL=0.000, BAYES_00=-2.599, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id MJBdgl-uGnje; Mon,  8 Nov 2010 18:31:38 -0800 (PST)
Received: from mail.amsl.com (mail.amsl.com [64.170.98.20]) by core3.amsl.com (Postfix) with ESMTP id 1F26728C126; Mon,  8 Nov 2010 18:31:14 -0800 (PST)
Received: from localhost (localhost [127.0.0.1]) by c1a.amsl.com (Postfix) with ESMTP id 05836E08C1; Mon,  8 Nov 2010 18:31:37 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
Received: from c1a.amsl.com ([127.0.0.1]) by localhost (c1a.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id k5Heia3LhIi5; Mon,  8 Nov 2010 18:31:36 -0800 (PST)
Received: from [192.168.1.100] (173-8-133-91-SFBA.hfc.comcastbusiness.net [173.8.133.91]) by c1a.amsl.com (Postfix) with ESMTPSA id A8442E0834; Mon,  8 Nov 2010 18:31:36 -0800 (PST)
Message-ID: <4CD8B280.9060404@amsl.com>
Date: Mon, 08 Nov 2010 18:31:28 -0800
From: Glen Barney <glen@amsl.com>
Organization: AMS
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.12) Gecko/20101027 Lightning/1.0b2 Thunderbird/3.1.6
MIME-Version: 1.0
To: "codesprints@ietf.org" <codesprints@ietf.org>,  Russ Housley <housley@vigilsec.com>, Henrik Levkowetz <henrik@levkowetz.com>, tools-development@ietf.org,  tools-team@ietf.org
X-Enigmail-Version: 1.1.1
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Subject: [Tools-team] Datatracker Patch Report
X-BeenThere: tools-team@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: "The purpose of the TOOLS team is to provide IETF feedback and guidance during the development of software tools to support various parts of IETF activities." <tools-team.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tools-team>
List-Post: <mailto:tools-team@ietf.org>
List-Help: <mailto:tools-team-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Nov 2010 02:31:59 -0000

All -

An emergency patch has been applied to the live datatracker.  This is a
report on that patch.

We received reports today that Internet Draft announcements were not
being received by people.  Specifically, many people in regular
single-message-delivery mode were not receiving the email; however,
digest readers were receiving it.  One person reported that MIME headers
appeared to be malformed.

Nothing had changed on the AMS end since this was working.  The old ID
Submission Tool was not modified (except for a reopening-time patch,
which was not related), and mailman, postfix, and other MTA chain tools
were not modified.

What had changed, however, was that we were now processing scheduled
announcements through the datatracker.  I attempted to find Henrik, but
he was unavailable.  I did reach Robert Sparks, but he had not been
involved in this change.

I investigated backup copies of the messages on the server.  I found
that the Content-type header was being squashed to lowercase.  This was
causing the IDST "NextPart" boundary to be squashed in the header to
"nextpart".  This, in turn, was causing many MTAs (and MUAs) to fail to
receive and/or parse the message because of the malformed headers and
MIME structure.

Armed with this information I dove into the datatracker code.  I traced
things down to the following file:

	web/ietf/announcements/send_scheduled.py

Line 16 said this:
    content_type = announcement.content_type.lower()

I changed it to this:
    content_type = announcement.content_type

That was to fix the squashing, but I also noticed that later code
depended on that squashing:

Line 20 said this:
    elif 'multipart' in content_type:

Since the IDST injects records into the database with a Content Type of
"Multipart/Mixed" (instead of "multipart/mixed"), I changed it to this:
    elif 'ultipart' in content_type:

(I just removed the "M" from the test).

These two changes allowed I-D announcements to go through and be
processed and received correctly.  I then went in and requeued all the
sent mail in the database from November 1 onward, and all those messages
did subsequently get processed correctly.

Doubtless someone will want to go in and do a cleaner correction for
this problem - I was acting without Henrik's guidance on an emergency
basis, just to get those announcements fixed and flowing again.

Hopefully this information will facilitate a fix for the next update.
Sorry if I treaded on toes here but as I'm sure you understand, "In an
emergency, anything goes."  Please let me know if further information is
needed.

Thanks,
Glen

From glen@amsl.com  Mon Nov  8 19:30:24 2010
Return-Path: <glen@amsl.com>
X-Original-To: tools-team@core3.amsl.com
Delivered-To: tools-team@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 8216628C1B8; Mon,  8 Nov 2010 19:30:24 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.599
X-Spam-Level: 
X-Spam-Status: No, score=-102.599 tagged_above=-999 required=5 tests=[AWL=0.000, BAYES_00=-2.599, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id LszW7SSOXmNX; Mon,  8 Nov 2010 19:30:23 -0800 (PST)
Received: from mail.amsl.com (mail.amsl.com [64.170.98.20]) by core3.amsl.com (Postfix) with ESMTP id CF2E928C1A5; Mon,  8 Nov 2010 19:30:22 -0800 (PST)
Received: from localhost (localhost [127.0.0.1]) by c1a.amsl.com (Postfix) with ESMTP id 11D5CE08C2; Mon,  8 Nov 2010 19:30:46 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
Received: from c1a.amsl.com ([127.0.0.1]) by localhost (c1a.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id DW4rx0v36FFY; Mon,  8 Nov 2010 19:30:45 -0800 (PST)
Received: from [192.168.1.100] (173-8-133-91-SFBA.hfc.comcastbusiness.net [173.8.133.91]) by c1a.amsl.com (Postfix) with ESMTPSA id A6D27E076A; Mon,  8 Nov 2010 19:30:45 -0800 (PST)
Message-ID: <4CD8C05C.5090407@amsl.com>
Date: Mon, 08 Nov 2010 19:30:36 -0800
From: Glen Barney <glen@amsl.com>
Organization: AMS
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.12) Gecko/20101027 Lightning/1.0b2 Thunderbird/3.1.6
MIME-Version: 1.0
To: Tony Hansen <tony@att.com>
References: <4CD8B280.9060404@amsl.com> <4CD8BA99.3040907@att.com>
In-Reply-To: <4CD8BA99.3040907@att.com>
X-Enigmail-Version: 1.1.1
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Cc: tools-team@ietf.org, Russ Housley <housley@vigilsec.com>, Henrik Levkowetz <henrik@levkowetz.com>, "codesprints@ietf.org" <codesprints@ietf.org>, tools-development@ietf.org
Subject: Re: [Tools-team] [codesprints] Datatracker Patch Report
X-BeenThere: tools-team@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: "The purpose of the TOOLS team is to provide IETF feedback and guidance during the development of software tools to support various parts of IETF activities." <tools-team.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tools-team>
List-Post: <mailto:tools-team@ietf.org>
List-Help: <mailto:tools-team-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Nov 2010 03:30:24 -0000

On 11/8/2010 7:06 PM, Tony Hansen wrote:
> Your fix appears totally correct. Nit: I'm wondering if a better fix
> would be
>     elif 'multipart/' in content_type.lower()

I like that one better, yes.  I'll let Henrik figure out what he wants
to do with that.  :-)  Now that it's working, I don't want to touch it.  :-)

> Thanks for tracking the problem down Glen.
>     Tony

And thank you for the check!  :-)

Glen

From henrik@levkowetz.com  Mon Nov  8 22:24:07 2010
Return-Path: <henrik@levkowetz.com>
X-Original-To: tools-team@core3.amsl.com
Delivered-To: tools-team@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id E9C8F3A6875; Mon,  8 Nov 2010 22:24:06 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.543
X-Spam-Level: 
X-Spam-Status: No, score=-102.543 tagged_above=-999 required=5 tests=[AWL=0.057, BAYES_00=-2.599, NO_RELAYS=-0.001, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id I7tVgmdLpg+7; Mon,  8 Nov 2010 22:24:04 -0800 (PST)
Received: from merlot.tools.ietf.org (merlot.tools.ietf.org [IPv6:2a01:3f0:0:31:214:22ff:fe21:bb]) by core3.amsl.com (Postfix) with ESMTP id 6C1363A6874; Mon,  8 Nov 2010 22:24:04 -0800 (PST)
Received: from [2001:df8:0:96:21b:63ff:fecd:4021] (port=56071) by merlot.tools.ietf.org with esmtpsa (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.72) (envelope-from <henrik@levkowetz.com>) id 1PFhcg-0007Hd-5V; Tue, 09 Nov 2010 07:24:04 +0100
Message-ID: <4CD8E8FD.8060402@levkowetz.com>
Date: Tue, 09 Nov 2010 14:23:57 +0800
From: Henrik Levkowetz <henrik@levkowetz.com>
User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.2.8) Gecko/20100802 Thunderbird/3.1.2
MIME-Version: 1.0
To: Glen Barney <glen@amsl.com>
References: <4CD8A1EA.2050109@amsl.com>
In-Reply-To: <4CD8A1EA.2050109@amsl.com>
X-Enigmail-Version: 1.1.1
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
X-SA-Exim-Connect-IP: 2001:df8:0:96:21b:63ff:fecd:4021
X-SA-Exim-Rcpt-To: glen@amsl.com, codesprints@ietf.org, tools-development@ietf.org, tools-team@ietf.org, housley@vigilsec.com, henrik-sent@levkowetz.com
X-SA-Exim-Mail-From: henrik@levkowetz.com
X-SA-Exim-Version: 4.2.1 (built Mon, 22 Mar 2010 06:51:10 +0000)
X-SA-Exim-Scanned: Yes (on merlot.tools.ietf.org)
Cc: Russ Housley <housley@vigilsec.com>, tools-team@ietf.org, tools-development@ietf.org, "codesprints@ietf.org" <codesprints@ietf.org>
Subject: Re: [Tools-team] Problem with I-D Announcements / Recent Datatracker Update
X-BeenThere: tools-team@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: "The purpose of the TOOLS team is to provide IETF feedback and guidance during the development of software tools to support various parts of IETF activities." <tools-team.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tools-team>
List-Post: <mailto:tools-team@ietf.org>
List-Help: <mailto:tools-team-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tools-team>, <mailto:tools-team-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Nov 2010 06:24:07 -0000

Hi Glen,

I'll start looking at this at once.

Best,

	Henrik

On 2010-11-09 09:20 Glen Barney said the following:
> Tools Team -
> 
> Please forgive the crossposting, but this is urgent.
>
> We are getting reports that I-D-Announcements are not going out
> correctly to the list.
> 
> One complainant indicated that the MIME headers were going out
> malformed.  Other evidence suggests that some digest readers are getting
> the digests, but individual list subscribers are getting no mail, or
> blank mail, or invalid mail.
> 
> The old ID Submission Tool uses "NextPart" as a MIME boundary, which is
> obviously very bad... but it has been doing that for the past 3+ years
> with no problem.
> 
> Mailman has also been correctly handling those things for several years,
> also with no problem.
> 
> The only thing which has changed in the processing chain recently is
> that the Django Datatracker is now handling the processing of "Send
> Scheduled Announcements" via this cron job:
> 
> */15 * * * *    /a/www/ietf-datatracker/web/ietf/bin/send-scheduled-mail all
> 
> We implemented that change during the upload blackout before the IETF
> meeting; all announcements since uploading reopened yesterday appear to
> be problematic.
> 
> This is the reason I'm contacting these lists.  If someone could have a
> look at this quickly, and determine what needs to be fixed, that would
> be very helpful.
> 
> Thank you,
> Glen
> 
> 
