From testlist-bounces@mail.ietf.org Thu Jun 5 21:14:26 2008 Return-Path: X-Original-To: testlist-archive@ietf.org Delivered-To: ietfarch-testlist-archive@core3.amsl.com Received: from [127.0.0.1] (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 601093A6B8F; Thu, 5 Jun 2008 21:14:26 -0700 (PDT) X-Original-To: testlist@core3.amsl.com Delivered-To: testlist@core3.amsl.com Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id C89883A6B8F for ; Thu, 5 Jun 2008 21:14:24 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -100.495 X-Spam-Level: X-Spam-Status: No, score=-100.495 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, FH_RELAY_NODNS=1.451, HELO_MISMATCH_COM=0.553, RDNS_NONE=0.1, USER_IN_WHITELIST=-100] Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YY74WAR4OYQE for ; Thu, 5 Jun 2008 21:14:24 -0700 (PDT) Received: from mail.amsl.com (mail.amsl.com [IPv6:2001:1890:1112:1::14]) by core3.amsl.com (Postfix) with ESMTP id 42FBE3A6925 for ; Thu, 5 Jun 2008 21:14:21 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by thunder2.amsl.com (Postfix) with ESMTP id CA6FA4810B for ; Thu, 5 Jun 2008 21:14:47 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com Received: from mail.amsl.com ([64.170.98.20]) by localhost (thunder2.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0ArqGFPyeD8y for ; Thu, 5 Jun 2008 21:14:47 -0700 (PDT) Received: from Inbox (c-76-103-55-1.hsd1.ca.comcast.net [76.103.55.1]) by thunder2.amsl.com (Postfix) with ESMTP id C12FC48100 for ; Thu, 5 Jun 2008 21:14:46 -0700 (PDT) MIME-Version: 1.0 content-class: From: Glen Date: Thu, 5 Jun 2008 21:14:26 -0700 Importance: normal X-Priority: 3 To: Message-Id: <20080606041446.C12FC48100@thunder2.amsl.com> Subject: [testlist] Test X-BeenThere: testlist@mail.ietf.org X-Mailman-Version: 2.1.9 Precedence: list Reply-To: testlist@mail.ietf.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: testlist-bounces@mail.ietf.org Errors-To: testlist-bounces@mail.ietf.org Test, please ignore. _______________________________________________ Testlist mailing list Testlist@mail.ietf.org https://mail.ietf.org/mailman/listinfo/testlist From testlist-bounces@mail.ietf.org Thu Jun 26 15:08:54 2008 Return-Path: X-Original-To: testlist-archive@ietf.org Delivered-To: ietfarch-testlist-archive@core3.amsl.com Received: from [127.0.0.1] (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 27DD43A688D; Thu, 26 Jun 2008 15:08:54 -0700 (PDT) X-Original-To: testlist@core3.amsl.com Delivered-To: testlist@core3.amsl.com Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 1DE373A688D for ; Thu, 26 Jun 2008 15:04:57 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -100.495 X-Spam-Level: X-Spam-Status: No, score=-100.495 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, FH_RELAY_NODNS=1.451, HELO_MISMATCH_COM=0.553, RDNS_NONE=0.1, USER_IN_WHITELIST=-100] Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id auNsrOBzLsCA for ; Thu, 26 Jun 2008 15:04:56 -0700 (PDT) Received: from mail.amsl.com (mail.amsl.com [IPv6:2001:1890:1112:1::14]) by core3.amsl.com (Postfix) with ESMTP id 872623A687A for ; Thu, 26 Jun 2008 15:04:56 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by thunder2.amsl.com (Postfix) with ESMTP id 9EA7B48141 for ; Thu, 26 Jun 2008 15:05:05 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com Received: from mail.amsl.com ([64.170.98.20]) by localhost (thunder2.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id cwUR8CxoIsWt for ; Thu, 26 Jun 2008 15:05:05 -0700 (PDT) Received: from [64.170.98.103] (dv2500r1.c5i.net [64.170.98.103]) by thunder2.amsl.com (Postfix) with ESMTP id 714F848131 for ; Thu, 26 Jun 2008 15:05:05 -0700 (PDT) Message-ID: <4864128A.8000507@amsl.com> Date: Thu, 26 Jun 2008 15:04:58 -0700 From: Glen User-Agent: Thunderbird 2.0.0.14 (Windows/20080421) MIME-Version: 1.0 To: testlist@mail.ietf.org X-Enigmail-Version: 0.95.6 Subject: [testlist] Test 4 X-BeenThere: testlist@mail.ietf.org X-Mailman-Version: 2.1.9 Precedence: list Reply-To: testlist@mail.ietf.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: testlist-bounces@mail.ietf.org Errors-To: testlist-bounces@mail.ietf.org Test 4 _______________________________________________ Testlist mailing list Testlist@mail.ietf.org https://mail.ietf.org/mailman/listinfo/testlist From testlist-bounces@mail.ietf.org Fri Jun 27 10:04:26 2008 Return-Path: X-Original-To: testlist-archive@ietf.org Delivered-To: ietfarch-testlist-archive@core3.amsl.com Received: from [127.0.0.1] (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 8AB323A68B6; Fri, 27 Jun 2008 10:04:26 -0700 (PDT) X-Original-To: testlist@core3.amsl.com Delivered-To: testlist@core3.amsl.com Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id A12B73A68C8 for ; Fri, 27 Jun 2008 10:04:24 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -100.495 X-Spam-Level: X-Spam-Status: No, score=-100.495 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, FH_RELAY_NODNS=1.451, HELO_MISMATCH_COM=0.553, RDNS_NONE=0.1, USER_IN_WHITELIST=-100] Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jjqyMMMdVmef for ; Fri, 27 Jun 2008 10:04:23 -0700 (PDT) Received: from mail.amsl.com (mail.amsl.com [IPv6:2001:1890:1112:1::14]) by core3.amsl.com (Postfix) with ESMTP id 703B23A67AA for ; Fri, 27 Jun 2008 10:03:30 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by thunder2.amsl.com (Postfix) with ESMTP id CDAAD480FA for ; Fri, 27 Jun 2008 10:03:41 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com Received: from mail.amsl.com ([64.170.98.20]) by localhost (thunder2.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9jp+TytTQYE7 for ; Fri, 27 Jun 2008 10:03:41 -0700 (PDT) Received: from [192.168.1.100] (c-76-103-55-1.hsd1.ca.comcast.net [76.103.55.1]) by thunder2.amsl.com (Postfix) with ESMTP id 8EDAB480F1 for ; Fri, 27 Jun 2008 10:03:41 -0700 (PDT) Message-ID: <48651D66.6050002@amsl.com> Date: Fri, 27 Jun 2008 10:03:34 -0700 From: Glen User-Agent: Thunderbird 2.0.0.14 (Windows/20080421) MIME-Version: 1.0 To: testlist@mail.ietf.org X-Enigmail-Version: 0.95.6 Subject: [testlist] Test 6 X-BeenThere: testlist@mail.ietf.org X-Mailman-Version: 2.1.9 Precedence: list Reply-To: testlist@mail.ietf.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: testlist-bounces@mail.ietf.org Errors-To: testlist-bounces@mail.ietf.org Test 6 _______________________________________________ Testlist mailing list Testlist@mail.ietf.org https://mail.ietf.org/mailman/listinfo/testlist From testlist-bounces@mail.ietf.org Fri Jun 27 10:16:27 2008 Return-Path: X-Original-To: testlist-archive@ietf.org Delivered-To: ietfarch-testlist-archive@core3.amsl.com Received: from [127.0.0.1] (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 331703A68AB; Fri, 27 Jun 2008 10:16:27 -0700 (PDT) X-Original-To: testlist@core3.amsl.com Delivered-To: testlist@core3.amsl.com Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 189393A679F for ; Fri, 27 Jun 2008 10:16:26 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -101.547 X-Spam-Level: X-Spam-Status: No, score=-101.547 tagged_above=-999 required=5 tests=[AWL=1.052, BAYES_00=-2.599, USER_IN_WHITELIST=-100] Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0kbMzXauPdy1 for ; Fri, 27 Jun 2008 10:16:25 -0700 (PDT) Received: from mail.amsl.com (thunder.amsl.com [64.170.98.20]) by core3.amsl.com (Postfix) with ESMTP id 430313A67AA for ; Fri, 27 Jun 2008 10:16:25 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by thunder2.amsl.com (Postfix) with ESMTP id A9396480EE; Fri, 27 Jun 2008 10:16:36 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com Received: from mail.amsl.com ([64.170.98.20]) by localhost (thunder2.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ie1n+w2yQ-6p; Fri, 27 Jun 2008 10:16:36 -0700 (PDT) Received: from [192.168.1.100] (c-76-103-55-1.hsd1.ca.comcast.net [76.103.55.1]) by thunder2.amsl.com (Postfix) with ESMTP id 23354480FC; Fri, 27 Jun 2008 10:16:36 -0700 (PDT) Message-ID: <4865206C.3090007@amsl.com> Date: Fri, 27 Jun 2008 10:16:28 -0700 From: Glen User-Agent: Thunderbird 2.0.0.14 (Windows/20080421) MIME-Version: 1.0 To: Working Group Chairs , testlist@mail.ietf.org X-Enigmail-Version: 0.95.6 Subject: [testlist] TMDA / Outage X-BeenThere: testlist@mail.ietf.org X-Mailman-Version: 2.1.9 Precedence: list Reply-To: testlist@mail.ietf.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: testlist-bounces@mail.ietf.org Errors-To: testlist-bounces@mail.ietf.org Dear Working Group Chairs and Testers: We had an outage last night, and I felt it appropriate to contact the WGChairs list directly about this, because we have some lingering cleanup to do. So, first of all, we had an outage last night, once again because of TMDA. It seems that TMDA knows it's on the way out. Last night, an extreme spam run against many of the RT queues caused TMDA to overflow the server. This caused the anomalous behavior observed at 1:45 AM, and was quickly leading to a crash and reboot. To this I can only say that my objections against TMDA have been solid since day 1. The bad news is that two lists were damaged by this outage - the IETF list, and the SIP list. Because TMDA was eating everything alive, Mailman got a transient failure when it tried to read its databases for those two lists. Rather than just try again, mailman produced 3-year-old data from an old copy of the databases for those two lists, and "rebuilt" the two lists with the old data. By way of commentary, I find this behavior to be outrageous, but apparently that's what mailman does, and did. As a result, messages to those two lists form people who were suddenly not on the list went to moderation instead. Mail sent to those lists over the past couple of hours may not have been delivered to some individuals. And servers attempting to deliver mail during the 75-minute impact period may still be holding mail waiting on redelivery attempts. *sigh* I have restored the databases for those two lists from much more recent backups! However, messages did go to moderation, and it would probably be prudent to send a message out to IETF-ANNOUNCE or something asking people to check and correct their subscriptions on those two lists. The good news is that, yesterday, Henrik and I successfully installed his "postconfirm" TMDA replacement system, and implemented it on the testlist. We still want to do some followup testing today, but I think we're finally getting out of the woods with this TMDA abomination. So TMDA will be taken off, within the next day or so, and replaced with Henrik's system, which should put this ongoing stability issue, finally, to rest. In addition, of course, we are proceeding with the split of web and email, using the servers we received from NSS, and setting up a multiple-server structure for the IETF. We are finishing the data offload this week, and will begin the process of reloading servers next week. Configuration and testing will occur after that, and we expect to switch over to the new setup right after Dublin. I am now finish up final checks before I head into the office to work on Postconfirm with Henrik, who is visiting us this week. As always, any questions, please let me know. Glen _______________________________________________ Testlist mailing list Testlist@mail.ietf.org https://mail.ietf.org/mailman/listinfo/testlist