From nobody Tue Oct 30 20:15:23 2018 Return-Path: X-Original-To: sandbox-mailoutput@ietfa.amsl.com Delivered-To: sandbox-mailoutput@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id D0B471252B7 for ; Tue, 30 Oct 2018 20:15:20 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.107 X-Spam-Level: X-Spam-Status: No, score=-1.107 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RDNS_NONE=0.793, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id eTnwBfSSTq-a for ; Tue, 30 Oct 2018 20:15:19 -0700 (PDT) Received: from mailtest.ietf.org (unknown [4.31.198.57]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A6217124C04 for ; Tue, 30 Oct 2018 20:15:19 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by sandbox.amsl.com (Postfix) with ESMTP id 4EB161C2E3F for ; Tue, 30 Oct 2018 20:15:04 -0700 (PDT) X-Virus-Scanned: amavisd-new at mailtest.ietf.org Received: from mailtest.ietf.org ([4.31.198.57]) by localhost (mailtest.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id CjHQPnJHJxDz for ; Tue, 30 Oct 2018 20:15:02 -0700 (PDT) Received: from sandbox.amsl.com (localhost [IPv6:::1]) by sandbox.amsl.com (Postfix) with ESMTP id A5F141C2E3B for ; Tue, 30 Oct 2018 20:15:02 -0700 (PDT) Content-Type: multipart/mixed; boundary="===============8577806448237524360==" MIME-Version: 1.0 From: IETF Secretariat To: sandbox-mailoutput@ietf.org Message-ID: <154095570260.17250.5529338803797036678.idtracker@sandbox.amsl.com> Date: Tue, 30 Oct 2018 20:15:02 -0700 Archived-At: Subject: [Sandbox-mailoutput] [Django development] Datatracker State Update Notice: X-BeenThere: sandbox-mailoutput@ietf.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Oct 2018 03:15:21 -0000 --===============8577806448237524360== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit The attached message would have been sent, but the tracker is in development mode. It was not sent to anybody. --===============8577806448237524360== Content-Type: message/rfc822 MIME-Version: 1.0 MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit To: , Subject: Datatracker State Update Notice: X-Test-IDTracker: yes X-IETF-IDTracker: 6.87.2.dev0 Auto-Submitted: auto-generated Precedence: bulk Message-ID: <154095570259.17250.7589276931382381501.idtracker@sandbox.amsl.com> Date: Tue, 30 Oct 2018 20:15:02 -0700 From: IETF Secretariat State changed to Informal IESG review. Datatracker URL: https://datatracker.ietf.org/doc/charter-ietf-bmwg/ --===============8577806448237524360==-- From nobody Tue Oct 30 20:19:47 2018 Return-Path: X-Original-To: sandbox-mailoutput@ietfa.amsl.com Delivered-To: sandbox-mailoutput@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 7C4071252B7 for ; Tue, 30 Oct 2018 20:19:45 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.107 X-Spam-Level: X-Spam-Status: No, score=-1.107 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RDNS_NONE=0.793, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 8yv0qB9DGASE for ; Tue, 30 Oct 2018 20:19:44 -0700 (PDT) Received: from mailtest.ietf.org (unknown [4.31.198.57]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BDD21124C04 for ; Tue, 30 Oct 2018 20:19:44 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by sandbox.amsl.com (Postfix) with ESMTP id B03331C2E41 for ; Tue, 30 Oct 2018 20:19:44 -0700 (PDT) X-Virus-Scanned: amavisd-new at mailtest.ietf.org Received: from mailtest.ietf.org ([4.31.198.57]) by localhost (mailtest.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id S4jTP4NVPe1Y for ; Tue, 30 Oct 2018 20:19:43 -0700 (PDT) Received: from sandbox.amsl.com (localhost [IPv6:::1]) by sandbox.amsl.com (Postfix) with ESMTP id 528291C2E3F for ; Tue, 30 Oct 2018 20:19:43 -0700 (PDT) Content-Type: multipart/mixed; boundary="===============6828568387985655945==" MIME-Version: 1.0 From: IETF Secretariat To: sandbox-mailoutput@ietf.org Message-ID: <154095598333.18257.13332365477777601124.idtracker@sandbox.amsl.com> Date: Tue, 30 Oct 2018 20:19:43 -0700 Archived-At: Subject: [Sandbox-mailoutput] [Django development] Regarding WG bmwg: Charter state changed to "Internal review" X-BeenThere: sandbox-mailoutput@ietf.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Oct 2018 03:19:45 -0000 --===============6828568387985655945== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit The attached message would have been sent, but the tracker is in development mode. It was not sent to anybody. --===============6828568387985655945== Content-Type: message/rfc822 MIME-Version: 1.0 MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit To: Subject: Regarding WG bmwg: Charter state changed to "Internal review" X-Test-IDTracker: yes X-IETF-IDTracker: 6.87.2.dev0 Auto-Submitted: auto-generated Precedence: bulk Message-ID: <154095598333.18257.1774109600720496868.idtracker@sandbox.amsl.com> Date: Tue, 30 Oct 2018 20:19:43 -0700 From: IETF Secretariat The proposed charter for WG "Benchmarking Methodology" (bmwg) has been set to Internal review by Warren Kumari. Please place it on the next IESG telechat if it has not already been placed. WG: https://datatracker.ietf.org/wg/bmwg/about/ Charter: https://datatracker.ietf.org/doc/charter-ietf-bmwg/ --===============6828568387985655945==-- From nobody Tue Oct 30 20:19:54 2018 Return-Path: X-Original-To: sandbox-mailoutput@ietfa.amsl.com Delivered-To: sandbox-mailoutput@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B4F7D1252B7 for ; Tue, 30 Oct 2018 20:19:46 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.107 X-Spam-Level: X-Spam-Status: No, score=-1.107 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RDNS_NONE=0.793, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id eK5mGB1sLOoY for ; Tue, 30 Oct 2018 20:19:45 -0700 (PDT) Received: from mailtest.ietf.org (unknown [4.31.198.57]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id AA55D124C04 for ; Tue, 30 Oct 2018 20:19:45 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by sandbox.amsl.com (Postfix) with ESMTP id 9EFD01C2E3F for ; Tue, 30 Oct 2018 20:19:45 -0700 (PDT) X-Virus-Scanned: amavisd-new at mailtest.ietf.org Received: from mailtest.ietf.org ([4.31.198.57]) by localhost (mailtest.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qvQ96j_BVFeM for ; Tue, 30 Oct 2018 20:19:43 -0700 (PDT) Received: from sandbox.amsl.com (localhost [IPv6:::1]) by sandbox.amsl.com (Postfix) with ESMTP id 48C1F1C2E3B for ; Tue, 30 Oct 2018 20:19:43 -0700 (PDT) Content-Type: multipart/mixed; boundary="===============8301288265867630247==" MIME-Version: 1.0 From: IETF Secretariat To: sandbox-mailoutput@ietf.org Message-ID: <154095598320.18257.18053731430359308189.idtracker@sandbox.amsl.com> Date: Tue, 30 Oct 2018 20:19:43 -0700 Archived-At: Subject: [Sandbox-mailoutput] [Django development] Internal WG Review: Benchmarking Methodology (bmwg) X-BeenThere: sandbox-mailoutput@ietf.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Oct 2018 03:19:47 -0000 --===============8301288265867630247== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit The attached message would have been sent, but the tracker is in development mode. It was not sent to anybody. --===============8301288265867630247== Content-Type: message/rfc822 MIME-Version: 1.0 MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit From: IETF Secretariat To: "The IESG" , "The IAB" Subject: Internal WG Review: Benchmarking Methodology (bmwg) X-Test-IDTracker: yes X-IETF-IDTracker: 6.87.2.dev0 Auto-Submitted: auto-generated Precedence: bulk Reply-To: iesg@ietf.org Message-ID: <154095598320.18257.8673024919398907202.idtracker@sandbox.amsl.com> Date: Tue, 30 Oct 2018 20:19:43 -0700 A new charter for the Benchmarking Methodology (bmwg) WG in the Operations and Management Area of the IETF is being considered. The draft charter for this WG is provided below for your review and comment. Review time is one week. The IETF Secretariat Benchmarking Methodology (bmwg) ----------------------------------------------------------------------- Current status: Active WG Chairs: Sarah Banks Al Morton Assigned Area Director: Warren Kumari Operations and Management Area Directors: Warren Kumari Ignas Bagdonas Mailing list: Address: bmwg@ietf.org To subscribe: https://www.ietf.org/mailman/listinfo/bmwg Archive: https://mailarchive.ietf.org/arch/browse/bmwg/ Charter: https://datatracker.ietf.org/doc/charter-ietf-bmwg/ Test - The Benchmarking Methodology Working Group (BMWG) will continue to produce a series of recommendations concerning the key performance characteristics of internetworking technologies, or benchmarks for network devices, systems, and services. Taking a view of networking divided into planes, the scope of work includes benchmarks for the management, control, and forwarding planes. The scope of BMWG has been extended to develop methods for virtual network functions (VNF) and their unique supporting infrastructure (such as SDN Controllers and vSwitches). Benchmarks for platform capacity and performance characteristics of virtual routers, firewalls (and other security functions), signaling control gateways, and other forms of gateways are included. The benchmarks will foster comparisons between physical and virtual network functions, and also cover unique features of Network Function Virtualization systems. Also, with the emergence of virtualized test systems, specifications for test system calibration are also in-scope. Each recommendation will describe the class of network function, system, or service being addressed; discuss the performance characteristics that are pertinent to that class; clearly identify a set of metrics that aid in the description of those characteristics; specify the methodologies required to collect said metrics; and lastly, present the requirements for the common, unambiguous reporting of benchmarking results. The set of relevant benchmarks will be developed with input from the community of users (e.g., network operators and testing organizations) and from those affected by the benchmarks when they are published (networking and test equipment manufacturers). When possible, the benchmarks and other terminologies will be developed jointly with organizations that are willing to share their expertise. Joint review requirements for a specific work area will be included in the description of the task. To better distinguish the BMWG from other measurement initiatives in the IETF, the scope of the BMWG is limited to the characterization of implementations of various internetworking technologies using controlled stimuli in a laboratory environment. Said differently, the BMWG does not attempt to produce benchmarks for live, operational networks. Moreover, the benchmarks produced by this WG shall strive to be vendor independent or otherwise have universal applicability to a given technology class. Because the demands of a particular technology may vary from deployment to deployment, a specific non-goal of the Working Group is to define acceptance criteria or performance requirements. An ongoing task is to provide a forum for development and advancement of measurements which provide insight on the capabilities and operation of implementations of inter-networking technology. Ideally, BMWG should communicate with the operations community through organizations such as NANOG, RIPE, and APRICOT, and consult with/inform other IETF WGs (as is the current practice). Milestones: --===============8301288265867630247==-- From nobody Tue Oct 30 20:19:59 2018 Return-Path: X-Original-To: sandbox-mailoutput@ietfa.amsl.com Delivered-To: sandbox-mailoutput@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1792A12872C for ; Tue, 30 Oct 2018 20:19:48 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.107 X-Spam-Level: X-Spam-Status: No, score=-1.107 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RDNS_NONE=0.793, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=no autolearn_force=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Wuf2MLqZDxXB for ; Tue, 30 Oct 2018 20:19:47 -0700 (PDT) Received: from mailtest.ietf.org (unknown [4.31.198.57]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 02BBA124C04 for ; Tue, 30 Oct 2018 20:19:47 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by sandbox.amsl.com (Postfix) with ESMTP id EC00A1C2E3B for ; Tue, 30 Oct 2018 20:19:46 -0700 (PDT) X-Virus-Scanned: amavisd-new at mailtest.ietf.org Received: from mailtest.ietf.org ([4.31.198.57]) by localhost (mailtest.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id arjycSX5LS6B for ; Tue, 30 Oct 2018 20:19:44 -0700 (PDT) Received: from sandbox.amsl.com (localhost [IPv6:::1]) by sandbox.amsl.com (Postfix) with ESMTP id 5EC4F1C2E40 for ; Tue, 30 Oct 2018 20:19:43 -0700 (PDT) Content-Type: multipart/mixed; boundary="===============4553308187932316016==" MIME-Version: 1.0 From: IETF Secretariat To: sandbox-mailoutput@ietf.org Message-ID: <154095598338.18257.12265441705518828367.idtracker@sandbox.amsl.com> Date: Tue, 30 Oct 2018 20:19:43 -0700 Archived-At: Subject: [Sandbox-mailoutput] [Django development] Datatracker State Update Notice: X-BeenThere: sandbox-mailoutput@ietf.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Oct 2018 03:19:48 -0000 --===============4553308187932316016== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit The attached message would have been sent, but the tracker is in development mode. It was not sent to anybody. --===============4553308187932316016== Content-Type: message/rfc822 MIME-Version: 1.0 MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit To: , Subject: Datatracker State Update Notice: X-Test-IDTracker: yes X-IETF-IDTracker: 6.87.2.dev0 Auto-Submitted: auto-generated Precedence: bulk Message-ID: <154095598338.18257.17070746374957479206.idtracker@sandbox.amsl.com> Date: Tue, 30 Oct 2018 20:19:43 -0700 From: IETF Secretariat State changed to Internal review. Datatracker URL: https://datatracker.ietf.org/doc/charter-ietf-bmwg/ --===============4553308187932316016==--