
From nobody Mon Dec 18 07:36:01 2017
Return-Path: <cross@eantc.de>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 7F7501289B0 for <bmwg@ietfa.amsl.com>; Mon, 18 Dec 2017 07:35:59 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 0.001
X-Spam-Level: 
X-Spam-Status: No, score=0.001 tagged_above=-999 required=5 tests=[HTML_MESSAGE=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id lne7Egx_INsd for <bmwg@ietfa.amsl.com>; Mon, 18 Dec 2017 07:35:55 -0800 (PST)
Received: from obelix.eantc.de (mailgw.eantc.com [89.27.172.100]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 8771712708C for <bmwg@ietf.org>; Mon, 18 Dec 2017 07:35:55 -0800 (PST)
Received: from ns.eantc.de ([192.168.100.100] helo=localhost) by obelix.eantc.de with esmtp (Exim 4.80) (envelope-from <cross@eantc.de>) id 1eQxSJ-0006fH-Ka for bmwg@ietf.org; Mon, 18 Dec 2017 16:35:51 +0100
Received: from [192.168.100.5] (helo=[192.168.100.5]) by eantc.de with ESMTP (eXpurgate 4.1.9) (envelope-from <cross@eantc.de>) id 5a37e057-0fa5-c0a864640019-c0a86405e068-1 for <bmwg@ietf.org>; Mon, 18 Dec 2017 16:35:51 +0100
To: bmwg@ietf.org
References: <2e2f64cb-4c63-f7eb-f43b-33d9b1255cd1@eantc.de>
From: Carsten Rossenhoevel <cross@eantc.de>
Organization: EANTC AG
Message-ID: <44a149d0-9c97-3795-4c1c-aa30a93e9a55@eantc.de>
Date: Mon, 18 Dec 2017 16:35:51 +0100
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.4.0
MIME-Version: 1.0
In-Reply-To: <2e2f64cb-4c63-f7eb-f43b-33d9b1255cd1@eantc.de>
Content-Type: multipart/alternative; boundary="------------AB32E565A96E9EF7E92D3103"
Content-Language: en-US
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/4BWQUZg7PdeiXrpxP8HBrBVIO1Y>
Subject: [bmwg] First draft for next-gen firewall (NGFW) performance benchmarking uploaded
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 18 Dec 2017 15:35:59 -0000

This is a multi-part message in MIME format.
--------------AB32E565A96E9EF7E92D3103
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit

Dear Benchmarking Methodology WG,

My colleague Bala Balarajah has uploaded the first draft of the
next-generation firewall (NGFW) benchmarking methodology for your
review: draft-balarajah-bmwg-ngfw-performance-00
<https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00>. 

Currently the document contains sections for the test setup, test bed
preparation, reporting guidelines and test cases (complete TOC below). 
Please let us know specifically:

- How do you assess the first test case in section 7?  Its format and
level of details is meant to serve as a blueprint for additional test cases.

- What do you think about the test equipment configuration section,
specifically the traffic load profile and flows in section 4?

- Section 5 is a bit unusual as it defines test bed requirements for
minimum performance.  These were usually taken for granted in the past;
for virtualized test solutions they need to be made explicit we (Bala
and I) feel.

Any feedback and comments are very welcome!  Bala and I will process
them swiftly - either before Dec 22 or in the first week of January.

Best regards, Carsten



>
>    1
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-1>.  Introduction  . . . . . . . . . . . . . . . . . . . . . . . .   2
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-2>
>    2
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-2>.  Requirements  . . . . . . . . . . . . . . . . . . . . . . . .   2
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-2>
>    3
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-3>.  Scope . . . . . . . . . . . . . . . . . . . . . . . . . . . .   3
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-3>
>    4
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4>.  Test Setup  . . . . . . . . . . . . . . . . . . . . . . . . .   3
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-3>
>      4.1
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4.1>.  Testbed Configuration . . . . . . . . . . . . . . . . . .   3
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-3>
>      4.2
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4.2>.  DUT/SUT Configuration . . . . . . . . . . . . . . . . . .   4
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-4>
>      4.3
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4.3>.  Test Equipment Configuration  . . . . . . . . . . . . . .   6
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-6>
>        4.3.1
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4.3.1>.  Client Configuration  . . . . . . . . . . . . . . . .   7
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-7>
>        4.3.2
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4.3.2>.  Backend Server Configuration  . . . . . . . . . . . .   8
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-8>
>        4.3.3
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4.3.3>.  Traffic Flow Definition . . . . . . . . . . . . . . .   9
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-9>
>        4.3.4
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4.3.4>.  Traffic Load Profile  . . . . . . . . . . . . . . . .  10
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-10>
>    5
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-5>.  Test Bed Considerations . . . . . . . . . . . . . . . . . . .  11
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-11>
>    6
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-6>.  Reporting . . . . . . . . . . . . . . . . . . . . . . . . . .  12
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-12>
>      6.1
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-6.1>.  Key Performance Indicators  . . . . . . . . . . . . . . .  13
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-13>
>    7
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7>.  Benchmarking Tests  . . . . . . . . . . . . . . . . . . . . .  14
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-14>
>      7.1
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.1>.  Throughput Performance  . . . . . . . . . . . . . . . . .  15
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-15>
>        7.1.1
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.1.1>.  Objective . . . . . . . . . . . . . . . . . . . . . .  15
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-15>
>        7.1.2
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.1.2>.  Test Setup  . . . . . . . . . . . . . . . . . . . . .  15
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-15>
>        7.1.3
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.1.3>.  Test Parameters . . . . . . . . . . . . . . . . . . .  15
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-15>
>        7.1.4
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.1.4>.  Test Procedures and expected Results  . . . . . . . .  17
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-17>
>      7.2
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.2>.  TCP Concurrent Connection Capacity  . . . . . . . . . . .  18
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18>
>      7.3
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.3>.  TCP Connection Setup Rate . . . . . . . . . . . . . . . .  18
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18>
>      7.4
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.4>.  Application Transaction Rate  . . . . . . . . . . . . . .  18
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18>
>      7.5
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.5>.  SSL/TLS Handshake Rate  . . . . . . . . . . . . . . . . .  18
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18>
>    8
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-8>.  Formal Syntax . . . . . . . . . . . . . . . . . . . . . . . .  18
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18>
>    9
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-9>.  IANA Considerations . . . . . . . . . . . . . . . . . . . . .  18
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18>
>    10
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-10>. Security Considerations . . . . . . . . . . . . . . . . . . .  18
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18>
>    11
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-11>. Acknowledgements  . . . . . . . . . . . . . . . . . . . . . .  18
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18>
>    12
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-12>. Normative References  . . . . . . . . . . . . . . . . . . . .  18
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18>
>    Appendix A
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#appendix-A>.  An Appendix  . . . . . . . . . . . . . . . . . . . .  18
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18>
>    Author's Address  . . . . . . . . . . . . . . . . . . . . . . . .  19
> <https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-19>

On 16.11.2017 02:54, Carsten Rossenhoevel wrote:
>
> Dear BMWG,
>
> Recently, the multi-vendor, not-for-profit NetSecOPEN
> <http://www.netsecopen.org> initiative has been formed to innovate
> network security test methodology.  The network security vendors, test
> equipment manufacturers and test labs involved in the initiative aim
> to strongly improve the applicability, reproducibility and
> transparency of benchmarks for next-gen firewalls (NGFW), intrusion
> detection/prevention systems (IDS/IPS) and unified threat management
> (UTM) solutions.  NetSecOPEN is chaired by Brian Monkman (Cc'ed). 
>
> We currently develop test terminology, traffic profiles and
> benchmarking methodology for NGFWs to start with.  With the BMWG's
> consent, we would like to contribute our initial draft to BMWG and
> continue the standards development under this working group's guidance
> with the goal to create RFC(s).
>
> Some time next week we plan to submit the first draft for the WG's
> review.  Our contributions should proceed swiftly in November and
> December - hoping that there will be a lot to review and contribute to
> before the end of the year.  Any contributions are more than welcome -
> we really hope for peer review, contributions and innovative testing
> ideas from the BMWG!
>
> An early draft table of contents is listed below for your information
> (this is not a formal contribution).
>
> Best regards,
>     Carsten Rossenhoevel (EANTC CTO)
>     Balamuhunthan Balarajah (EANTC Senior Test Engineer)
>
> Table of Contents
>
> 1. Introduction    
> 2. Requirements    
> 3. Scope
> This document is focused on test methodology for network security device benchmarking tests in term of performance metrics.  It describes the test methodology to obtain reproducible test results independently using different vendor test equipment.  By defining a full set of test configuration parameters, this document will allow users to reproduce network performance measurements and compare measurements. The benchmarking tests focus a set of key performance indicators (KPI): throughput, transaction rates, concurrent connection, connection setup rate and SSL/TLS handshake rate. 
> Devices such as firewalls, Next Generation firewalls, intrusion detection and prevention devices, application delivery controllers, deep packet inspection devices and web application firewalls generally fall into the
> network security device category.  
>     
> 4. Test Setup
>     4.1. Testbed Configuration
>     4.2. DUT/SUT Configuration
>     4.3. Test Equipment Configuration
>    
> 5. Test Bed Calibration
>     
> 6. Reporting
>     6.1. Testbed Software and Hardware Details
>     6.2. Key Performance Indicators    
>
> 7. Benchmarking Tests   
>     7.1. Throughput Performance    
>     7.2. TCP Concurrent Connection Capacity    
>     7.3. TCP Connection Setup Rate    
>     7.4. Application Transaction Rate       
>     7.5. SSL/TLS Handshake Rate    
>       
> Appendix A. Traffic Mix Definition
> -- 
> Carsten Rossenhövel
> Managing Director, EANTC AG (European Advanced Networking Test Center)
> Salzufer 14, 10587 Berlin, Germany
> office +49.30.3180595-21, fax +49.30.3180595-10, mobile +49.177.2505721
> cross@eantc.de, http://www.eantc.de
>
> Place of Business/Sitz der Gesellschaft: Berlin, Germany
> Chairman/Vorsitzender des Aufsichtsrats: Herbert Almus
> Managing Directors/Vorstand: Carsten Rossenhövel, Gabriele Schrenk
> Registered: HRB 73694, Amtsgericht Charlottenburg, Berlin, Germany
> EU VAT No: DE812824025
>
>
> _______________________________________________
> bmwg mailing list
> bmwg@ietf.org
> https://www.ietf.org/mailman/listinfo/bmwg

-- 
Carsten Rossenhövel
Managing Director, EANTC AG (European Advanced Networking Test Center)
Salzufer 14, 10587 Berlin, Germany
office +49.30.3180595-21, fax +49.30.3180595-10, mobile +49.177.2505721
cross@eantc.de, http://www.eantc.de

Place of Business/Sitz der Gesellschaft: Berlin, Germany
Chairman/Vorsitzender des Aufsichtsrats: Herbert Almus
Managing Directors/Vorstand: Carsten Rossenhövel, Gabriele Schrenk
Registered: HRB 73694, Amtsgericht Charlottenburg, Berlin, Germany
EU VAT No: DE812824025


--------------AB32E565A96E9EF7E92D3103
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit

<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <p><font face="Calibri">Dear Benchmarking Methodology WG,</font></p>
    My colleague Bala Balarajah has uploaded the first draft of the
    next-generation firewall (NGFW) benchmarking methodology for your
    review: <a moz-do-not-send="true"
href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00">draft-balarajah-bmwg-ngfw-performance-00</a>. 
    <br>
    <br>
    Currently the document contains sections for the test setup, test
    bed preparation, reporting guidelines and test cases (complete TOC
    below).  Please let us know specifically:<br>
    <br>
    - How do you assess the first test case in section 7?  Its format
    and level of details is meant to serve as a blueprint for additional
    test cases.<br>
    <br>
    - What do you think about the test equipment configuration section,
    specifically the traffic load profile and flows in section 4?<br>
    <br>
    - Section 5 is a bit unusual as it defines test bed requirements for
    minimum performance.  These were usually taken for granted in the
    past; for virtualized test solutions they need to be made explicit
    we (Bala and I) feel. <br>
    <br>
    Any feedback and comments are very welcome!  Bala and I will process
    them swiftly - either before Dec 22 or in the first week of January.<br>
    <br>
    Best regards, Carsten <br>
    <br>
    <br>
    <br>
    <blockquote type="cite">
      <pre class="newpage" style="font-size: 13.3333px; margin-top: 0px; margin-bottom: 0px; break-before: page; color: rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;">

   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-1">1</a>.  Introduction  . . . . . . . . . . . . . . . . . . . . . . . .   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-2">2</a>
   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-2">2</a>.  Requirements  . . . . . . . . . . . . . . . . . . . . . . . .   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-2">2</a>
   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-3">3</a>.  Scope . . . . . . . . . . . . . . . . . . . . . . . . . . . .   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-3">3</a>
   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4">4</a>.  Test Setup  . . . . . . . . . . . . . . . . . . . . . . . . .   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-3">3</a>
     <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4.1">4.1</a>.  Testbed Configuration . . . . . . . . . . . . . . . . . .   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-3">3</a>
     <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4.2">4.2</a>.  DUT/SUT Configuration . . . . . . . . . . . . . . . . . .   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-4">4</a>
     <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4.3">4.3</a>.  Test Equipment Configuration  . . . . . . . . . . . . . .   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-6">6</a>
       <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4.3.1">4.3.1</a>.  Client Configuration  . . . . . . . . . . . . . . . .   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-7">7</a>
       <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4.3.2">4.3.2</a>.  Backend Server Configuration  . . . . . . . . . . . .   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-8">8</a>
       <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4.3.3">4.3.3</a>.  Traffic Flow Definition . . . . . . . . . . . . . . .   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-9">9</a>
       <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-4.3.4">4.3.4</a>.  Traffic Load Profile  . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-10">10</a>
   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-5">5</a>.  Test Bed Considerations . . . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-11">11</a>
   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-6">6</a>.  Reporting . . . . . . . . . . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-12">12</a>
     <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-6.1">6.1</a>.  Key Performance Indicators  . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-13">13</a>
   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7">7</a>.  Benchmarking Tests  . . . . . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-14">14</a>
     <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.1">7.1</a>.  Throughput Performance  . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-15">15</a>
       <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.1.1">7.1.1</a>.  Objective . . . . . . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-15">15</a>
       <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.1.2">7.1.2</a>.  Test Setup  . . . . . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-15">15</a>
       <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.1.3">7.1.3</a>.  Test Parameters . . . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-15">15</a>
       <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.1.4">7.1.4</a>.  Test Procedures and expected Results  . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-17">17</a>
     <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.2">7.2</a>.  TCP Concurrent Connection Capacity  . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18">18</a>
     <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.3">7.3</a>.  TCP Connection Setup Rate . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18">18</a>
     <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.4">7.4</a>.  Application Transaction Rate  . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18">18</a>
     <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-7.5">7.5</a>.  SSL/TLS Handshake Rate  . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18">18</a>
   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-8">8</a>.  Formal Syntax . . . . . . . . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18">18</a>
   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-9">9</a>.  IANA Considerations . . . . . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18">18</a>
   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-10">10</a>. Security Considerations . . . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18">18</a>
   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-11">11</a>. Acknowledgements  . . . . . . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18">18</a>
   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#section-12">12</a>. Normative References  . . . . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18">18</a>
   <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#appendix-A">Appendix A</a>.  An Appendix  . . . . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-18">18</a>
   Author's Address  . . . . . . . . . . . . . . . . . . . . . . . .  <a href="https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-00#page-19">19</a></pre>
    </blockquote>
    <br>
    <div class="moz-cite-prefix">On 16.11.2017 02:54, Carsten
      Rossenhoevel wrote:<br>
    </div>
    <blockquote type="cite"
      cite="mid:2e2f64cb-4c63-f7eb-f43b-33d9b1255cd1@eantc.de">
      <meta http-equiv="content-type" content="text/html; charset=utf-8">
      <p><font face="Calibri">Dear BMWG,</font></p>
      <p><font face="Calibri">Recently, the multi-vendor, not-for-profit
          <a moz-do-not-send="true" href="http://www.netsecopen.org">NetSecOPEN</a>
          initiative has been formed to innovate network security test
          methodology.  The network security vendors, test equipment
          manufacturers and test labs involved in the initiative aim to
          strongly improve the applicability, reproducibility and
          transparency of benchmarks for next-gen firewalls (NGFW),
          intrusion detection/prevention systems (IDS/IPS) and unified
          threat management (UTM) solutions.  NetSecOPEN is chaired by
          Brian Monkman (Cc'ed).  <br>
        </font></p>
      <p><font face="Calibri">We currently develop test terminology,
          traffic profiles and benchmarking methodology for NGFWs to
          start with.  With the BMWG's consent, we would like to
          contribute our initial draft to BMWG and continue the
          standards development under this working group's guidance with
          the goal to create RFC(s). <br>
        </font></p>
      <p><font face="Calibri">Some time next week we plan to submit the
          first draft for the WG's review.  Our contributions should
          proceed swiftly in November and December - hoping that there
          will be a lot to review and contribute to before the end of
          the year.  Any contributions are more than welcome - we really
          hope for peer review, contributions and innovative testing
          ideas from the BMWG!</font></p>
      <p><font face="Calibri">An early draft table of contents is listed
          below for your information (this is not a formal
          contribution).<br>
        </font></p>
      <p><font face="Calibri">Best regards,<br>
              Carsten Rossenhoevel (EANTC CTO)<br>
              Balamuhunthan Balarajah (EANTC Senior Test Engineer)<br>
        </font></p>
      <pre wrap="">Table of Contents

1. Introduction    
2. Requirements    
3. Scope
This document is focused on test methodology for network security device benchmarking tests in term of performance metrics.  It describes the test methodology to obtain reproducible test results independently using different vendor test equipment.  By defining a full set of test configuration parameters, this document will allow users to reproduce network performance measurements and compare measurements. The benchmarking tests focus a set of key performance indicators (KPI): throughput, transaction rates, concurrent connection, connection setup rate and SSL/TLS handshake rate. 
Devices such as firewalls, Next Generation firewalls, intrusion detection and prevention devices, application delivery controllers, deep packet inspection devices and web application firewalls generally fall into the
network security device category.  
    
4. Test Setup
    4.1. Testbed Configuration
    4.2. DUT/SUT Configuration
    4.3. Test Equipment Configuration
   
5. Test Bed Calibration
    
6. Reporting
    6.1. Testbed Software and Hardware Details
    6.2. Key Performance Indicators    

7. Benchmarking Tests   
    7.1. Throughput Performance    
    7.2. TCP Concurrent Connection Capacity    
    7.3. TCP Connection Setup Rate    
    7.4. Application Transaction Rate       
    7.5. SSL/TLS Handshake Rate    
      
Appendix A. Traffic Mix Definition</pre>
      <pre class="moz-signature" cols="72">-- 
Carsten Rossenhövel
Managing Director, EANTC AG (European Advanced Networking Test Center)
Salzufer 14, 10587 Berlin, Germany
office +49.30.3180595-21, fax +49.30.3180595-10, mobile +49.177.2505721
<a class="moz-txt-link-abbreviated" href="mailto:cross@eantc.de" moz-do-not-send="true">cross@eantc.de</a>, <a class="moz-txt-link-freetext" href="http://www.eantc.de" moz-do-not-send="true">http://www.eantc.de</a>

Place of Business/Sitz der Gesellschaft: Berlin, Germany
Chairman/Vorsitzender des Aufsichtsrats: Herbert Almus
Managing Directors/Vorstand: Carsten Rossenhövel, Gabriele Schrenk
Registered: HRB 73694, Amtsgericht Charlottenburg, Berlin, Germany
EU VAT No: DE812824025
</pre>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
bmwg mailing list
<a class="moz-txt-link-abbreviated" href="mailto:bmwg@ietf.org">bmwg@ietf.org</a>
<a class="moz-txt-link-freetext" href="https://www.ietf.org/mailman/listinfo/bmwg">https://www.ietf.org/mailman/listinfo/bmwg</a>
</pre>
    </blockquote>
    <br>
    <pre class="moz-signature" cols="72">-- 
Carsten Rossenhövel
Managing Director, EANTC AG (European Advanced Networking Test Center)
Salzufer 14, 10587 Berlin, Germany
office +49.30.3180595-21, fax +49.30.3180595-10, mobile +49.177.2505721
<a class="moz-txt-link-abbreviated" href="mailto:cross@eantc.de">cross@eantc.de</a>, <a class="moz-txt-link-freetext" href="http://www.eantc.de">http://www.eantc.de</a>

Place of Business/Sitz der Gesellschaft: Berlin, Germany
Chairman/Vorsitzender des Aufsichtsrats: Herbert Almus
Managing Directors/Vorstand: Carsten Rossenhövel, Gabriele Schrenk
Registered: HRB 73694, Amtsgericht Charlottenburg, Berlin, Germany
EU VAT No: DE812824025
</pre>
  </body>
</html>

--------------AB32E565A96E9EF7E92D3103--


From nobody Mon Dec 18 10:00:38 2017
Return-Path: <warren@kumari.net>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8D153129C6B for <bmwg@ietfa.amsl.com>; Mon, 18 Dec 2017 10:00:36 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 0
X-Spam-Level: 
X-Spam-Status: No, score=0 tagged_above=-999 required=5 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=kumari-net.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id i5ETtUz2_Cz8 for <bmwg@ietfa.amsl.com>; Mon, 18 Dec 2017 10:00:35 -0800 (PST)
Received: from mail-wr0-x234.google.com (mail-wr0-x234.google.com [IPv6:2a00:1450:400c:c0c::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 16BE1126D05 for <bmwg@ietf.org>; Mon, 18 Dec 2017 10:00:35 -0800 (PST)
Received: by mail-wr0-x234.google.com with SMTP id o2so15082299wro.5 for <bmwg@ietf.org>; Mon, 18 Dec 2017 10:00:35 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kumari-net.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to; bh=8AYzMYU++KBRpVCF2qXNsfW4NAu4jPISjxQDqEEP1YQ=; b=r5mtHVtYj8xqc8SS1keF0st8dYEaCe4vsN6oTE7IHoLY9dz+TvQ23H1nsM7P5qcswD NktCNMp+Mgly41vRnK7OBbleu/mIwZLRvGW0R3wYx5uQ0/o3O0/2gFkKNo3W2+HSTaMt Bw3p5b9OeNfMOhAwbYY5HpL4V8r34SB9uRAJcTEJH9TqUloDk3IrqBXCLMhkb+/afilZ myyosEK+O+wQMyEWZaYZvFAK6GjtKNOFUEnWbMzmmgX5/2xk5ZNJ/1D5ooKFsaOoxwHH 8+ggJE2Wk1aW1Au7MPFiuhZnY1prgMlakywMWaSONKZYaHAQ7W8czz8B94ZHTayehEkX jmng==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=8AYzMYU++KBRpVCF2qXNsfW4NAu4jPISjxQDqEEP1YQ=; b=rHfrpllvc4wL5/rx3tDhOofBRjL3fdcJiyLt2oty0Iwj2Dqusnj3V35ZtzMaC8VBu5 3u3zLJCo8cunP3fcHkzKWqj90EZsQxk7Y2X/QJPZBkWf932GecYnI+K8SVsrnupggujX Uir1Ru4UrLxiizRtxV8xOXqbcvPEyMbt4LqMoz4m07KlS4HDQmzg1GVorNyRmJj5K6Ax PaJbr+2IE/hEYkJhRpctUbNuLyiCvyBEqHcpvFo8TdL5iVGSD0Y8ReZZ51zd18Dywlfx iCowFR9bTtGPP8sIZjSbuMgu5wmAgQ5mHt2U82ep7itJvNWagei4eL38Xqgu3RQiDfh3 8p4g==
X-Gm-Message-State: AKGB3mKP/xDBIZFuqhTPcftjKRdu5njafiuYP7krWbYT71BxHNxG3FUj Ws8SZj7aQ5krqAGwqZ/sX2G4KTOFGsRomG6xVoBSYu4PMHI=
X-Google-Smtp-Source: ACJfBotoFSvRZMdmF6M/pCD1mo9HkFKxFqRzGGZsHLFD/T55sa4eeMqWjQUYdiOLEExvei4eEMofgyKgP+kdbuGLk4Q=
X-Received: by 10.223.170.4 with SMTP id p4mr815989wrd.109.1513620033004; Mon, 18 Dec 2017 10:00:33 -0800 (PST)
MIME-Version: 1.0
Received: by 10.223.160.149 with HTTP; Mon, 18 Dec 2017 09:59:51 -0800 (PST)
From: Warren Kumari <warren@kumari.net>
Date: Mon, 18 Dec 2017 12:59:51 -0500
Message-ID: <CAHw9_iKmPer65KBoTBs-sim0ZY5mxJY14ts-FHBUFhnVHB9QCg@mail.gmail.com>
To: bmwg@ietf.org
Content-Type: text/plain; charset="UTF-8"
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/Dvf2lWgp0Mn5vFPqFHXkwjsZQ-A>
Subject: [bmwg] Favor: Confirm Errata 5207
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 18 Dec 2017 18:00:36 -0000

Hi there all,

This errata looks correct to me, but before I validate it I wanted to
ask the WG to confirm I'm not missing anything obvious.

https://www.rfc-editor.org/errata/eid5207

If I don't hear anything to the contrary I'll mark it verified on Friday.

W

-- 
I don't think the execution is relevant when it was obviously a bad
idea in the first place.
This is like putting rabid weasels in your pants, and later expressing
regret at having chosen those particular rabid weasels and that pair
of pants.
   ---maf


From nobody Mon Dec 18 11:49:43 2017
Return-Path: <acmorton@att.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BA2541277BB for <bmwg@ietfa.amsl.com>; Mon, 18 Dec 2017 11:49:41 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.721
X-Spam-Level: 
X-Spam-Status: No, score=-0.721 tagged_above=-999 required=5 tests=[RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id q6jJqL7tIwS7 for <bmwg@ietfa.amsl.com>; Mon, 18 Dec 2017 11:49:40 -0800 (PST)
Received: from mx0a-00191d01.pphosted.com (mx0a-00191d01.pphosted.com [67.231.149.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 335CE120454 for <bmwg@ietf.org>; Mon, 18 Dec 2017 11:49:40 -0800 (PST)
Received: from pps.filterd (m0049295.ppops.net [127.0.0.1]) by m0049295.ppops.net-00191d01. (8.16.0.21/8.16.0.21) with SMTP id vBIJkHTZ014691; Mon, 18 Dec 2017 14:49:38 -0500
Received: from tlpd255.enaf.dadc.sbc.com (sbcsmtp3.sbc.com [144.160.112.28]) by m0049295.ppops.net-00191d01. with ESMTP id 2exk8s9ff6-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 18 Dec 2017 14:49:38 -0500
Received: from enaf.dadc.sbc.com (localhost [127.0.0.1]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id vBIJnach049789; Mon, 18 Dec 2017 13:49:37 -0600
Received: from dalint02.pst.cso.att.com (dalint02.pst.cso.att.com [135.31.133.160]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id vBIJnSU5049699 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 18 Dec 2017 13:49:29 -0600
Received: from zlp30493.vci.att.com (zlp30493.vci.att.com [135.46.181.176]) by dalint02.pst.cso.att.com (RSA Interceptor); Mon, 18 Dec 2017 19:49:20 GMT
Received: from zlp30493.vci.att.com (zlp30493.vci.att.com [127.0.0.1]) by zlp30493.vci.att.com (Service) with ESMTP id 2396C4000498; Mon, 18 Dec 2017 19:49:20 +0000 (GMT)
Received: from clpi183.sldc.sbc.com (unknown [135.41.1.46]) by zlp30493.vci.att.com (Service) with ESMTP id E6DBE4000492; Mon, 18 Dec 2017 19:49:19 +0000 (GMT)
Received: from sldc.sbc.com (localhost [127.0.0.1]) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id vBIJnJeD005677; Mon, 18 Dec 2017 13:49:19 -0600
Received: from mail-azure.research.att.com (mail-azure.research.att.com [135.207.255.18]) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id vBIJnCwi005336; Mon, 18 Dec 2017 13:49:15 -0600
Received: from exchange.research.att.com (njmtcas2.research.att.com [135.207.255.47]) by mail-azure.research.att.com (Postfix) with ESMTP id E0D40E3B79; Mon, 18 Dec 2017 14:49:11 -0500 (EST)
Received: from njmtexg4.research.att.com ([fe80::8cd:baa3:219e:5bd4]) by njmtcas2.research.att.com ([fe80::d550:ec84:f872:cad9%15]) with mapi id 14.03.0361.001; Mon, 18 Dec 2017 14:49:11 -0500
From: "MORTON, ALFRED C (AL)" <acmorton@att.com>
To: Warren Kumari <warren@kumari.net>, "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: [bmwg] Favor: Confirm Errata 5207
Thread-Index: AQHTeCojldxq6+I4r02d3maT83tvcaNJgTtw
Date: Mon, 18 Dec 2017 19:49:10 +0000
Message-ID: <4D7F4AD313D3FC43A053B309F97543CF4907B984@njmtexg4.research.att.com>
References: <CAHw9_iKmPer65KBoTBs-sim0ZY5mxJY14ts-FHBUFhnVHB9QCg@mail.gmail.com>
In-Reply-To: <CAHw9_iKmPer65KBoTBs-sim0ZY5mxJY14ts-FHBUFhnVHB9QCg@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
x-originating-ip: [73.178.187.36]
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-RSA-Inspected: yes
X-RSA-Classifications: public
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:, , definitions=2017-12-18_15:, , signatures=0
X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=870 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1711220000 definitions=main-1712180262
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/s4-y5UPkH_i9NzyxqGghXnRZaYI>
Subject: Re: [bmwg] Favor: Confirm Errata 5207
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 18 Dec 2017 19:49:42 -0000

Hi Warren,

I think the fix:

OLD
   The DUT SHOULD be able to respond to address resolution requests sent
   by the DUT wherever the protocol requires such a process.
NEW
   The DUT SHOULD be able to respond to address resolution requests sent
   by the tester wherever the protocol requires such a process.

is fine, but it would suggest that
NEW++
   The tester SHOULD be able to respond to address resolution requests sent
   by the DUT wherever the protocol requires such a process.

is also needed, for symmetry.

Al

> -----Original Message-----
> From: bmwg [mailto:bmwg-bounces@ietf.org] On Behalf Of Warren Kumari
> Sent: Monday, December 18, 2017 1:00 PM
> To: bmwg@ietf.org
> Subject: [bmwg] Favor: Confirm Errata 5207
>=20
> Hi there all,
>=20
> This errata looks correct to me, but before I validate it I wanted to
> ask the WG to confirm I'm not missing anything obvious.
>=20
> https://urldefense.proofpoint.com/v2/url?u=3Dhttps-3A__www.rfc-
> 2Deditor.org_errata_eid5207&d=3DDwICAg&c=3DLFYZ-
> o9_HUMeMTSQicvjIg&r=3DOfsSu8kTIltVyD1oL72cBw&m=3DbjjaUdU3P64iEA1Bgik69Sjn=
zDG
> 75gAiRQKHQje6bj8&s=3DAMJgPjE-e67R_B7CwNtTtd385iZHZryxhsF3IS_Sw3M&e=3D
>=20
> If I don't hear anything to the contrary I'll mark it verified on
> Friday.
>=20
> W
>=20
> --
> I don't think the execution is relevant when it was obviously a bad
> idea in the first place.
> This is like putting rabid weasels in your pants, and later expressing
> regret at having chosen those particular rabid weasels and that pair
> of pants.
>    ---maf
>=20
> _______________________________________________
> bmwg mailing list
> bmwg@ietf.org
> https://urldefense.proofpoint.com/v2/url?u=3Dhttps-
> 3A__www.ietf.org_mailman_listinfo_bmwg&d=3DDwICAg&c=3DLFYZ-
> o9_HUMeMTSQicvjIg&r=3DOfsSu8kTIltVyD1oL72cBw&m=3DbjjaUdU3P64iEA1Bgik69Sjn=
zDG
> 75gAiRQKHQje6bj8&s=3D67LX3SMcO-MP3Udz0Fe-zdJfPsMvHmhl73LQBBnvZwo&e=3D


From nobody Mon Dec 18 13:28:38 2017
Return-Path: <warren@kumari.net>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A42C112D940 for <bmwg@ietfa.amsl.com>; Mon, 18 Dec 2017 13:28:36 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 0
X-Spam-Level: 
X-Spam-Status: No, score=0 tagged_above=-999 required=5 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=kumari-net.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id tHLGJ5YC6TC0 for <bmwg@ietfa.amsl.com>; Mon, 18 Dec 2017 13:28:35 -0800 (PST)
Received: from mail-wr0-x234.google.com (mail-wr0-x234.google.com [IPv6:2a00:1450:400c:c0c::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id C31B512D890 for <bmwg@ietf.org>; Mon, 18 Dec 2017 13:28:34 -0800 (PST)
Received: by mail-wr0-x234.google.com with SMTP id l41so3575000wre.11 for <bmwg@ietf.org>; Mon, 18 Dec 2017 13:28:34 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kumari-net.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=wZKiVxpPOUj4sR7mU1pqhhZOJ6OsPhOKdTAx5qLvWDE=; b=NZ66i9mElcBDFHWT1V7RLkXVmtxUPb0d5VkXu/kphgsMZOEjX0+/N2ZJZRiSV1x8p4 v5mBJNDQ85bB/lLlYl+gdh/guvEZrBYt9qFUSQeJot7RSaXAySH681sPRGg2PzAicDdE BuRS3rcPn87hpv98NXHQ7/az48xnvn/yw/ZZR/2sPPgeFQ/l9AW6AoR5LGva4uvFjvza Uc8UJ6KWuz9FX317LI7D7ej0v8RUVVrEDHPzE0DsyxXpk9EKAy/9zVt/1UIryH+ysGgz MCurwG60bnEyBcq4dGljUuj+8AJIZJst+iLaQUctPskHw67Afk90Vt+1BqfqzZaxLdLG wBCA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=wZKiVxpPOUj4sR7mU1pqhhZOJ6OsPhOKdTAx5qLvWDE=; b=pL5eDsNnb6aj+MkwTNTpoqbV3oxptI6YwKzPX82iShpQhZ20xy9JufxS5sYc6HLLEI gmGnFw37tBvlGWDh3PqzaGx2fU7Txpk2EnkfmjKKmoyQw1X4fQ42mnUKeErDSNQYiM0F qF6RlchwSFqyHSqJWAmajbAkEJoyRG+7u9MLzZVvebIMdN+rPmdgYh9zmzzmKCC1GC+4 5QLjbQyyXVPIaAr+U8OfrXeoyDkZXrBcXv3IcCsnM0Dy2z3pHDKGHkDgbv5QLJqM3DiW /0blUfuE6MnEjhaxykzEvnN3GXVbGld1dXj+NlunQUv8ZEWxU3UKfutHuB/UGoH3QsI+ jCiQ==
X-Gm-Message-State: AKGB3mKELVRx1jkxGbFAFx7pMZFOjDfJ33RY1V3IOFx9nKAL36ZyftW9 ZVaIj7oyLnURPFSFbFSh9zDGZqm+SZNGF3gar0A+IA==
X-Google-Smtp-Source: ACJfBosG58XmzmP8jRAnQsIOJcLFFsixWkvr80q7WnciaKsY0otU4AeE284+5Ern8C7yktMzl7JtiSPYAf3dwqpAF54=
X-Received: by 10.223.201.139 with SMTP id f11mr1675798wrh.283.1513632512989;  Mon, 18 Dec 2017 13:28:32 -0800 (PST)
MIME-Version: 1.0
Received: by 10.223.160.149 with HTTP; Mon, 18 Dec 2017 13:27:51 -0800 (PST)
In-Reply-To: <4D7F4AD313D3FC43A053B309F97543CF4907B984@njmtexg4.research.att.com>
References: <CAHw9_iKmPer65KBoTBs-sim0ZY5mxJY14ts-FHBUFhnVHB9QCg@mail.gmail.com> <4D7F4AD313D3FC43A053B309F97543CF4907B984@njmtexg4.research.att.com>
From: Warren Kumari <warren@kumari.net>
Date: Mon, 18 Dec 2017 16:27:51 -0500
Message-ID: <CAHw9_iLpr3Oy1+6QcABZQvhP3_ZYqwGiqyWaAVVMDWAQciYviw@mail.gmail.com>
To: "MORTON, ALFRED C (AL)" <acmorton@att.com>
Cc: "bmwg@ietf.org" <bmwg@ietf.org>
Content-Type: text/plain; charset="UTF-8"
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/g4P8Z6BKf7ALzlqF0rDI0BdrRHk>
Subject: Re: [bmwg] Favor: Confirm Errata 5207
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 18 Dec 2017 21:28:36 -0000

On Mon, Dec 18, 2017 at 2:49 PM, MORTON, ALFRED C (AL) <acmorton@att.com> wrote:
> Hi Warren,
>
> I think the fix:
>
> OLD
>    The DUT SHOULD be able to respond to address resolution requests sent
>    by the DUT wherever the protocol requires such a process.
> NEW
>    The DUT SHOULD be able to respond to address resolution requests sent
>    by the tester wherever the protocol requires such a process.
>
> is fine, but it would suggest that
> NEW++
>    The tester SHOULD be able to respond to address resolution requests sent
>    by the DUT wherever the protocol requires such a process.
>
> is also needed, for symmetry.
>

While I agree with you, that it likely larger than an Errata can
cover, and would likely need a -bis document... :-(
W

> Al
>
>> -----Original Message-----
>> From: bmwg [mailto:bmwg-bounces@ietf.org] On Behalf Of Warren Kumari
>> Sent: Monday, December 18, 2017 1:00 PM
>> To: bmwg@ietf.org
>> Subject: [bmwg] Favor: Confirm Errata 5207
>>
>> Hi there all,
>>
>> This errata looks correct to me, but before I validate it I wanted to
>> ask the WG to confirm I'm not missing anything obvious.
>>
>> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.rfc-
>> 2Deditor.org_errata_eid5207&d=DwICAg&c=LFYZ-
>> o9_HUMeMTSQicvjIg&r=OfsSu8kTIltVyD1oL72cBw&m=bjjaUdU3P64iEA1Bgik69SjnzDG
>> 75gAiRQKHQje6bj8&s=AMJgPjE-e67R_B7CwNtTtd385iZHZryxhsF3IS_Sw3M&e=
>>
>> If I don't hear anything to the contrary I'll mark it verified on
>> Friday.
>>
>> W
>>
>> --
>> I don't think the execution is relevant when it was obviously a bad
>> idea in the first place.
>> This is like putting rabid weasels in your pants, and later expressing
>> regret at having chosen those particular rabid weasels and that pair
>> of pants.
>>    ---maf
>>
>> _______________________________________________
>> bmwg mailing list
>> bmwg@ietf.org
>> https://urldefense.proofpoint.com/v2/url?u=https-
>> 3A__www.ietf.org_mailman_listinfo_bmwg&d=DwICAg&c=LFYZ-
>> o9_HUMeMTSQicvjIg&r=OfsSu8kTIltVyD1oL72cBw&m=bjjaUdU3P64iEA1Bgik69SjnzDG
>> 75gAiRQKHQje6bj8&s=67LX3SMcO-MP3Udz0Fe-zdJfPsMvHmhl73LQBBnvZwo&e=



-- 
I don't think the execution is relevant when it was obviously a bad
idea in the first place.
This is like putting rabid weasels in your pants, and later expressing
regret at having chosen those particular rabid weasels and that pair
of pants.
   ---maf


From nobody Mon Dec 18 13:58:50 2017
Return-Path: <lucienav@google.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B3ECD12D945 for <bmwg@ietfa.amsl.com>; Mon, 18 Dec 2017 13:58:49 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.011
X-Spam-Level: 
X-Spam-Status: No, score=-2.011 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=google.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id LpFFxMZ4C0ue for <bmwg@ietfa.amsl.com>; Mon, 18 Dec 2017 13:58:47 -0800 (PST)
Received: from mail-pf0-x230.google.com (mail-pf0-x230.google.com [IPv6:2607:f8b0:400e:c00::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id CF92F124B0A for <bmwg@ietf.org>; Mon, 18 Dec 2017 13:58:47 -0800 (PST)
Received: by mail-pf0-x230.google.com with SMTP id a90so10262177pfk.1 for <bmwg@ietf.org>; Mon, 18 Dec 2017 13:58:47 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=V3DCPtE1miVNqClbKaBf7ve+ZQjorqE2AfPDEOkiSGo=; b=U/c3l2UbJECZPArw8pzd7Pf9Kj2qIBiJPrJ4u9slbkhPwvb70OnlDj/vOfH/SbMC4+ aAjBCcwrsMYx+3Eqq7HWY79dcr0OtnXr0ZC/HRU5sLz4/OTs1z0Sr/rVpcQX+uiWvz+0 QXup6UX2SPtLZoKmzPiqwwNtoowRNDzhvD+XDNlh7Aniiubu3VNarH5cu7pmDii6NLeZ Lh3o3wJhdPq1ewH3tPtumhU+MA5u4WvB9f4RELCVNVNHmm3zCzdqfZi+IHLkpuqwJAMr WbuP50YK6BpfKmi1B4lYjZIpQSg86SnJDlSrZ0QxLwm/ukGYPhy9ZXZXkLQpTudXOtEX RAWA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=V3DCPtE1miVNqClbKaBf7ve+ZQjorqE2AfPDEOkiSGo=; b=tFtbPfJXs5OWWlBhL3+BSx6YsP1onlvh5E2hCTn4B/9F3kQsm99zmdjmUhGF+cbEsE vBSm2vVpezCwLFQtHKXj1L37BPhS/Yel0W38/1Xb738rxnv8e1TRSo4MTxYij8VdR7mY d3CouSjas9k1glDeCrAlGeyEoRzSFpfaO8dnndTk2XAqL6bKeGWq5MkuLT5A7DNaASK9 U8EqDjd2TVdRkZXxNjMrokAOuDaQ7r/FYLhH/0dbf5BE1aHlPHhmlIGoNKjCDjXE8SMp 6S5DjObtjr04NwiPIwsghk1nQDvVJTtuxpfaxebYhyc9Jkf9WWUfdeo6lsVnB+E/jE4e TtMA==
X-Gm-Message-State: AKGB3mIYxMGg8FZMqNjur9mEo8yUzpKoWqqrSgsEEUTcixfg9QwsEq7V bGj5/tQ9+GkAAGFidzYHMIPxKF+iYGw=
X-Google-Smtp-Source: ACJfBou0aRiCVI87IamajmXG/mp1rlZZghdRCC5+XMhAFQTvEZBcqpTnA+hHh2/eNY3y9G0Phtid5w==
X-Received: by 10.99.149.4 with SMTP id p4mr923035pgd.73.1513634326806; Mon, 18 Dec 2017 13:58:46 -0800 (PST)
Received: from ?IPv6:2620:15c:2c3:fd00:6814:4cf:4beb:b453? ([2620:15c:2c3:fd00:6814:4cf:4beb:b453]) by smtp.gmail.com with ESMTPSA id w11sm6659239pgq.38.2017.12.18.13.58.45 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 18 Dec 2017 13:58:45 -0800 (PST)
Content-Type: text/plain; charset=utf-8
Mime-Version: 1.0 (1.0)
From: Lucien Avramov <lucienav@google.com>
X-Mailer: iPhone Mail (15C114)
In-Reply-To: <CAHw9_iLpr3Oy1+6QcABZQvhP3_ZYqwGiqyWaAVVMDWAQciYviw@mail.gmail.com>
Date: Mon, 18 Dec 2017 13:58:44 -0800
Cc: "MORTON, ALFRED C (AL)" <acmorton@att.com>, "bmwg@ietf.org" <bmwg@ietf.org>
Content-Transfer-Encoding: quoted-printable
Message-Id: <9A663BF0-CE45-483C-9788-641B22E63621@google.com>
References: <CAHw9_iKmPer65KBoTBs-sim0ZY5mxJY14ts-FHBUFhnVHB9QCg@mail.gmail.com> <4D7F4AD313D3FC43A053B309F97543CF4907B984@njmtexg4.research.att.com> <CAHw9_iLpr3Oy1+6QcABZQvhP3_ZYqwGiqyWaAVVMDWAQciYviw@mail.gmail.com>
To: Warren Kumari <warren@kumari.net>
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/cC5eMC26Z6Y0JHbvth11g_gUWpQ>
Subject: Re: [bmwg] Favor: Confirm Errata 5207
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 18 Dec 2017 21:58:49 -0000

Is it possible to try to submit Al=E2=80=99s suggestion and see if there are=
 issues with avoiding a -bis? His context is important.

Thank you,
Lucien

> On Dec 18, 2017, at 13:27, Warren Kumari <warren@kumari.net> wrote:
>=20
>> On Mon, Dec 18, 2017 at 2:49 PM, MORTON, ALFRED C (AL) <acmorton@att.com>=
 wrote:
>> Hi Warren,
>>=20
>> I think the fix:
>>=20
>> OLD
>>   The DUT SHOULD be able to respond to address resolution requests sent
>>   by the DUT wherever the protocol requires such a process.
>> NEW
>>   The DUT SHOULD be able to respond to address resolution requests sent
>>   by the tester wherever the protocol requires such a process.
>>=20
>> is fine, but it would suggest that
>> NEW++
>>   The tester SHOULD be able to respond to address resolution requests sen=
t
>>   by the DUT wherever the protocol requires such a process.
>>=20
>> is also needed, for symmetry.
>>=20
>=20
> While I agree with you, that it likely larger than an Errata can
> cover, and would likely need a -bis document... :-(
> W
>=20
>> Al
>>=20
>>> -----Original Message-----
>>> From: bmwg [mailto:bmwg-bounces@ietf.org] On Behalf Of Warren Kumari
>>> Sent: Monday, December 18, 2017 1:00 PM
>>> To: bmwg@ietf.org
>>> Subject: [bmwg] Favor: Confirm Errata 5207
>>>=20
>>> Hi there all,
>>>=20
>>> This errata looks correct to me, but before I validate it I wanted to
>>> ask the WG to confirm I'm not missing anything obvious.
>>>=20
>>> https://urldefense.proofpoint.com/v2/url?u=3Dhttps-3A__www.rfc-
>>> 2Deditor.org_errata_eid5207&d=3DDwICAg&c=3DLFYZ-
>>> o9_HUMeMTSQicvjIg&r=3DOfsSu8kTIltVyD1oL72cBw&m=3DbjjaUdU3P64iEA1Bgik69Sj=
nzDG
>>> 75gAiRQKHQje6bj8&s=3DAMJgPjE-e67R_B7CwNtTtd385iZHZryxhsF3IS_Sw3M&e=3D
>>>=20
>>> If I don't hear anything to the contrary I'll mark it verified on
>>> Friday.
>>>=20
>>> W
>>>=20
>>> --
>>> I don't think the execution is relevant when it was obviously a bad
>>> idea in the first place.
>>> This is like putting rabid weasels in your pants, and later expressing
>>> regret at having chosen those particular rabid weasels and that pair
>>> of pants.
>>>   ---maf
>>>=20
>>> _______________________________________________
>>> bmwg mailing list
>>> bmwg@ietf.org
>>> https://urldefense.proofpoint.com/v2/url?u=3Dhttps-
>>> 3A__www.ietf.org_mailman_listinfo_bmwg&d=3DDwICAg&c=3DLFYZ-
>>> o9_HUMeMTSQicvjIg&r=3DOfsSu8kTIltVyD1oL72cBw&m=3DbjjaUdU3P64iEA1Bgik69Sj=
nzDG
>>> 75gAiRQKHQje6bj8&s=3D67LX3SMcO-MP3Udz0Fe-zdJfPsMvHmhl73LQBBnvZwo&e=3D
>=20
>=20
>=20
> --=20
> I don't think the execution is relevant when it was obviously a bad
> idea in the first place.
> This is like putting rabid weasels in your pants, and later expressing
> regret at having chosen those particular rabid weasels and that pair
> of pants.
>   ---maf
>=20
> _______________________________________________
> bmwg mailing list
> bmwg@ietf.org
> https://www.ietf.org/mailman/listinfo/bmwg


From nobody Tue Dec 19 05:36:54 2017
Return-Path: <acmorton@att.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E8D941270AB for <bmwg@ietfa.amsl.com>; Tue, 19 Dec 2017 05:36:52 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.601
X-Spam-Level: 
X-Spam-Status: No, score=-2.601 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Ez7bJw1RPWRP for <bmwg@ietfa.amsl.com>; Tue, 19 Dec 2017 05:36:46 -0800 (PST)
Received: from mx0a-00191d01.pphosted.com (mx0b-00191d01.pphosted.com [67.231.157.136]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 67DF9127023 for <bmwg@ietf.org>; Tue, 19 Dec 2017 05:36:46 -0800 (PST)
Received: from pps.filterd (m0049462.ppops.net [127.0.0.1]) by m0049462.ppops.net-00191d01. (8.16.0.21/8.16.0.21) with SMTP id vBJDZLB5044161; Tue, 19 Dec 2017 08:36:44 -0500
Received: from tlpd255.enaf.dadc.sbc.com (sbcsmtp3.sbc.com [144.160.112.28]) by m0049462.ppops.net-00191d01. with ESMTP id 2ey2h01up3-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 19 Dec 2017 08:36:44 -0500
Received: from enaf.dadc.sbc.com (localhost [127.0.0.1]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id vBJDahJe028266; Tue, 19 Dec 2017 07:36:43 -0600
Received: from dalint02.pst.cso.att.com (dalint02.pst.cso.att.com [135.31.133.160]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id vBJDadZn028244 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Tue, 19 Dec 2017 07:36:39 -0600
Received: from zlp30495.vci.att.com (zlp30495.vci.att.com [135.46.181.158]) by dalint02.pst.cso.att.com (RSA Interceptor); Tue, 19 Dec 2017 13:36:32 GMT
Received: from zlp30495.vci.att.com (zlp30495.vci.att.com [127.0.0.1]) by zlp30495.vci.att.com (Service) with ESMTP id 8D4F040002C7; Tue, 19 Dec 2017 13:36:32 +0000 (GMT)
Received: from clpi183.sldc.sbc.com (unknown [135.41.1.46]) by zlp30495.vci.att.com (Service) with ESMTP id 6E7684000697; Tue, 19 Dec 2017 13:36:32 +0000 (GMT)
Received: from sldc.sbc.com (localhost [127.0.0.1]) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id vBJDaVub021968; Tue, 19 Dec 2017 07:36:32 -0600
Received: from mail-green.research.att.com (mail-green.research.att.com [135.207.255.15]) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id vBJDaPEJ021585; Tue, 19 Dec 2017 07:36:25 -0600
Received: from exchange.research.att.com (njmtcas2.research.att.com [135.207.255.47]) by mail-green.research.att.com (Postfix) with ESMTP id 2A8BAE4AD2; Tue, 19 Dec 2017 08:35:07 -0500 (EST)
Received: from njmtexg4.research.att.com ([fe80::8cd:baa3:219e:5bd4]) by njmtcas2.research.att.com ([fe80::d550:ec84:f872:cad9%15]) with mapi id 14.03.0361.001; Tue, 19 Dec 2017 08:36:23 -0500
From: "MORTON, ALFRED C (AL)" <acmorton@att.com>
To: Lucien Avramov <lucienav@google.com>, Warren Kumari <warren@kumari.net>
CC: "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: [bmwg] Favor: Confirm Errata 5207
Thread-Index: AQHTeCojldxq6+I4r02d3maT83tvcaNJgTtwgABwX4CAAAihAIAAsWIQ
Date: Tue, 19 Dec 2017 13:36:23 +0000
Message-ID: <4D7F4AD313D3FC43A053B309F97543CF4907BD23@njmtexg4.research.att.com>
References: <CAHw9_iKmPer65KBoTBs-sim0ZY5mxJY14ts-FHBUFhnVHB9QCg@mail.gmail.com> <4D7F4AD313D3FC43A053B309F97543CF4907B984@njmtexg4.research.att.com> <CAHw9_iLpr3Oy1+6QcABZQvhP3_ZYqwGiqyWaAVVMDWAQciYviw@mail.gmail.com> <9A663BF0-CE45-483C-9788-641B22E63621@google.com>
In-Reply-To: <9A663BF0-CE45-483C-9788-641B22E63621@google.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
x-originating-ip: [73.178.187.36]
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-RSA-Inspected: yes
X-RSA-Classifications: public
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:, , definitions=2017-12-19_07:, , signatures=0
X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1711220000 definitions=main-1712190196
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/ayEx21JJEGujEQf9zwl1C2IW9vU>
Subject: Re: [bmwg] Favor: Confirm Errata 5207
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 19 Dec 2017 13:36:53 -0000

SXQgb2NjdXJzIHRvIG1lIHRoYXQgSSBjb3VsZCBwdXQgaW4gYSBjb21wYXJhYmxlIGVycmF0YQ0K
dG8gZml4IHRoZSBzYW1lIHNlbnRlbmNlOg0KDQpPTEQNCiAgIFRoZSBEVVQgU0hPVUxEIGJlIGFi
bGUgdG8gcmVzcG9uZCB0byBhZGRyZXNzIHJlc29sdXRpb24gcmVxdWVzdHMgc2VudA0KICAgYnkg
dGhlIERVVCB3aGVyZXZlciB0aGUgcHJvdG9jb2wgcmVxdWlyZXMgc3VjaCBhIHByb2Nlc3MuDQpO
RVcNCiAgIFRoZSB0ZXN0ZXIgU0hPVUxEIGJlIGFibGUgdG8gcmVzcG9uZCB0byBhZGRyZXNzIHJl
c29sdXRpb24gcmVxdWVzdHMgc2VudA0KICAgYnkgdGhlIERVVCB3aGVyZXZlciB0aGUgcHJvdG9j
b2wgcmVxdWlyZXMgc3VjaCBhIHByb2Nlc3MuDQoNCmFuZCB0aGVuIHdlJ2xsIGhhdmUgYm90aCBw
b2ludHMgcmVjb3JkZWQgZm9yIHVwZGF0ZS4NCg0KSXMgdGhpcyB5b3VyIHByZWZlcnJlZCBjb3Vy
c2UsIFdhcnJlbj8NCkFsDQoNCj4gLS0tLS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0NCj4gRnJvbTog
THVjaWVuIEF2cmFtb3YgW21haWx0bzpsdWNpZW5hdkBnb29nbGUuY29tXQ0KPiBTZW50OiBNb25k
YXksIERlY2VtYmVyIDE4LCAyMDE3IDQ6NTkgUE0NCj4gVG86IFdhcnJlbiBLdW1hcmkNCj4gQ2M6
IE1PUlRPTiwgQUxGUkVEIEMgKEFMKTsgYm13Z0BpZXRmLm9yZw0KPiBTdWJqZWN0OiBSZTogW2Jt
d2ddIEZhdm9yOiBDb25maXJtIEVycmF0YSA1MjA3DQo+IA0KPiBJcyBpdCBwb3NzaWJsZSB0byB0
cnkgdG8gc3VibWl0IEFs4oCZcyBzdWdnZXN0aW9uIGFuZCBzZWUgaWYgdGhlcmUgYXJlDQo+IGlz
c3VlcyB3aXRoIGF2b2lkaW5nIGEgLWJpcz8gSGlzIGNvbnRleHQgaXMgaW1wb3J0YW50Lg0KPiAN
Cj4gVGhhbmsgeW91LA0KPiBMdWNpZW4NCj4gDQo+ID4gT24gRGVjIDE4LCAyMDE3LCBhdCAxMzoy
NywgV2FycmVuIEt1bWFyaSA8d2FycmVuQGt1bWFyaS5uZXQ+IHdyb3RlOg0KPiA+DQo+ID4+IE9u
IE1vbiwgRGVjIDE4LCAyMDE3IGF0IDI6NDkgUE0sIE1PUlRPTiwgQUxGUkVEIEMgKEFMKQ0KPiA8
YWNtb3J0b25AYXR0LmNvbT4gd3JvdGU6DQo+ID4+IEhpIFdhcnJlbiwNCj4gPj4NCj4gPj4gSSB0
aGluayB0aGUgZml4Og0KPiA+Pg0KPiA+PiBPTEQNCj4gPj4gICBUaGUgRFVUIFNIT1VMRCBiZSBh
YmxlIHRvIHJlc3BvbmQgdG8gYWRkcmVzcyByZXNvbHV0aW9uIHJlcXVlc3RzDQo+IHNlbnQNCj4g
Pj4gICBieSB0aGUgRFVUIHdoZXJldmVyIHRoZSBwcm90b2NvbCByZXF1aXJlcyBzdWNoIGEgcHJv
Y2Vzcy4NCj4gPj4gTkVXDQo+ID4+ICAgVGhlIERVVCBTSE9VTEQgYmUgYWJsZSB0byByZXNwb25k
IHRvIGFkZHJlc3MgcmVzb2x1dGlvbiByZXF1ZXN0cw0KPiBzZW50DQo+ID4+ICAgYnkgdGhlIHRl
c3RlciB3aGVyZXZlciB0aGUgcHJvdG9jb2wgcmVxdWlyZXMgc3VjaCBhIHByb2Nlc3MuDQo+ID4+
DQo+ID4+IGlzIGZpbmUsIGJ1dCBpdCB3b3VsZCBzdWdnZXN0IHRoYXQNCj4gPj4gTkVXKysNCj4g
Pj4gICBUaGUgdGVzdGVyIFNIT1VMRCBiZSBhYmxlIHRvIHJlc3BvbmQgdG8gYWRkcmVzcyByZXNv
bHV0aW9uIHJlcXVlc3RzDQo+IHNlbnQNCj4gPj4gICBieSB0aGUgRFVUIHdoZXJldmVyIHRoZSBw
cm90b2NvbCByZXF1aXJlcyBzdWNoIGEgcHJvY2Vzcy4NCj4gPj4NCj4gPj4gaXMgYWxzbyBuZWVk
ZWQsIGZvciBzeW1tZXRyeS4NCj4gPj4NCj4gPg0KPiA+IFdoaWxlIEkgYWdyZWUgd2l0aCB5b3Us
IHRoYXQgaXQgbGlrZWx5IGxhcmdlciB0aGFuIGFuIEVycmF0YSBjYW4NCj4gPiBjb3ZlciwgYW5k
IHdvdWxkIGxpa2VseSBuZWVkIGEgLWJpcyBkb2N1bWVudC4uLiA6LSgNCj4gPiBXDQo+ID4NCj4g
Pj4gQWwNCj4gPj4NCj4gPj4+IC0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tDQo+ID4+PiBGcm9t
OiBibXdnIFttYWlsdG86Ym13Zy1ib3VuY2VzQGlldGYub3JnXSBPbiBCZWhhbGYgT2YgV2FycmVu
IEt1bWFyaQ0KPiA+Pj4gU2VudDogTW9uZGF5LCBEZWNlbWJlciAxOCwgMjAxNyAxOjAwIFBNDQo+
ID4+PiBUbzogYm13Z0BpZXRmLm9yZw0KPiA+Pj4gU3ViamVjdDogW2Jtd2ddIEZhdm9yOiBDb25m
aXJtIEVycmF0YSA1MjA3DQo+ID4+Pg0KPiA+Pj4gSGkgdGhlcmUgYWxsLA0KPiA+Pj4NCj4gPj4+
IFRoaXMgZXJyYXRhIGxvb2tzIGNvcnJlY3QgdG8gbWUsIGJ1dCBiZWZvcmUgSSB2YWxpZGF0ZSBp
dCBJIHdhbnRlZA0KPiB0bw0KPiA+Pj4gYXNrIHRoZSBXRyB0byBjb25maXJtIEknbSBub3QgbWlz
c2luZyBhbnl0aGluZyBvYnZpb3VzLg0KPiA+Pj4NCj4gPj4+IGh0dHBzOi8vdXJsZGVmZW5zZS5w
cm9vZnBvaW50LmNvbS92Mi91cmw/dT1odHRwcy0zQV9fd3d3LnJmYy0NCj4gPj4+IDJEZWRpdG9y
Lm9yZ19lcnJhdGFfZWlkNTIwNyZkPUR3SUNBZyZjPUxGWVotDQo+ID4+Pg0KPiBvOV9IVU1lTVRT
UWljdmpJZyZyPU9mc1N1OGtUSWx0VnlEMW9MNzJjQncmbT1iamphVWRVM1A2NGlFQTFCZ2lrNjlT
am56REcNCj4gPj4+IDc1Z0FpUlFLSFFqZTZiajgmcz1BTUpnUGpFLWU2N1JfQjdDd050VHRkMzg1
aVpIWnJ5eGhzRjNJU19TdzNNJmU9DQo+ID4+Pg0KPiA+Pj4gSWYgSSBkb24ndCBoZWFyIGFueXRo
aW5nIHRvIHRoZSBjb250cmFyeSBJJ2xsIG1hcmsgaXQgdmVyaWZpZWQgb24NCj4gPj4+IEZyaWRh
eS4NCj4gPj4+DQo+ID4+PiBXDQo+ID4+Pg0KPiA+Pj4gLS0NCj4gPj4+IEkgZG9uJ3QgdGhpbmsg
dGhlIGV4ZWN1dGlvbiBpcyByZWxldmFudCB3aGVuIGl0IHdhcyBvYnZpb3VzbHkgYSBiYWQNCj4g
Pj4+IGlkZWEgaW4gdGhlIGZpcnN0IHBsYWNlLg0KPiA+Pj4gVGhpcyBpcyBsaWtlIHB1dHRpbmcg
cmFiaWQgd2Vhc2VscyBpbiB5b3VyIHBhbnRzLCBhbmQgbGF0ZXINCj4gZXhwcmVzc2luZw0KPiA+
Pj4gcmVncmV0IGF0IGhhdmluZyBjaG9zZW4gdGhvc2UgcGFydGljdWxhciByYWJpZCB3ZWFzZWxz
IGFuZCB0aGF0IHBhaXINCj4gPj4+IG9mIHBhbnRzLg0KPiA+Pj4gICAtLS1tYWYNCj4gPj4+DQo+
ID4+PiBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXw0KPiA+
Pj4gYm13ZyBtYWlsaW5nIGxpc3QNCj4gPj4+IGJtd2dAaWV0Zi5vcmcNCj4gPj4+IGh0dHBzOi8v
dXJsZGVmZW5zZS5wcm9vZnBvaW50LmNvbS92Mi91cmw/dT1odHRwcy0NCj4gPj4+IDNBX193d3cu
aWV0Zi5vcmdfbWFpbG1hbl9saXN0aW5mb19ibXdnJmQ9RHdJQ0FnJmM9TEZZWi0NCj4gPj4+DQo+
IG85X0hVTWVNVFNRaWN2aklnJnI9T2ZzU3U4a1RJbHRWeUQxb0w3MmNCdyZtPWJqamFVZFUzUDY0
aUVBMUJnaWs2OVNqbnpERw0KPiA+Pj4gNzVnQWlSUUtIUWplNmJqOCZzPTY3TFgzU01jTy1NUDNV
ZHowRmUtemRKZlBzTXZIbWhsNzNMUUJCbnZad28mZT0NCj4gPg0KPiA+DQo+ID4NCj4gPiAtLQ0K
PiA+IEkgZG9uJ3QgdGhpbmsgdGhlIGV4ZWN1dGlvbiBpcyByZWxldmFudCB3aGVuIGl0IHdhcyBv
YnZpb3VzbHkgYSBiYWQNCj4gPiBpZGVhIGluIHRoZSBmaXJzdCBwbGFjZS4NCj4gPiBUaGlzIGlz
IGxpa2UgcHV0dGluZyByYWJpZCB3ZWFzZWxzIGluIHlvdXIgcGFudHMsIGFuZCBsYXRlciBleHBy
ZXNzaW5nDQo+ID4gcmVncmV0IGF0IGhhdmluZyBjaG9zZW4gdGhvc2UgcGFydGljdWxhciByYWJp
ZCB3ZWFzZWxzIGFuZCB0aGF0IHBhaXINCj4gPiBvZiBwYW50cy4NCj4gPiAgIC0tLW1hZg0KPiA+
DQo+ID4gX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18NCj4g
PiBibXdnIG1haWxpbmcgbGlzdA0KPiA+IGJtd2dAaWV0Zi5vcmcNCj4gPiBodHRwczovL3VybGRl
ZmVuc2UucHJvb2Zwb2ludC5jb20vdjIvdXJsP3U9aHR0cHMtDQo+IDNBX193d3cuaWV0Zi5vcmdf
bWFpbG1hbl9saXN0aW5mb19ibXdnJmQ9RHdJRmFRJmM9TEZZWi0NCj4gbzlfSFVNZU1UU1FpY3Zq
SWcmcj1PZnNTdThrVElsdFZ5RDFvTDcyY0J3Jm09NTIwNGZIR3lXTkRiVEYyUmpTMVdNMlZWZ3Fr
DQo+IDN6R3lRd0RydEJUUnhhMEUmcz1IZi1kUHZGYjZHcVU5Tjl2SDZsLVA0c0M3eEpaRzAzanZ4
NkhZVjd1LUtBJmU9DQo=


From nobody Thu Dec 21 13:01:17 2017
Return-Path: <session-request@ietf.org>
X-Original-To: bmwg@ietf.org
Delivered-To: bmwg@ietfa.amsl.com
Received: from ietfa.amsl.com (localhost [IPv6:::1]) by ietfa.amsl.com (Postfix) with ESMTP id 7FA071243F3; Thu, 21 Dec 2017 13:01:15 -0800 (PST)
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 7bit
From: IETF Meeting Session Request Tool <session-request@ietf.org>
To: <session-request@ietf.org>
Cc: warren@kumari.net, bmwg-chairs@ietf.org, acmorton@att.com, bmwg@ietf.org
X-Test-IDTracker: no
X-IETF-IDTracker: 6.68.0
Auto-Submitted: auto-generated
Precedence: bulk
Message-ID: <151389007547.12838.9193410247969695791.idtracker@ietfa.amsl.com>
Date: Thu, 21 Dec 2017 13:01:15 -0800
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/go2dLz5Z8uhEloOqkwKNOXZK1qc>
Subject: [bmwg] bmwg - New Meeting Session Request for IETF 101
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 21 Dec 2017 21:01:16 -0000

A new meeting session request has just been submitted by Al Morton, a Chair of the bmwg working group.


---------------------------------------------------------
Working Group Name: Benchmarking Methodology
Area Name: Operations and Management Area
Session Requester: Al Morton

Number of Sessions: 1
Length of Session(s):  2 Hours
Number of Attendees: 30
Conflicts to Avoid: 
 First Priority: sfc tictoc tsvwg idr nfvrg ippm quic ntp
 Second Priority: saag rmcat tsvarea xrblock irtfopen



People who must be present:
  Al Morton
  Sarah Banks
  Warren Kumari

Resources Requested:
  Experimental Room Setup (U-Shape and classroom, subject to availability)

Special Requests:
  Much better participation when session NOT on Friday

---------------------------------------------------------


From nobody Sat Dec 30 17:29:52 2017
Return-Path: <warren@kumari.net>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A09E7126C83 for <bmwg@ietfa.amsl.com>; Sat, 30 Dec 2017 17:29:50 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.6
X-Spam-Level: 
X-Spam-Status: No, score=-2.6 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_LOW=-0.7] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=kumari-net.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id lzGQs2LGZG79 for <bmwg@ietfa.amsl.com>; Sat, 30 Dec 2017 17:29:48 -0800 (PST)
Received: from mail-wm0-x22e.google.com (mail-wm0-x22e.google.com [IPv6:2a00:1450:400c:c09::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1D03A1200FC for <bmwg@ietf.org>; Sat, 30 Dec 2017 17:29:47 -0800 (PST)
Received: by mail-wm0-x22e.google.com with SMTP id a79so14253341wma.0 for <bmwg@ietf.org>; Sat, 30 Dec 2017 17:29:47 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kumari-net.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=hn0lT8ba5JcIJuRC1Sw1w/7k5U29TuNH8VZK4Mlosyw=; b=p7L4gQRwhP+XgE0gk/KlIOG5pjMekQJfOgMpq3JFg9R+d+LFOXkhrYopyVokIyHnEL S8i+LcRAgehUy+G5c3chOfuT+O5y3uTFhZFtvP818IORxXgHzSRolGf3jEn/EkpA12d8 XLVHrAgW8CgaQdqYrFOx4Dwbz/BRrZk4TrAH6X4d4h3XH3fT7gdPgX5gs3rReISk9x1J 7uNwj+rMky/WfyL3dTbcQRH9dm87fdSrUdUQg6wH8lIyeY1kOMqDA2dPSqfjeumykIEy BFzH8ZhFQC9HSpBF6jjHfFnqpCMisBeICOYeyNY9S1psUzEik1CAJ7GK9yKdFgp9eyzz vX9Q==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=hn0lT8ba5JcIJuRC1Sw1w/7k5U29TuNH8VZK4Mlosyw=; b=RTyBR4ye5Qip+5CVKxGGPamu2QM7VVfyNUiY9qOdhpqyXXS6lcEGnfXEBgoSafN0FR 7YqPnSskJiWPzVvMNbNeUuEQdyU5KiJvHh2SUeJg/DM9CENrh2osIfVP+9zjF6IIEOj1 nKut9Ww9Udj3MY9DTFN8SgxXc1FftNoL2VeQnUBmR5mf7jwoRUd/7FSB98BeLfgF2hAd JaxssbHHa2qovnsIUtvDXRcoPpdarLvS7FA2oni1CyFnVIp1ImYzOKOGJ3twBzMqp+28 I0RSZZ/H964cgea015nS8Up1QLljM1aLy7KFr7qgmjdOvhZOFYpRJKp4XgVgTf3AGudK ExBA==
X-Gm-Message-State: AKGB3mJ+DdEPrR0YbwlbWGwrF4E0x32fA7CzvakX1KUrj4/jDv6gyN4f 6xK/agQwvfL6Lyzlv9XaLt3CQwIndNKBRsCbQRox8w==
X-Google-Smtp-Source: ACJfBov4ENdGSAxkcFcWATeiIm8p/tIenmPAAUhCd8PP/3vA3q03d+QgTzAiBQiZk/awwWjtdrTzVMC91ZOdRGSOHN4=
X-Received: by 10.28.237.23 with SMTP id l23mr23563726wmh.37.1514683786229; Sat, 30 Dec 2017 17:29:46 -0800 (PST)
MIME-Version: 1.0
Received: by 10.223.190.138 with HTTP; Sat, 30 Dec 2017 17:29:05 -0800 (PST)
In-Reply-To: <4D7F4AD313D3FC43A053B309F97543CF4907BD23@njmtexg4.research.att.com>
References: <CAHw9_iKmPer65KBoTBs-sim0ZY5mxJY14ts-FHBUFhnVHB9QCg@mail.gmail.com> <4D7F4AD313D3FC43A053B309F97543CF4907B984@njmtexg4.research.att.com> <CAHw9_iLpr3Oy1+6QcABZQvhP3_ZYqwGiqyWaAVVMDWAQciYviw@mail.gmail.com> <9A663BF0-CE45-483C-9788-641B22E63621@google.com> <4D7F4AD313D3FC43A053B309F97543CF4907BD23@njmtexg4.research.att.com>
From: Warren Kumari <warren@kumari.net>
Date: Sat, 30 Dec 2017 20:29:05 -0500
Message-ID: <CAHw9_iKCyy-n7eM48w2d+MHxVRgo1A32oF5oUkPNa6wcZyKOVg@mail.gmail.com>
To: "MORTON, ALFRED C (AL)" <acmorton@att.com>
Cc: Lucien Avramov <lucienav@google.com>, "bmwg@ietf.org" <bmwg@ietf.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/xIwaAzqW85MypTPclBZu3JDG9uU>
Subject: Re: [bmwg] Favor: Confirm Errata 5207
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 31 Dec 2017 01:29:51 -0000

On Tue, Dec 19, 2017 at 8:36 AM, MORTON, ALFRED C (AL) <acmorton@att.com> w=
rote:
> It occurs to me that I could put in a comparable errata
> to fix the same sentence:
>
> OLD
>    The DUT SHOULD be able to respond to address resolution requests sent
>    by the DUT wherever the protocol requires such a process.
> NEW
>    The tester SHOULD be able to respond to address resolution requests se=
nt
>    by the DUT wherever the protocol requires such a process.
>
> and then we'll have both points recorded for update.
>
> Is this your preferred course, Warren?

So, I let this stew for as while (I was supposed to submit it on Friday).
I ended up going with:
"The DUT and tester SHOULD both be able to respond to address
resolution requests wherever the protocol requires such a
process."

This seems sufficiently clear, and only required a minor change to the text=
.
W


> Al
>
>> -----Original Message-----
>> From: Lucien Avramov [mailto:lucienav@google.com]
>> Sent: Monday, December 18, 2017 4:59 PM
>> To: Warren Kumari
>> Cc: MORTON, ALFRED C (AL); bmwg@ietf.org
>> Subject: Re: [bmwg] Favor: Confirm Errata 5207
>>
>> Is it possible to try to submit Al=E2=80=99s suggestion and see if there=
 are
>> issues with avoiding a -bis? His context is important.
>>
>> Thank you,
>> Lucien
>>
>> > On Dec 18, 2017, at 13:27, Warren Kumari <warren@kumari.net> wrote:
>> >
>> >> On Mon, Dec 18, 2017 at 2:49 PM, MORTON, ALFRED C (AL)
>> <acmorton@att.com> wrote:
>> >> Hi Warren,
>> >>
>> >> I think the fix:
>> >>
>> >> OLD
>> >>   The DUT SHOULD be able to respond to address resolution requests
>> sent
>> >>   by the DUT wherever the protocol requires such a process.
>> >> NEW
>> >>   The DUT SHOULD be able to respond to address resolution requests
>> sent
>> >>   by the tester wherever the protocol requires such a process.
>> >>
>> >> is fine, but it would suggest that
>> >> NEW++
>> >>   The tester SHOULD be able to respond to address resolution requests
>> sent
>> >>   by the DUT wherever the protocol requires such a process.
>> >>
>> >> is also needed, for symmetry.
>> >>
>> >
>> > While I agree with you, that it likely larger than an Errata can
>> > cover, and would likely need a -bis document... :-(
>> > W
>> >
>> >> Al
>> >>
>> >>> -----Original Message-----
>> >>> From: bmwg [mailto:bmwg-bounces@ietf.org] On Behalf Of Warren Kumari
>> >>> Sent: Monday, December 18, 2017 1:00 PM
>> >>> To: bmwg@ietf.org
>> >>> Subject: [bmwg] Favor: Confirm Errata 5207
>> >>>
>> >>> Hi there all,
>> >>>
>> >>> This errata looks correct to me, but before I validate it I wanted
>> to
>> >>> ask the WG to confirm I'm not missing anything obvious.
>> >>>
>> >>> https://urldefense.proofpoint.com/v2/url?u=3Dhttps-3A__www.rfc-
>> >>> 2Deditor.org_errata_eid5207&d=3DDwICAg&c=3DLFYZ-
>> >>>
>> o9_HUMeMTSQicvjIg&r=3DOfsSu8kTIltVyD1oL72cBw&m=3DbjjaUdU3P64iEA1Bgik69Sj=
nzDG
>> >>> 75gAiRQKHQje6bj8&s=3DAMJgPjE-e67R_B7CwNtTtd385iZHZryxhsF3IS_Sw3M&e=
=3D
>> >>>
>> >>> If I don't hear anything to the contrary I'll mark it verified on
>> >>> Friday.
>> >>>
>> >>> W
>> >>>
>> >>> --
>> >>> I don't think the execution is relevant when it was obviously a bad
>> >>> idea in the first place.
>> >>> This is like putting rabid weasels in your pants, and later
>> expressing
>> >>> regret at having chosen those particular rabid weasels and that pair
>> >>> of pants.
>> >>>   ---maf
>> >>>
>> >>> _______________________________________________
>> >>> bmwg mailing list
>> >>> bmwg@ietf.org
>> >>> https://urldefense.proofpoint.com/v2/url?u=3Dhttps-
>> >>> 3A__www.ietf.org_mailman_listinfo_bmwg&d=3DDwICAg&c=3DLFYZ-
>> >>>
>> o9_HUMeMTSQicvjIg&r=3DOfsSu8kTIltVyD1oL72cBw&m=3DbjjaUdU3P64iEA1Bgik69Sj=
nzDG
>> >>> 75gAiRQKHQje6bj8&s=3D67LX3SMcO-MP3Udz0Fe-zdJfPsMvHmhl73LQBBnvZwo&e=
=3D
>> >
>> >
>> >
>> > --
>> > I don't think the execution is relevant when it was obviously a bad
>> > idea in the first place.
>> > This is like putting rabid weasels in your pants, and later expressing
>> > regret at having chosen those particular rabid weasels and that pair
>> > of pants.
>> >   ---maf
>> >
>> > _______________________________________________
>> > bmwg mailing list
>> > bmwg@ietf.org
>> > https://urldefense.proofpoint.com/v2/url?u=3Dhttps-
>> 3A__www.ietf.org_mailman_listinfo_bmwg&d=3DDwIFaQ&c=3DLFYZ-
>> o9_HUMeMTSQicvjIg&r=3DOfsSu8kTIltVyD1oL72cBw&m=3D5204fHGyWNDbTF2RjS1WM2V=
Vgqk
>> 3zGyQwDrtBTRxa0E&s=3DHf-dPvFb6GqU9N9vH6l-P4sC7xJZG03jvx6HYV7u-KA&e=3D



--=20
I don't think the execution is relevant when it was obviously a bad
idea in the first place.
This is like putting rabid weasels in your pants, and later expressing
regret at having chosen those particular rabid weasels and that pair
of pants.
   ---maf


From nobody Sun Dec 31 06:27:35 2017
Return-Path: <acmorton@att.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4017612025C for <bmwg@ietfa.amsl.com>; Sun, 31 Dec 2017 06:27:32 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.621
X-Spam-Level: 
X-Spam-Status: No, score=-2.621 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NqkFoTiS0sNh for <bmwg@ietfa.amsl.com>; Sun, 31 Dec 2017 06:27:29 -0800 (PST)
Received: from mx0a-00191d01.pphosted.com (mx0a-00191d01.pphosted.com [67.231.149.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id E308A124319 for <bmwg@ietf.org>; Sun, 31 Dec 2017 06:27:29 -0800 (PST)
Received: from pps.filterd (m0048589.ppops.net [127.0.0.1]) by m0048589.ppops.net-00191d01. (8.16.0.21/8.16.0.21) with SMTP id vBVEPPoK034393; Sun, 31 Dec 2017 09:27:27 -0500
Received: from tlpd255.enaf.dadc.sbc.com (sbcsmtp3.sbc.com [144.160.112.28]) by m0048589.ppops.net-00191d01. with ESMTP id 2f6w0v2tu7-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sun, 31 Dec 2017 09:27:27 -0500
Received: from enaf.dadc.sbc.com (localhost [127.0.0.1]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id vBVERPqM002253; Sun, 31 Dec 2017 08:27:26 -0600
Received: from dalint01.pst.cso.att.com (dalint01.pst.cso.att.com [135.31.133.159]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id vBVERNUQ002237 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sun, 31 Dec 2017 08:27:23 -0600
Received: from zlp30497.vci.att.com (zlp30497.vci.att.com [135.46.181.156]) by dalint01.pst.cso.att.com (RSA Interceptor); Sun, 31 Dec 2017 14:27:12 GMT
Received: from zlp30497.vci.att.com (zlp30497.vci.att.com [127.0.0.1]) by zlp30497.vci.att.com (Service) with ESMTP id 322C54000390; Sun, 31 Dec 2017 14:27:12 +0000 (GMT)
Received: from clpi183.sldc.sbc.com (unknown [135.41.1.46]) by zlp30497.vci.att.com (Service) with ESMTP id 10A3140006D5; Sun, 31 Dec 2017 14:27:12 +0000 (GMT)
Received: from sldc.sbc.com (localhost [127.0.0.1]) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id vBVERBrD014093; Sun, 31 Dec 2017 08:27:11 -0600
Received: from mail-azure.research.att.com (mail-azure.research.att.com [135.207.255.18]) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id vBVEQx3U013501; Sun, 31 Dec 2017 08:26:59 -0600
Received: from exchange.research.att.com (njmtcas2.research.att.com [135.207.255.47]) by mail-azure.research.att.com (Postfix) with ESMTP id E07EBE5283; Sun, 31 Dec 2017 09:26:58 -0500 (EST)
Received: from njmtexg4.research.att.com ([fe80::8cd:baa3:219e:5bd4]) by njmtcas2.research.att.com ([fe80::d550:ec84:f872:cad9%15]) with mapi id 14.03.0361.001; Sun, 31 Dec 2017 09:26:58 -0500
From: "MORTON, ALFRED C (AL)" <acmorton@att.com>
To: Warren Kumari <warren@kumari.net>
CC: Lucien Avramov <lucienav@google.com>, "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: [bmwg] Favor: Confirm Errata 5207
Thread-Index: AQHTeCojldxq6+I4r02d3maT83tvcaNJgTtwgABwX4CAAAihAIAAsWIQgBJlXoCAAIUo4A==
Date: Sun, 31 Dec 2017 14:26:58 +0000
Message-ID: <4D7F4AD313D3FC43A053B309F97543CF49080039@njmtexg4.research.att.com>
References: <CAHw9_iKmPer65KBoTBs-sim0ZY5mxJY14ts-FHBUFhnVHB9QCg@mail.gmail.com> <4D7F4AD313D3FC43A053B309F97543CF4907B984@njmtexg4.research.att.com> <CAHw9_iLpr3Oy1+6QcABZQvhP3_ZYqwGiqyWaAVVMDWAQciYviw@mail.gmail.com> <9A663BF0-CE45-483C-9788-641B22E63621@google.com> <4D7F4AD313D3FC43A053B309F97543CF4907BD23@njmtexg4.research.att.com> <CAHw9_iKCyy-n7eM48w2d+MHxVRgo1A32oF5oUkPNa6wcZyKOVg@mail.gmail.com>
In-Reply-To: <CAHw9_iKCyy-n7eM48w2d+MHxVRgo1A32oF5oUkPNa6wcZyKOVg@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
x-originating-ip: [69.141.203.172]
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-RSA-Inspected: yes
X-RSA-Classifications: public
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:, , definitions=2017-12-31_10:, , signatures=0
X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1711220000 definitions=main-1712310217
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/qGdpF7DHT1kYj7q613Ox-oJpQGo>
Subject: Re: [bmwg] Favor: Confirm Errata 5207
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 31 Dec 2017 14:27:32 -0000

VGhhbmtzIFdhcnJlbiwgdGhhdCdzIHZlcnkgZWZmaWNpZW50IHdvcmRpbmcuDQpNeSBoYXQgaXMg
b2ZmIHRvIHlvdSEgKEkga25vdyB5b3UgbGlrZSBoYXRzKQ0KSGFwcHkgTmV3IFllYXIsDQpBbA0K
DQo+IC0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tDQo+IEZyb206IFdhcnJlbiBLdW1hcmkgW21h
aWx0bzp3YXJyZW5Aa3VtYXJpLm5ldF0NCj4gU2VudDogU2F0dXJkYXksIERlY2VtYmVyIDMwLCAy
MDE3IDg6MjkgUE0NCj4gVG86IE1PUlRPTiwgQUxGUkVEIEMgKEFMKQ0KPiBDYzogTHVjaWVuIEF2
cmFtb3Y7IGJtd2dAaWV0Zi5vcmcNCj4gU3ViamVjdDogUmU6IFtibXdnXSBGYXZvcjogQ29uZmly
bSBFcnJhdGEgNTIwNw0KPiANCj4gT24gVHVlLCBEZWMgMTksIDIwMTcgYXQgODozNiBBTSwgTU9S
VE9OLCBBTEZSRUQgQyAoQUwpDQo+IDxhY21vcnRvbkBhdHQuY29tPiB3cm90ZToNCj4gPiBJdCBv
Y2N1cnMgdG8gbWUgdGhhdCBJIGNvdWxkIHB1dCBpbiBhIGNvbXBhcmFibGUgZXJyYXRhDQo+ID4g
dG8gZml4IHRoZSBzYW1lIHNlbnRlbmNlOg0KPiA+DQo+ID4gT0xEDQo+ID4gICAgVGhlIERVVCBT
SE9VTEQgYmUgYWJsZSB0byByZXNwb25kIHRvIGFkZHJlc3MgcmVzb2x1dGlvbiByZXF1ZXN0cw0K
PiBzZW50DQo+ID4gICAgYnkgdGhlIERVVCB3aGVyZXZlciB0aGUgcHJvdG9jb2wgcmVxdWlyZXMg
c3VjaCBhIHByb2Nlc3MuDQo+ID4gTkVXDQo+ID4gICAgVGhlIHRlc3RlciBTSE9VTEQgYmUgYWJs
ZSB0byByZXNwb25kIHRvIGFkZHJlc3MgcmVzb2x1dGlvbiByZXF1ZXN0cw0KPiBzZW50DQo+ID4g
ICAgYnkgdGhlIERVVCB3aGVyZXZlciB0aGUgcHJvdG9jb2wgcmVxdWlyZXMgc3VjaCBhIHByb2Nl
c3MuDQo+ID4NCj4gPiBhbmQgdGhlbiB3ZSdsbCBoYXZlIGJvdGggcG9pbnRzIHJlY29yZGVkIGZv
ciB1cGRhdGUuDQo+ID4NCj4gPiBJcyB0aGlzIHlvdXIgcHJlZmVycmVkIGNvdXJzZSwgV2FycmVu
Pw0KPiANCj4gU28sIEkgbGV0IHRoaXMgc3RldyBmb3IgYXMgd2hpbGUgKEkgd2FzIHN1cHBvc2Vk
IHRvIHN1Ym1pdCBpdCBvbg0KPiBGcmlkYXkpLg0KPiBJIGVuZGVkIHVwIGdvaW5nIHdpdGg6DQo+
ICJUaGUgRFVUIGFuZCB0ZXN0ZXIgU0hPVUxEIGJvdGggYmUgYWJsZSB0byByZXNwb25kIHRvIGFk
ZHJlc3MNCj4gcmVzb2x1dGlvbiByZXF1ZXN0cyB3aGVyZXZlciB0aGUgcHJvdG9jb2wgcmVxdWly
ZXMgc3VjaCBhDQo+IHByb2Nlc3MuIg0KPiANCj4gVGhpcyBzZWVtcyBzdWZmaWNpZW50bHkgY2xl
YXIsIGFuZCBvbmx5IHJlcXVpcmVkIGEgbWlub3IgY2hhbmdlIHRvIHRoZQ0KPiB0ZXh0Lg0KPiBX
DQo+IA0KPiANCj4gPiBBbA0KPiA+DQo+ID4+IC0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tDQo+
ID4+IEZyb206IEx1Y2llbiBBdnJhbW92IFttYWlsdG86bHVjaWVuYXZAZ29vZ2xlLmNvbV0NCj4g
Pj4gU2VudDogTW9uZGF5LCBEZWNlbWJlciAxOCwgMjAxNyA0OjU5IFBNDQo+ID4+IFRvOiBXYXJy
ZW4gS3VtYXJpDQo+ID4+IENjOiBNT1JUT04sIEFMRlJFRCBDIChBTCk7IGJtd2dAaWV0Zi5vcmcN
Cj4gPj4gU3ViamVjdDogUmU6IFtibXdnXSBGYXZvcjogQ29uZmlybSBFcnJhdGEgNTIwNw0KPiA+
Pg0KPiA+PiBJcyBpdCBwb3NzaWJsZSB0byB0cnkgdG8gc3VibWl0IEFs4oCZcyBzdWdnZXN0aW9u
IGFuZCBzZWUgaWYgdGhlcmUgYXJlDQo+ID4+IGlzc3VlcyB3aXRoIGF2b2lkaW5nIGEgLWJpcz8g
SGlzIGNvbnRleHQgaXMgaW1wb3J0YW50Lg0KPiA+Pg0KPiA+PiBUaGFuayB5b3UsDQo+ID4+IEx1
Y2llbg0KPiA+Pg0KPiA+PiA+IE9uIERlYyAxOCwgMjAxNywgYXQgMTM6MjcsIFdhcnJlbiBLdW1h
cmkgPHdhcnJlbkBrdW1hcmkubmV0PiB3cm90ZToNCj4gPj4gPg0KPiA+PiA+PiBPbiBNb24sIERl
YyAxOCwgMjAxNyBhdCAyOjQ5IFBNLCBNT1JUT04sIEFMRlJFRCBDIChBTCkNCj4gPj4gPGFjbW9y
dG9uQGF0dC5jb20+IHdyb3RlOg0KPiA+PiA+PiBIaSBXYXJyZW4sDQo+ID4+ID4+DQo+ID4+ID4+
IEkgdGhpbmsgdGhlIGZpeDoNCj4gPj4gPj4NCj4gPj4gPj4gT0xEDQo+ID4+ID4+ICAgVGhlIERV
VCBTSE9VTEQgYmUgYWJsZSB0byByZXNwb25kIHRvIGFkZHJlc3MgcmVzb2x1dGlvbiByZXF1ZXN0
cw0KPiA+PiBzZW50DQo+ID4+ID4+ICAgYnkgdGhlIERVVCB3aGVyZXZlciB0aGUgcHJvdG9jb2wg
cmVxdWlyZXMgc3VjaCBhIHByb2Nlc3MuDQo+ID4+ID4+IE5FVw0KPiA+PiA+PiAgIFRoZSBEVVQg
U0hPVUxEIGJlIGFibGUgdG8gcmVzcG9uZCB0byBhZGRyZXNzIHJlc29sdXRpb24gcmVxdWVzdHMN
Cj4gPj4gc2VudA0KPiA+PiA+PiAgIGJ5IHRoZSB0ZXN0ZXIgd2hlcmV2ZXIgdGhlIHByb3RvY29s
IHJlcXVpcmVzIHN1Y2ggYSBwcm9jZXNzLg0KPiA+PiA+Pg0KPiA+PiA+PiBpcyBmaW5lLCBidXQg
aXQgd291bGQgc3VnZ2VzdCB0aGF0DQo+ID4+ID4+IE5FVysrDQo+ID4+ID4+ICAgVGhlIHRlc3Rl
ciBTSE9VTEQgYmUgYWJsZSB0byByZXNwb25kIHRvIGFkZHJlc3MgcmVzb2x1dGlvbg0KPiByZXF1
ZXN0cw0KPiA+PiBzZW50DQo+ID4+ID4+ICAgYnkgdGhlIERVVCB3aGVyZXZlciB0aGUgcHJvdG9j
b2wgcmVxdWlyZXMgc3VjaCBhIHByb2Nlc3MuDQo+ID4+ID4+DQo+ID4+ID4+IGlzIGFsc28gbmVl
ZGVkLCBmb3Igc3ltbWV0cnkuDQo+ID4+ID4+DQo+ID4+ID4NCj4gPj4gPiBXaGlsZSBJIGFncmVl
IHdpdGggeW91LCB0aGF0IGl0IGxpa2VseSBsYXJnZXIgdGhhbiBhbiBFcnJhdGEgY2FuDQo+ID4+
ID4gY292ZXIsIGFuZCB3b3VsZCBsaWtlbHkgbmVlZCBhIC1iaXMgZG9jdW1lbnQuLi4gOi0oDQo+
ID4+ID4gVw0KPiA+PiA+DQo+ID4+ID4+IEFsDQo+ID4+ID4+DQo+ID4+ID4+PiAtLS0tLU9yaWdp
bmFsIE1lc3NhZ2UtLS0tLQ0KPiA+PiA+Pj4gRnJvbTogYm13ZyBbbWFpbHRvOmJtd2ctYm91bmNl
c0BpZXRmLm9yZ10gT24gQmVoYWxmIE9mIFdhcnJlbg0KPiBLdW1hcmkNCj4gPj4gPj4+IFNlbnQ6
IE1vbmRheSwgRGVjZW1iZXIgMTgsIDIwMTcgMTowMCBQTQ0KPiA+PiA+Pj4gVG86IGJtd2dAaWV0
Zi5vcmcNCj4gPj4gPj4+IFN1YmplY3Q6IFtibXdnXSBGYXZvcjogQ29uZmlybSBFcnJhdGEgNTIw
Nw0KPiA+PiA+Pj4NCj4gPj4gPj4+IEhpIHRoZXJlIGFsbCwNCj4gPj4gPj4+DQo+ID4+ID4+PiBU
aGlzIGVycmF0YSBsb29rcyBjb3JyZWN0IHRvIG1lLCBidXQgYmVmb3JlIEkgdmFsaWRhdGUgaXQg
SQ0KPiB3YW50ZWQNCj4gPj4gdG8NCj4gPj4gPj4+IGFzayB0aGUgV0cgdG8gY29uZmlybSBJJ20g
bm90IG1pc3NpbmcgYW55dGhpbmcgb2J2aW91cy4NCj4gPj4gPj4+DQo+ID4+ID4+PiBodHRwczov
L3VybGRlZmVuc2UucHJvb2Zwb2ludC5jb20vdjIvdXJsP3U9aHR0cHMtM0FfX3d3dy5yZmMtDQo+
ID4+ID4+PiAyRGVkaXRvci5vcmdfZXJyYXRhX2VpZDUyMDcmZD1Ed0lDQWcmYz1MRllaLQ0KPiA+
PiA+Pj4NCj4gPj4NCj4gbzlfSFVNZU1UU1FpY3ZqSWcmcj1PZnNTdThrVElsdFZ5RDFvTDcyY0J3
Jm09YmpqYVVkVTNQNjRpRUExQmdpazY5U2puekRHDQo+ID4+ID4+PiA3NWdBaVJRS0hRamU2Ymo4
JnM9QU1KZ1BqRS1lNjdSX0I3Q3dOdFR0ZDM4NWlaSFpyeXhoc0YzSVNfU3czTSZlPQ0KPiA+PiA+
Pj4NCj4gPj4gPj4+IElmIEkgZG9uJ3QgaGVhciBhbnl0aGluZyB0byB0aGUgY29udHJhcnkgSSds
bCBtYXJrIGl0IHZlcmlmaWVkIG9uDQo+ID4+ID4+PiBGcmlkYXkuDQo+ID4+ID4+Pg0KPiA+PiA+
Pj4gVw0KPiA+PiA+Pj4NCj4gPj4gPj4+IC0tDQo+ID4+ID4+PiBJIGRvbid0IHRoaW5rIHRoZSBl
eGVjdXRpb24gaXMgcmVsZXZhbnQgd2hlbiBpdCB3YXMgb2J2aW91c2x5IGENCj4gYmFkDQo+ID4+
ID4+PiBpZGVhIGluIHRoZSBmaXJzdCBwbGFjZS4NCj4gPj4gPj4+IFRoaXMgaXMgbGlrZSBwdXR0
aW5nIHJhYmlkIHdlYXNlbHMgaW4geW91ciBwYW50cywgYW5kIGxhdGVyDQo+ID4+IGV4cHJlc3Np
bmcNCj4gPj4gPj4+IHJlZ3JldCBhdCBoYXZpbmcgY2hvc2VuIHRob3NlIHBhcnRpY3VsYXIgcmFi
aWQgd2Vhc2VscyBhbmQgdGhhdA0KPiBwYWlyDQo+ID4+ID4+PiBvZiBwYW50cy4NCj4gPj4gPj4+
ICAgLS0tbWFmDQo+ID4+ID4+Pg0KPiA+PiA+Pj4gX19fX19fX19fX19fX19fX19fX19fX19fX19f
X19fX19fX19fX19fX19fX19fX18NCj4gPj4gPj4+IGJtd2cgbWFpbGluZyBsaXN0DQo+ID4+ID4+
PiBibXdnQGlldGYub3JnDQo+ID4+ID4+PiBodHRwczovL3VybGRlZmVuc2UucHJvb2Zwb2ludC5j
b20vdjIvdXJsP3U9aHR0cHMtDQo+ID4+ID4+PiAzQV9fd3d3LmlldGYub3JnX21haWxtYW5fbGlz
dGluZm9fYm13ZyZkPUR3SUNBZyZjPUxGWVotDQo+ID4+ID4+Pg0KPiA+Pg0KPiBvOV9IVU1lTVRT
UWljdmpJZyZyPU9mc1N1OGtUSWx0VnlEMW9MNzJjQncmbT1iamphVWRVM1A2NGlFQTFCZ2lrNjlT
am56REcNCj4gPj4gPj4+IDc1Z0FpUlFLSFFqZTZiajgmcz02N0xYM1NNY08tTVAzVWR6MEZlLXpk
SmZQc012SG1obDczTFFCQm52WndvJmU9DQo+ID4+ID4NCj4gPj4gPg0KPiA+PiA+DQo+ID4+ID4g
LS0NCj4gPj4gPiBJIGRvbid0IHRoaW5rIHRoZSBleGVjdXRpb24gaXMgcmVsZXZhbnQgd2hlbiBp
dCB3YXMgb2J2aW91c2x5IGEgYmFkDQo+ID4+ID4gaWRlYSBpbiB0aGUgZmlyc3QgcGxhY2UuDQo+
ID4+ID4gVGhpcyBpcyBsaWtlIHB1dHRpbmcgcmFiaWQgd2Vhc2VscyBpbiB5b3VyIHBhbnRzLCBh
bmQgbGF0ZXINCj4gZXhwcmVzc2luZw0KPiA+PiA+IHJlZ3JldCBhdCBoYXZpbmcgY2hvc2VuIHRo
b3NlIHBhcnRpY3VsYXIgcmFiaWQgd2Vhc2VscyBhbmQgdGhhdA0KPiBwYWlyDQo+ID4+ID4gb2Yg
cGFudHMuDQo+ID4+ID4gICAtLS1tYWYNCj4gPj4gPg0KPiA+PiA+IF9fX19fX19fX19fX19fX19f
X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fDQo+ID4+ID4gYm13ZyBtYWlsaW5nIGxpc3QN
Cj4gPj4gPiBibXdnQGlldGYub3JnDQo+ID4+ID4gaHR0cHM6Ly91cmxkZWZlbnNlLnByb29mcG9p
bnQuY29tL3YyL3VybD91PWh0dHBzLQ0KPiA+PiAzQV9fd3d3LmlldGYub3JnX21haWxtYW5fbGlz
dGluZm9fYm13ZyZkPUR3SUZhUSZjPUxGWVotDQo+ID4+DQo+IG85X0hVTWVNVFNRaWN2aklnJnI9
T2ZzU3U4a1RJbHRWeUQxb0w3MmNCdyZtPTUyMDRmSEd5V05EYlRGMlJqUzFXTTJWVmdxaw0KPiA+
PiAzekd5UXdEcnRCVFJ4YTBFJnM9SGYtZFB2RmI2R3FVOU45dkg2bC1QNHNDN3hKWkcwM2p2eDZI
WVY3dS1LQSZlPQ0KPiANCj4gDQo+IA0KPiAtLQ0KPiBJIGRvbid0IHRoaW5rIHRoZSBleGVjdXRp
b24gaXMgcmVsZXZhbnQgd2hlbiBpdCB3YXMgb2J2aW91c2x5IGEgYmFkDQo+IGlkZWEgaW4gdGhl
IGZpcnN0IHBsYWNlLg0KPiBUaGlzIGlzIGxpa2UgcHV0dGluZyByYWJpZCB3ZWFzZWxzIGluIHlv
dXIgcGFudHMsIGFuZCBsYXRlciBleHByZXNzaW5nDQo+IHJlZ3JldCBhdCBoYXZpbmcgY2hvc2Vu
IHRob3NlIHBhcnRpY3VsYXIgcmFiaWQgd2Vhc2VscyBhbmQgdGhhdCBwYWlyDQo+IG9mIHBhbnRz
Lg0KPiAgICAtLS1tYWYNCg==

