
From nobody Mon Oct  2 09:12:31 2017
Return-Path: <internet-drafts@ietf.org>
X-Original-To: bmwg@ietf.org
Delivered-To: bmwg@ietfa.amsl.com
Received: from ietfa.amsl.com (localhost [IPv6:::1]) by ietfa.amsl.com (Postfix) with ESMTP id 3FAF9132193; Mon,  2 Oct 2017 09:12:30 -0700 (PDT)
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 7bit
From: internet-drafts@ietf.org
To: <i-d-announce@ietf.org>
Cc: bmwg@ietf.org
X-Test-IDTracker: no
X-IETF-IDTracker: 6.63.0
Auto-Submitted: auto-generated
Precedence: bulk
Message-ID: <150696075022.28653.14743103910596066529@ietfa.amsl.com>
Date: Mon, 02 Oct 2017 09:12:30 -0700
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/AJVAis48BnSOY65WX0DYnDLZc6I>
Subject: [bmwg] I-D Action: draft-ietf-bmwg-sdn-controller-benchmark-term-05.txt
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 02 Oct 2017 16:12:30 -0000

A New Internet-Draft is available from the on-line Internet-Drafts directories.
This draft is a work item of the Benchmarking Methodology WG of the IETF.

        Title           : Terminology for Benchmarking SDN Controller Performance
        Authors         : Bhuvaneswaran Vengainathan
                          Anton Basil
                          Mark Tassinari
                          Vishwas Manral
                          Sarah Banks
	Filename        : draft-ietf-bmwg-sdn-controller-benchmark-term-05.txt
	Pages           : 23
	Date            : 2017-10-02

Abstract:
   This document defines terminology for benchmarking an SDN
   controller's control plane performance. It extends the terminology
   already defined in RFC 7426 for the purpose of benchmarking SDN
   controllers. The terms provided in this document help to benchmark
   SDN controller's performance independent of the controller's
   supported protocols and/or network services. A mechanism for
   benchmarking the performance of SDN controllers is defined in the
   companion methodology document. These two documents provide a
   standard mechanism to measure and evaluate the performance of
   various controller implementations.


The IETF datatracker status page for this draft is:
https://datatracker.ietf.org/doc/draft-ietf-bmwg-sdn-controller-benchmark-term/

There are also htmlized versions available at:
https://tools.ietf.org/html/draft-ietf-bmwg-sdn-controller-benchmark-term-05
https://datatracker.ietf.org/doc/html/draft-ietf-bmwg-sdn-controller-benchmark-term-05

A diff from the previous version is available at:
https://www.ietf.org/rfcdiff?url2=draft-ietf-bmwg-sdn-controller-benchmark-term-05


Please note that it may take a couple of minutes from the time of submission
until the htmlized version and diff are available at tools.ietf.org.

Internet-Drafts are also available by anonymous FTP at:
ftp://ftp.ietf.org/internet-drafts/


From nobody Mon Oct  2 09:13:55 2017
Return-Path: <internet-drafts@ietf.org>
X-Original-To: bmwg@ietf.org
Delivered-To: bmwg@ietfa.amsl.com
Received: from ietfa.amsl.com (localhost [IPv6:::1]) by ietfa.amsl.com (Postfix) with ESMTP id 94E9E133059; Mon,  2 Oct 2017 09:13:54 -0700 (PDT)
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 7bit
From: internet-drafts@ietf.org
To: <i-d-announce@ietf.org>
Cc: bmwg@ietf.org
X-Test-IDTracker: no
X-IETF-IDTracker: 6.63.0
Auto-Submitted: auto-generated
Precedence: bulk
Message-ID: <150696083459.28744.4063280920608483974@ietfa.amsl.com>
Date: Mon, 02 Oct 2017 09:13:54 -0700
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/YM-U9LrRw7I5ijcXb9Lr_RLqWXE>
Subject: [bmwg] I-D Action: draft-ietf-bmwg-sdn-controller-benchmark-meth-05.txt
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 02 Oct 2017 16:13:54 -0000

A New Internet-Draft is available from the on-line Internet-Drafts directories.
This draft is a work item of the Benchmarking Methodology WG of the IETF.

        Title           : Benchmarking Methodology for SDN Controller Performance
        Authors         : Bhuvaneswaran Vengainathan
                          Anton Basil
                          Mark Tassinari
                          Vishwas Manral
                          Sarah Banks
	Filename        : draft-ietf-bmwg-sdn-controller-benchmark-meth-05.txt
	Pages           : 53
	Date            : 2017-10-02

Abstract:
   This document defines the methodologies for benchmarking control
   plane performance of SDN controllers. Terminology related to
   benchmarking SDN controllers is described in the companion
   terminology document. SDN controllers have been implemented with
   many varying designs in order to achieve their intended network
   functionality. Hence, the authors have taken the approach of
   considering an SDN controller as a black box, defining the
   methodology in a manner that is agnostic to protocols and network
   services supported by controllers. The intent of this document is to
   provide a standard mechanism to measure the performance of all
   controller implementations.


The IETF datatracker status page for this draft is:
https://datatracker.ietf.org/doc/draft-ietf-bmwg-sdn-controller-benchmark-meth/

There are also htmlized versions available at:
https://tools.ietf.org/html/draft-ietf-bmwg-sdn-controller-benchmark-meth-05
https://datatracker.ietf.org/doc/html/draft-ietf-bmwg-sdn-controller-benchmark-meth-05

A diff from the previous version is available at:
https://www.ietf.org/rfcdiff?url2=draft-ietf-bmwg-sdn-controller-benchmark-meth-05


Please note that it may take a couple of minutes from the time of submission
until the htmlized version and diff are available at tools.ietf.org.

Internet-Drafts are also available by anonymous FTP at:
ftp://ftp.ietf.org/internet-drafts/


From nobody Mon Oct  2 09:30:06 2017
Return-Path: <bhuvaneswaran.vengainathan@veryxtech.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 920EA13234B for <bmwg@ietfa.amsl.com>; Mon,  2 Oct 2017 09:30:04 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.899
X-Spam-Level: 
X-Spam-Status: No, score=-1.899 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id K5BHLhpeDg9v for <bmwg@ietfa.amsl.com>; Mon,  2 Oct 2017 09:30:01 -0700 (PDT)
Received: from smtpout4.netcore.co.in (smout464.nsmailserv.com [202.162.238.64]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 6AA4E13263F for <bmwg@ietf.org>; Mon,  2 Oct 2017 09:30:01 -0700 (PDT)
Received: from smtpin5.netcore.co.in (unknown [192.168.2.96]) by cf3.netcore.co.in (Postfix) with ESMTP id 137281200C3; Mon,  2 Oct 2017 21:59:47 +0530 (IST)
Received: from cloudmail14.netcore.co.in (cloudmail12.netcore.co.in [202.162.231.3]) by smtpin5.netcore.co.in (Postfix) with ESMTP id C362D57D5E; Mon,  2 Oct 2017 21:59:50 +0530 (IST)
Mime-Version: 1.0
Date: Mon, 02 Oct 2017 16:29:51 +0000
Content-Type: multipart/alternative; boundary="----=_Part_652_491088771.1506961791"
Message-ID: <b551c4756efb65cb01a67b46c438aedc@cloudmail14.netcore.co.in>
X-Mailer: AfterLogic webmail client
From: bhuvaneswaran.vengainathan@veryxtech.com
To: "bmwg@ietf.org" <bmwg@ietf.org>
Cc: "Sarah B" <sbanks@encrypted.net>, "MORTON, ALFRED C (AL)" <acmorton@att.com>
In-Reply-To: <150696083474.28744.11512922472398306447.idtracker@ietfa.amsl.com>
References: <150696083474.28744.11512922472398306447.idtracker@ietfa.amsl.com>
X-Priority: 3 (Normal)
X-SMTP30-MailScanner-Information: Please contact the ISP for more information
X-MailScanner-ID: C362D57D5E.A66DE
X-SMTP30-MailScanner: Found to be clean
X-MailScanner-From: bhuvaneswaran.vengainathan@veryxtech.com
X-Cloudmilter-Processed: 1
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/2ZDeoE9nZMmponr5osfmKhJC6H8>
Subject: [bmwg] Fwd: New Version Notification for draft-ietf-bmwg-sdn-controller-benchmark-meth-05.txt
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 02 Oct 2017 16:30:05 -0000

------=_Part_652_491088771.1506961791
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable

Hi All,
A new version of SDN controller benchmarking terminology and methodology dr=
afts have been submitted into IETF.
The following are the draft changes:
1. Addressed Al's comment on Asynchronous Message Processing Rate benchmark=
 test about loss-free and maximum message processing rate.
2. Reworded Test Iterations/Duration to Trails/Trail Duration.

Note: The 3x3 matrix in terminology draft still remain the same.
Thanks,
Bhuvan

---- Original Message ----
 From: internet-drafts@ietf.org
 To: Vishwas Manral , Sarah Banks , Bhuvaneswaran Vengainathan , Anton Basi=
l , Mark Tassinari=20
 Sent: Mon, Oct 2, 2017, 09:44 PM
 Subject: New Version Notification for draft-ietf-bmwg-sdn-controller-bench=
mark-meth-05.txt
A new version of I-D, draft-ietf-bmwg-sdn-controller-benchmark-meth-05.txt
has been successfully submitted by Bhuvaneswaran Vengainathan and posted to=
 the
IETF repository.

Name:      draft-ietf-bmwg-sdn-controller-benchmark-meth
Revision:   05
Title:      Benchmarking Methodology for SDN Controller Performance
Document date:   2017-10-01
Group:      bmwg
Pages:      53
URL:            https://www.ietf.org/internet-drafts/draft-ietf-bmwg-sdn-co=
ntroller-benchmark-meth-05.txt (https://www.ietf.org/internet-drafts/draft-=
ietf-bmwg-sdn-controller-benchmark-meth-05.txt)
Status:         https://datatracker.ietf.org/doc/draft-ietf-bmwg-sdn-contro=
ller-benchmark-meth/ (https://datatracker.ietf.org/doc/draft-ietf-bmwg-sdn-=
controller-benchmark-meth/)
Htmlized:       https://tools.ietf.org/html/draft-ietf-bmwg-sdn-controller-=
benchmark-meth-05 (https://tools.ietf.org/html/draft-ietf-bmwg-sdn-controll=
er-benchmark-meth-05)
Htmlized:       https://datatracker.ietf.org/doc/html/draft-ietf-bmwg-sdn-c=
ontroller-benchmark-meth-05 (https://datatracker.ietf.org/doc/html/draft-ie=
tf-bmwg-sdn-controller-benchmark-meth-05)
Diff:           https://www.ietf.org/rfcdiff?url2=3Ddraft-ietf-bmwg-sdn-con=
troller-benchmark-meth-05 (https://www.ietf.org/rfcdiff?url2=3Ddraft-ietf-b=
mwg-sdn-controller-benchmark-meth-05)

Abstract:
This document defines the methodologies for benchmarking control
plane performance of SDN controllers. Terminology related to
benchmarking SDN controllers is described in the companion
terminology document. SDN controllers have been implemented with
many varying designs in order to achieve their intended network
functionality. Hence, the authors have taken the approach of
considering an SDN controller as a black box, defining the
methodology in a manner that is agnostic to protocols and network
services supported by controllers. The intent of this document is to
provide a standard mechanism to measure the performance of all
controller implementations.

Please note that it may take a couple of minutes from the time of submission
until the htmlized version and diff are available at tools.ietf.org.

The IETF Secretariat

DISCLAIMER: Privileged and/or Confidential information may be
contained in this message. If you are not the addressee of this message,
you may not copy, use or deliver this message to anyone. In such
event,you should destroy the message and kindly notify the sender by
reply e-mail.
It is understood that opinions or conclusions that do not relate to the
official business of the company are neither given nor endorsed by the
company.


------=_Part_652_491088771.1506961791
Content-Type: text/html; charset="utf-8"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE html><html><head><meta http-equiv=3D"Content-Type" content=3D"tex=
t/html; charset=3Dutf-8" /></head><body><div data-crea=3D"font-wrapper" sty=
le=3D"font-family: Calibri; font-size: 16px; direction: ltr"><div style=3D"=
font-family: Calibri; font-size: 16px"></div>Hi All,<div><br></div><div>A n=
ew version of SDN controller benchmarking terminology and methodology draft=
s have been submitted into IETF.</div><div>The following are the draft chan=
ges:</div><div><br></div><div>1. Addressed Al's comment on Asynchronous Mes=
sage Processing Rate benchmark test about loss-free and maximum message pro=
cessing rate.</div><div>2. Reworded Test Iterations/Duration to Trails/Trai=
l Duration.<br><br>Note: The 3x3 matrix in terminology draft still remain t=
he same.<br><br><div></div>Thanks,</div><div>Bhuvan<br><br><div data-anchor=
=3D"reply-title">---- Original Message ----<br>
From: internet-drafts@ietf.org<br>
To: Vishwas Manral &lt;vishwas.manral@gmail.com&gt;, Sarah Banks &lt;sbanks=
@encrypted.net&gt;, Bhuvaneswaran Vengainathan &lt;bhuvaneswaran.vengainath=
an@veryxtech.com&gt;, Anton Basil &lt;anton.basil@veryxtech.com&gt;, Mark T=
assinari &lt;mark.tassinari@hpe.com&gt;<br>
Sent: Mon, Oct 2, 2017, 09:44 PM<br>
Subject: New Version Notification for  draft-ietf-bmwg-sdn-controller-bench=
mark-meth-05.txt<br></div><br><br><div>A new version of I-D, draft-ietf-bmw=
g-sdn-controller-benchmark-meth-05.txt<br>has been successfully submitted b=
y Bhuvaneswaran Vengainathan and posted to the<br>IETF repository.<br><br>N=
ame:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0draft-ietf-bmwg-sdn-controller-benc=
hmark-meth<br>Revision:=C2=A0=C2=A0=C2=A005<br>Title:=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0Benchmarking Methodology for SDN Controller Performance<br>D=
ocument date:=C2=A0=C2=A0=C2=A02017-10-01<br>Group:=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0bmwg<br>Pages:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A053<br>URL:=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0<a tar=
get=3D"_blank" href=3D"https://www.ietf.org/internet-drafts/draft-ietf-bmwg=
-sdn-controller-benchmark-meth-05.txt">https://www.ietf.org/internet-drafts=
/draft-ietf-bmwg-sdn-controller-benchmark-meth-05.txt</a><br>Status:=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 <a target=3D"_blank" href=3D"htt=
ps://datatracker.ietf.org/doc/draft-ietf-bmwg-sdn-controller-benchmark-meth=
/">https://datatracker.ietf.org/doc/draft-ietf-bmwg-sdn-controller-benchmar=
k-meth/</a><br>Htmlized:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 <a target=3D"_=
blank" href=3D"https://tools.ietf.org/html/draft-ietf-bmwg-sdn-controller-b=
enchmark-meth-05">https://tools.ietf.org/html/draft-ietf-bmwg-sdn-controlle=
r-benchmark-meth-05</a><br>Htmlized:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 <a=
 target=3D"_blank" href=3D"https://datatracker.ietf.org/doc/html/draft-ietf=
-bmwg-sdn-controller-benchmark-meth-05">https://datatracker.ietf.org/doc/ht=
ml/draft-ietf-bmwg-sdn-controller-benchmark-meth-05</a><br>Diff:=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 <a target=3D"_blank" hr=
ef=3D"https://www.ietf.org/rfcdiff?url2=3Ddraft-ietf-bmwg-sdn-controller-be=
nchmark-meth-05">https://www.ietf.org/rfcdiff?url2=3Ddraft-ietf-bmwg-sdn-co=
ntroller-benchmark-meth-05</a><br><br>Abstract:<br>This document defines th=
e methodologies for benchmarking control<br>plane performance of SDN contro=
llers. Terminology related to<br>benchmarking SDN controllers is described =
in the companion<br>terminology document. SDN controllers have been impleme=
nted with<br>many varying designs in order to achieve their intended networ=
k<br>functionality. Hence, the authors have taken the approach of<br>consid=
ering an SDN controller as a black box, defining the<br>methodology in a ma=
nner that is agnostic to protocols and network<br>services supported by con=
trollers. The intent of this document is to<br>provide a standard mechanism=
 to measure the performance of all<br>controller implementations.<br><br>Pl=
ease note that it may take a couple of minutes from the time of submission<=
br>until the htmlized version and diff are available at tools.ietf.org.<br>=
<br>The IETF Secretariat</div></div></div>DISCLAIMER: Privileged and/or Con=
fidential information may be
contained in this message. If you are not the addressee of this message,
you may not copy, use or deliver this message to anyone. In such
event,you should destroy the message and kindly notify the sender by
reply e-mail.
It is understood that opinions or conclusions that do not relate to the
official business of the company are neither given nor endorsed by the
company.
</body></html>

------=_Part_652_491088771.1506961791--


From nobody Fri Oct  6 02:40:14 2017
Return-Path: <internet-drafts@ietf.org>
X-Original-To: bmwg@ietf.org
Delivered-To: bmwg@ietfa.amsl.com
Received: from ietfa.amsl.com (localhost [IPv6:::1]) by ietfa.amsl.com (Postfix) with ESMTP id 1292D134891; Fri,  6 Oct 2017 02:40:06 -0700 (PDT)
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 7bit
From: internet-drafts@ietf.org
To: <i-d-announce@ietf.org>
Cc: bmwg@ietf.org
X-Test-IDTracker: no
X-IETF-IDTracker: 6.63.0
Auto-Submitted: auto-generated
Precedence: bulk
Message-ID: <150728280603.6271.7432428572819005429@ietfa.amsl.com>
Date: Fri, 06 Oct 2017 02:40:06 -0700
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/ALUWU-MhcL0Qzlv9M3gGKytIKtU>
Subject: [bmwg] I-D Action: draft-kishjac-bmwg-evpntest-08.txt
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 06 Oct 2017 09:40:06 -0000

A New Internet-Draft is available from the on-line Internet-Drafts directories.
This draft is a work item of the Benchmarking Methodology WG of the IETF.

        Title           : Benchmarking Methodology for EVPN and PBB-EVPN
        Authors         : Kishore Tiruveedhula
                          Sudhin Jacob
	Filename        : draft-kishjac-bmwg-evpntest-08.txt
	Pages           : 26
	Date            : 2017-10-06

Abstract:
   This document defines the methodologies for benchmarking performance
   of EVPN and PBB-EVPN.EVPN is defined in RFC 7432.It is being deployed
   in provider network.This document provides the benchmarking
   methodologies for EVPN/PBB-EVPN convergence,data plane,control plane
   learning of mac.



The IETF datatracker status page for this draft is:
https://datatracker.ietf.org/doc/draft-kishjac-bmwg-evpntest/

There are also htmlized versions available at:
https://tools.ietf.org/html/draft-kishjac-bmwg-evpntest-08
https://datatracker.ietf.org/doc/html/draft-kishjac-bmwg-evpntest-08

A diff from the previous version is available at:
https://www.ietf.org/rfcdiff?url2=draft-kishjac-bmwg-evpntest-08


Please note that it may take a couple of minutes from the time of submission
until the htmlized version and diff are available at tools.ietf.org.

Internet-Drafts are also available by anonymous FTP at:
ftp://ftp.ietf.org/internet-drafts/


From nobody Fri Oct 13 14:20:34 2017
Return-Path: <session-request@ietf.org>
X-Original-To: bmwg@ietf.org
Delivered-To: bmwg@ietfa.amsl.com
Received: from ietfa.amsl.com (localhost [IPv6:::1]) by ietfa.amsl.com (Postfix) with ESMTP id 8FE961321B6; Fri, 13 Oct 2017 14:20:32 -0700 (PDT)
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 7bit
From: IETF Meeting Session Request Tool <session-request@ietf.org>
To: <session-request@ietf.org>
Cc: warren@kumari.net, bmwg-chairs@ietf.org, smccammon@amsl.com, bmwg@ietf.org
X-Test-IDTracker: no
X-IETF-IDTracker: 6.63.1
Auto-Submitted: auto-generated
Precedence: bulk
Message-ID: <150792963258.23735.10187224444300392196.idtracker@ietfa.amsl.com>
Date: Fri, 13 Oct 2017 14:20:32 -0700
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/J8H8ON_giiZTSJfDvSMfbgxaJXc>
Subject: [bmwg] bmwg - Update to a Meeting Session Request for IETF 100
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 13 Oct 2017 21:20:32 -0000

An update to a meeting session request has just been submitted by Stephanie McCammon, on behalf of the bmwg working group.


---------------------------------------------------------
Working Group Name: Benchmarking Methodology
Area Name: Operations and Management Area
Session Requester: Stephanie McCammon

Number of Sessions: 1
Length of Session(s):  2 Hours
Number of Attendees: 30
Conflicts to Avoid: 
 First Priority: sfc tictoc tsvwg idr nfvrg ippm quic ntp
 Second Priority: saag rmcat tsvarea xrblock irtfopen



People who must be present:
  Al Morton
  Sarah Banks
  Warren Kumari

Resources Requested:

Special Requests:
  Much better participation when session NOT on Friday
&gt;&gt;&gt; 2nd session requested in evening roughly 8PM local time, for remote part. in *both* Europe and US . 10 people plus remote presenters.
---------------------------------------------------------


From nobody Fri Oct 20 17:24:40 2017
Return-Path: <agenda@ietf.org>
X-Original-To: bmwg@ietf.org
Delivered-To: bmwg@ietfa.amsl.com
Received: from ietfa.amsl.com (localhost [IPv6:::1]) by ietfa.amsl.com (Postfix) with ESMTP id 5CC9C134465; Fri, 20 Oct 2017 17:24:12 -0700 (PDT)
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 7bit
From: "\"IETF Secretariat\"" <agenda@ietf.org>
To: <bmwg-chairs@ietf.org>, <acmorton@att.com>
Cc: warren@kumari.net, bmwg@ietf.org
X-Test-IDTracker: no
X-IETF-IDTracker: 6.63.2
Auto-Submitted: auto-generated
Precedence: bulk
Message-ID: <150854545237.20809.18393770664330432075.idtracker@ietfa.amsl.com>
Date: Fri, 20 Oct 2017 17:24:12 -0700
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/-2k96bZ66cBexStwBy8JZFRggII>
Subject: [bmwg] bmwg - Requested session has been scheduled for IETF 100
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 21 Oct 2017 00:24:12 -0000

Dear Al Morton,

The session(s) that you have requested have been scheduled.
Below is the scheduled session information followed by
the original request. 

bmwg Session 1 (2:00:00)
    Thursday, Afternoon Session II 1550-1750
    Room Name: Bras Basah size: 100
    ---------------------------------------------
    


Request Information:


---------------------------------------------------------
Working Group Name: Benchmarking Methodology
Area Name: Operations and Management Area
Session Requester: Al Morton

Number of Sessions: 1
Length of Session(s):  2 Hours
Number of Attendees: 30
Conflicts to Avoid: 
 First Priority: sfc tictoc tsvwg idr nfvrg ippm quic ntp
 Second Priority: saag rmcat tsvarea xrblock irtfopen



People who must be present:
  Warren Kumari
  Sarah Banks
  Al Morton

Resources Requested:

Special Requests:
  Much better participation when session NOT on Friday
&gt;&gt;&gt; 2nd session requested in evening roughly 8PM local time, for remote part. in *both* Europe and US . 10 people plus remote presenters.
---------------------------------------------------------


From nobody Mon Oct 23 05:24:34 2017
Return-Path: <acmorton@att.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B316C138A2C for <bmwg@ietfa.amsl.com>; Mon, 23 Oct 2017 05:24:33 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -5.401
X-Spam-Level: 
X-Spam-Status: No, score=-5.401 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-2.8, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id dzI-B7Lp7qdV for <bmwg@ietfa.amsl.com>; Mon, 23 Oct 2017 05:24:32 -0700 (PDT)
Received: from mx0a-00191d01.pphosted.com (mx0b-00191d01.pphosted.com [67.231.157.136]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 257D31385A7 for <bmwg@ietf.org>; Mon, 23 Oct 2017 05:24:32 -0700 (PDT)
Received: from pps.filterd (m0049463.ppops.net [127.0.0.1]) by m0049463.ppops.net-00191d01. (8.16.0.21/8.16.0.21) with SMTP id v9NCGACt048775 for <bmwg@ietf.org>; Mon, 23 Oct 2017 08:24:30 -0400
Received: from tlpd255.enaf.dadc.sbc.com (sbcsmtp3.sbc.com [144.160.112.28]) by m0049463.ppops.net-00191d01. with ESMTP id 2ds077yxar-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for <bmwg@ietf.org>; Mon, 23 Oct 2017 08:24:29 -0400
Received: from enaf.dadc.sbc.com (localhost [127.0.0.1]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id v9NCOSfD094936 for <bmwg@ietf.org>; Mon, 23 Oct 2017 07:24:29 -0500
Received: from dalint02.pst.cso.att.com (dalint02.pst.cso.att.com [135.31.133.160]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id v9NCORhQ094928 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for <bmwg@ietf.org>; Mon, 23 Oct 2017 07:24:27 -0500
Received: from clpi183.sldc.sbc.com (clpi183.sldc.sbc.com [135.41.1.46]) by dalint02.pst.cso.att.com (RSA Interceptor) for <bmwg@ietf.org>; Mon, 23 Oct 2017 12:24:14 GMT
Received: from sldc.sbc.com (localhost [127.0.0.1]) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id v9NCOEvh029999 for <bmwg@ietf.org>; Mon, 23 Oct 2017 07:24:14 -0500
Received: from mail-azure.research.att.com (mail-azure.research.att.com [135.207.255.18]) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id v9NCO5jk029362 for <bmwg@ietf.org>; Mon, 23 Oct 2017 07:24:09 -0500
Received: from exchange.research.att.com (njmtcas2.research.att.com [135.207.255.47]) by mail-azure.research.att.com (Postfix) with ESMTP id 63A41E0C02 for <bmwg@ietf.org>; Mon, 23 Oct 2017 08:24:04 -0400 (EDT)
Received: from njmtexg5.research.att.com ([fe80::b09c:ff13:4487:78b6]) by njmtcas2.research.att.com ([fe80::d550:ec84:f872:cad9%15]) with mapi id 14.03.0361.001; Mon, 23 Oct 2017 08:24:04 -0400
From: "MORTON, ALFRED C (AL)" <acmorton@att.com>
To: "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: WGLC: draft-ietf-bmwg-sdn-controller-benchmark-term-05 and meth-05
Thread-Index: AdNL9wwgdn0u2xqdRdyOkQFkkPuWzA==
Date: Mon, 23 Oct 2017 12:24:03 +0000
Message-ID: <4D7F4AD313D3FC43A053B309F97543CF48FF6A62@njmtexg5.research.att.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
x-originating-ip: [73.178.187.36]
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-RSA-Inspected: yes
X-RSA-Classifications: public
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:, , definitions=2017-10-23_04:, , signatures=0
X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 impostorscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1707230000 definitions=main-1710230176
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/262zUXo4V5YhMlvcEjO7bqhUF2c>
Subject: [bmwg] WGLC: draft-ietf-bmwg-sdn-controller-benchmark-term-05 and meth-05
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 23 Oct 2017 12:24:34 -0000

BMWG:

A WG Last Call period for the Internet-Drafts on
SDN Controller Benchmarking Terminology and Methodology:

https://tools.ietf.org/html/draft-ietf-bmwg-sdn-controller-benchmark-term-0=
5
https://tools.ietf.org/html/draft-ietf-bmwg-sdn-controller-benchmark-meth-0=
5

will be open from 23 October 2017 through 17 November 2017.

These drafts completed their first WGLC on 15 November 2016,
with comments to address. Subsequent discussion at meetings
yielded additional suggestions for improvement.

These drafts are continuing the BMWG Last Call Process. See
https://www.ietf.org/mail-archive/web/bmwg/current/msg00846.html

Please read and express your opinion on whether or not these
Internet-Drafts should be forwarded to the Area Directors for
publication as Informational RFCs.  Send your comments
to this list or to co-chair acmorton@att.com=20

for the co-chairs,
Al


From nobody Sun Oct 29 08:21:28 2017
Return-Path: <acmorton@att.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 49D4813F560; Sun, 29 Oct 2017 08:21:26 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.621
X-Spam-Level: 
X-Spam-Status: No, score=-2.621 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ObORRZHeakIT; Sun, 29 Oct 2017 08:21:25 -0700 (PDT)
Received: from mx0a-00191d01.pphosted.com (mx0a-00191d01.pphosted.com [67.231.149.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id F415313F569; Sun, 29 Oct 2017 08:21:21 -0700 (PDT)
Received: from pps.filterd (m0049297.ppops.net [127.0.0.1]) by m0049297.ppops.net-00191d01. (8.16.0.21/8.16.0.21) with SMTP id v9TFEnhq022670; Sun, 29 Oct 2017 11:21:20 -0400
Received: from tlpd255.enaf.dadc.sbc.com (sbcsmtp3.sbc.com [144.160.112.28]) by m0049297.ppops.net-00191d01. with ESMTP id 2dvpm80dhr-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sun, 29 Oct 2017 11:21:20 -0400
Received: from enaf.dadc.sbc.com (localhost [127.0.0.1]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id v9TFLIxb093880; Sun, 29 Oct 2017 10:21:19 -0500
Received: from dalint01.pst.cso.att.com (dalint01.pst.cso.att.com [135.31.133.159]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id v9TFLFvs093835 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sun, 29 Oct 2017 10:21:16 -0500
Received: from clpi183.sldc.sbc.com (clpi183.sldc.sbc.com [135.41.1.46]) by dalint01.pst.cso.att.com (RSA Interceptor); Sun, 29 Oct 2017 15:04:15 GMT
Received: from sldc.sbc.com (localhost [127.0.0.1]) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id v9TF4ELX007002; Sun, 29 Oct 2017 10:04:14 -0500
Received: from mail-azure.research.att.com (mail-azure.research.att.com [135.207.255.18]) by clpi183.sldc.sbc.com (8.14.5/8.14.5) with ESMTP id v9TF47uc006646; Sun, 29 Oct 2017 10:04:11 -0500
Received: from exchange.research.att.com (njmtcas2.research.att.com [135.207.255.47]) by mail-azure.research.att.com (Postfix) with ESMTP id 0DA8DE10A0; Sun, 29 Oct 2017 11:04:08 -0400 (EDT)
Received: from njmtexg5.research.att.com ([fe80::b09c:ff13:4487:78b6]) by njmtcas2.research.att.com ([fe80::d550:ec84:f872:cad9%15]) with mapi id 14.03.0361.001; Sun, 29 Oct 2017 11:04:07 -0400
From: "MORTON, ALFRED C (AL)" <acmorton@att.com>
To: "bmwg@ietf.org" <bmwg@ietf.org>
CC: "bmwg-ads@ietf.org" <bmwg-ads@ietf.org>
Thread-Topic: Draft text for Re-Chartering
Thread-Index: AdNQxUrbng5SqNP0TuWo2gqShAGGsA==
Date: Sun, 29 Oct 2017 15:04:06 +0000
Message-ID: <4D7F4AD313D3FC43A053B309F97543CF490202BB@njmtexg5.research.att.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
x-originating-ip: [135.28.170.142]
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-RSA-Inspected: yes
X-RSA-Classifications: public
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:, , definitions=2017-10-29_09:, , signatures=0
X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 impostorscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1707230000 definitions=main-1710290218
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/xE7YzPe7j61x-bgzUX9ETdYU53E>
Subject: [bmwg] Draft text for Re-Chartering
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 29 Oct 2017 15:21:26 -0000

BMWG,

As discussed during our session in Prague, we have
nearly completed all our milestones and (recognizing
the number of new proposals we are tracking) it is time
to re-charter.

Below, please find the revised Charter text in Draft form.
Review will commence now through our session at IETF-100.

Also, it is time to determine which proposals have WG support
at the same time we re-charter, and we will add milestones
for those. Other proposals may need further consideration
as part of our on-going work.=20

In any case, our session at IETF-100 will offer time for
the new charter review and discussion of new work proposals.=20

So, please help the working group by participating
in discussions on the list and during the session!

for the co-chairs,
Al



Description of Working Group:

  The Benchmarking Methodology Working Group (BMWG) will continue to
  produce a series of recommendations concerning the key performance
  characteristics of internetworking technologies, or benchmarks for
  network devices, systems, and services. Taking a view of networking
  divided into planes, the scope of work includes benchmarks for the
  management, control, and forwarding planes.=20

  The scope of BMWG has been extended to develop methods for
  virtual network functions (VNF) and their unique supporting=20
  infrastructure (such as SDN Controllers and vSwitches).=20
  Benchmarks for platform capacity and performance characteristics=20
  of virtual routers, firewalls, signaling control
  gateways, and other forms of gateways are included. =20
  The benchmarks will foster comparisons between physical and virtual=20
  network functions, and also cover unique features of =20
  Network Function Virtualization systems.

  Each recommendation will describe the class of network function, system,=
=20
  or service being addressed; discuss the performance characteristics that
  are pertinent to that class; clearly identify a set of metrics that aid
  in the description of those characteristics; specify the methodologies
  required to collect said metrics; and lastly, present the requirements
  for the common, unambiguous reporting of benchmarking results.

  The set of relevant benchmarks will be developed with input from the
  community of users (e.g., network operators and testing organizations)
  and from those affected by the benchmarks when they are published
  (networking and test equipment manufacturers). When possible, the
  benchmarks and other terminologies will be developed jointly with
  organizations that are willing to share their expertise. Joint review
  requirements for a specific work area will be included in the
  description of the task.

  To better distinguish the BMWG from other measurement initiatives in the
  IETF, the scope of the BMWG is limited to the characterization of
  implementations of various internetworking technologies
  using controlled stimuli in a laboratory environment. Said differently,
  the BMWG does not attempt to produce benchmarks for live, operational
  networks. Moreover, the benchmarks produced by this WG shall strive to
  be vendor independent or otherwise have universal applicability to a
  given technology class.

  Because the demands of a particular technology may vary from deployment
  to deployment, a specific non-goal of the Working Group is to define
  acceptance criteria or performance requirements.

  An ongoing task is to provide a forum for development and
  advancement of measurements which provide insight on the
  capabilities and operation of implementations of inter-networking=20
  technology. Ideally, BMWG should communicate with the operations=20
  community through organizations such as NANOG, RIPE, and APRICOT.

=20
Goals and Milestones:
...
  Dec 2017 - Methodology for SDV Controller Benchmarking to IESG Review
  Dec 2017 - Terminology for SDV Controller Benchmarking to IESG Review

