
From christophe.strobbe@esat.kuleuven.be  Wed Nov  9 05:23:35 2011
Return-Path: <christophe.strobbe@esat.kuleuven.be>
X-Original-To: tap@ietfa.amsl.com
Delivered-To: tap@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4D7B521F8B14 for <tap@ietfa.amsl.com>; Wed,  9 Nov 2011 05:23:35 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 0.555
X-Spam-Level: 
X-Spam-Status: No, score=0.555 tagged_above=-999 required=5 tests=[AWL=1.665,  BAYES_05=-1.11]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Ey4KNUGZKrNM for <tap@ietfa.amsl.com>; Wed,  9 Nov 2011 05:23:30 -0800 (PST)
Received: from cavuit01.kulnet.kuleuven.be (rhcavuit01.kulnet.kuleuven.be [134.58.240.129]) by ietfa.amsl.com (Postfix) with ESMTP id 9C3AA21F8AFA for <tap@ietf.org>; Wed,  9 Nov 2011 05:23:28 -0800 (PST)
X-KULeuven-Envelope-From: christophe.strobbe@esat.kuleuven.be
X-KULeuven-Scanned: Found to be clean
X-KULeuven-ID: B044113809F.ACE32
X-KULeuven-Information: Katholieke Universiteit Leuven
Received: from smtps01.kuleuven.be (smtpshost01.kulnet.kuleuven.be [134.58.240.74]) by cavuit01.kulnet.kuleuven.be (Postfix) with ESMTP id B044113809F; Wed,  9 Nov 2011 14:23:18 +0100 (CET)
Received: from Nunavut.esat.kuleuven.be (telemic-10.esat.kuleuven.be [10.33.136.20]) by smtps01.kuleuven.be (Postfix) with ESMTP id 6770831E702; Wed,  9 Nov 2011 14:23:18 +0100 (CET)
Message-Id: <6.2.5.6.2.20111109131023.02af29c0@esat.kuleuven.be>
X-Mailer: QUALCOMM Windows Eudora Version 6.2.5.6
Date: Wed, 09 Nov 2011 14:23:18 +0100
To: tap@ietf.org
X-Kuleuven: This mail passed the K.U.Leuven mailcluster
From: Christophe Strobbe <christophe.strobbe@esat.kuleuven.be>
Mime-Version: 1.0
Content-Type: text/plain; charset="UTF-8"; format=flowed
Cc: Shadi Abou-Zahra <shadi@w3.org>
Subject: [tap] W3C Evaluation and Report Language (EARL)
X-BeenThere: tap@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Test Anything Protocol WG discussions <tap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tap>, <mailto:tap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tap>
List-Post: <mailto:tap@ietf.org>
List-Help: <mailto:tap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 09 Nov 2011 13:23:35 -0000

Hello,

I am a participant of the W3C's Evaluation and Repair Tools Working 
Group (ERT WG), a working group that develops the Evaluation and 
Report Language (EARL) and a few related specifications. EARL's core 
use case is reporting the results of accessibility evaluations of 
websites (i.e. accessibility for persons with disabilities), but the 
language itself is generic, so it can also be used in other contexts. 
The language is based on RDF; the specification is available at 
<http://www.w3.org/TR/EARL10/>.

During our last call for comments, one of the reviewers asked the 
working group if EARL duplicates TAP's efforts, or vice versa. The 
working group thinks that this is not the case; we think that EARL 
could be an alternative report format for TAP if a TAP consumer could 
be written that produces EARL. For this reason, we thought it would 
be interesting to contact you and to make sure we are aware of each 
other's work.

Shadi Abou-Zahra, in CC, is the working group's chair and W3C staff contact.

Best regards,

Christophe


-- 
Christophe Strobbe
K.U.Leuven - Dept. of Electrical Engineering - SCD
Research Group on Document Architectures
Kasteelpark Arenberg 10 bus 2442
B-3001 Leuven-Heverlee
BELGIUM
tel: +32 16 32 85 51
http://www.docarch.be/
Twitter: @RabelaisA11y
---
Open source for accessibility: results from the AEGIS project 
www.aegis-project.eu
---
Please don't invite me to Facebook, Quechup or other "social 
networks". You may have agreed to their "privacy policy", but I haven't.


From publiustemp-tapx@yahoo.com  Wed Nov  9 07:06:34 2011
Return-Path: <publiustemp-tapx@yahoo.com>
X-Original-To: tap@ietfa.amsl.com
Delivered-To: tap@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 32E2021F8591 for <tap@ietfa.amsl.com>; Wed,  9 Nov 2011 07:06:34 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.74
X-Spam-Level: 
X-Spam-Status: No, score=-0.74 tagged_above=-999 required=5 tests=[BAYES_20=-0.74]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jlAynNpnY5g0 for <tap@ietfa.amsl.com>; Wed,  9 Nov 2011 07:06:29 -0800 (PST)
Received: from nm28-vm0.bullet.mail.ac4.yahoo.com (nm28-vm0.bullet.mail.ac4.yahoo.com [98.139.52.246]) by ietfa.amsl.com (Postfix) with SMTP id 3123C21F858D for <tap@ietf.org>; Wed,  9 Nov 2011 07:06:29 -0800 (PST)
Received: from [98.139.52.190] by nm28.bullet.mail.ac4.yahoo.com with NNFMP; 09 Nov 2011 15:06:25 -0000
Received: from [98.139.52.144] by tm3.bullet.mail.ac4.yahoo.com with NNFMP; 09 Nov 2011 15:06:25 -0000
Received: from [127.0.0.1] by omp1027.mail.ac4.yahoo.com with NNFMP; 09 Nov 2011 15:06:25 -0000
X-Yahoo-Newman-Property: ymail-3
X-Yahoo-Newman-Id: 652028.49262.bm@omp1027.mail.ac4.yahoo.com
Received: (qmail 2907 invoked by uid 60001); 9 Nov 2011 15:06:25 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1320851185; bh=PZv8ocdW6J3kndPWXVKqYdqwBL2NZKgKliZLEkXry3M=; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=fNw/efrQwqSV8wUPikmH7snR3pQi1O/HzEBB4W3CUOHwH13W22tmWRszW2yvE6dRRtZHzbEhXVnplq7kNfDUhZAdU30APg4fNGNdSBcn3PbGlAMyVWHDL0zXgAPE4aKH9hHgz0XtG8QZXhF4jVBG9IhgrX4l4hlhIvZNAvl0PAM=
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=1fW8My/kbW8vP3qRMJS8EVY6oZgjiA1qk7BanYS32Z3yFvwa7J3/bnN7uaI/sek6o2YUyJG5ZvQW6Haf8PNp1q0GxS5PYB/JPMvhzQ2eacl5KX/5pfAinl6ggcR+i+pwpe0xLRSPy75Ahv/1Fwls9q+0qAH/fmMMRCQl+bJhvbw=;
X-YMail-OSG: eATu21oVM1lWOgme_M_6F1FhbF6c0Byisa4181U6NDC5pj_ 2DkPPwjJbzuQ4gFzIWxQg4IWyMg0TMNq8006fyffP4_BNNd1iV0RTFSY0MqV gUyc6xX9s.dnmvN0ZJadnZExtlRzpbSlVzalX.oQVwOD7ZgEBojRdIGMlpHh fjK4kF2OL85uZoBRXj5nVlDuPvYQq8_2MLNUduQtPRVWLo9Ms7ZkDKwX2czF uBjZMS4wAzv0y5e3ahvu5s7dKMPLZ3Bzrc8bbmj7eJnEI3L.o_VS5zKdg6t4 jcYE6wbcFFESE6vHQfyrth.NQvY3dxrQFHO7gWYMfUyPC3RsM1UfkujB9L.6 0IxDJ8.UprAY5bGD1xmfyaM3eoqUOVo9nqoa6Lg_P0ovwvuPu1et_H29eGzy oE3cijPE5w7mwoD0kN8RqdN1HPsj0vHZECcw6AC3XfM_X3IZ_ShhzVeKjGzi wMMJE_QD4sZdaOPitQ_BWdPtqSxLccOOpTGv2Q41eYzTWITXRFawBUNneAJL 1g_HxWzKUDQ8qUgItTer0_q0eo0fkrs87WdNt1RXB5qCvkdXmHRr4TVsIh0m jqszG.s6b5H_qCvMzCTim6q8eWduahbbq6E0LWqrAncN8GncFCY03HGtMKoa .8e4IXfJ0TH4pRS06IAbNH8wgQcU9NR5Q.p9JTX0hBSGql5y.F1BFPv6fILW 7EyHQRzEgHdYlm.6.eAyEHEaHvFmi25S5PMN6QMe1Q1l8TBv3urE3yltsdUf 8UfI4u1RVUfFJOkKDJo9z4c25tdcPrOa5_wgb497Ia5NYhgq5tWS9rz7I1zG UymQKppfJY.osax7P5Ydr62dPLmA2CQ5m0qwd6ssFKwrbn0Bkl3V0L2BZBjN YlKSYBc3tx3_iXqobhGslCa231G90IDwwe8jXXJl9NQ8FS4Q6fKd_qY5omr5 43nkg8JbQKD9642yVZ0Q.b.C7zBpdh.H4UDDYhZZ9xbeoYO7AkdSpCOv5gGp ZnuKzZQKSlGddg_tkw_dUfJUqh_eA6OyNuwQaxAIF6Q6J9Zq4EE8M0tlX8xZ VINQqcf4HsA--
Received: from [62.190.51.12] by web65712.mail.ac4.yahoo.com via HTTP; Wed, 09 Nov 2011 07:06:25 PST
X-Mailer: YahooMailWebService/0.8.114.317681
References: <6.2.5.6.2.20111109131023.02af29c0@esat.kuleuven.be>
Message-ID: <1320851185.97865.YahooMailNeo@web65712.mail.ac4.yahoo.com>
Date: Wed, 9 Nov 2011 07:06:25 -0800 (PST)
From: Ovid <publiustemp-tapx@yahoo.com>
To: Christophe Strobbe <christophe.strobbe@esat.kuleuven.be>, "tap@ietf.org" <tap@ietf.org>
In-Reply-To: <6.2.5.6.2.20111109131023.02af29c0@esat.kuleuven.be>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
Cc: Shadi Abou-Zahra <shadi@w3.org>
Subject: Re: [tap] W3C Evaluation and Report Language (EARL)
X-BeenThere: tap@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
Reply-To: Ovid <publiustemp-tapx@yahoo.com>
List-Id: Test Anything Protocol WG discussions <tap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tap>, <mailto:tap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tap>
List-Post: <mailto:tap@ietf.org>
List-Help: <mailto:tap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 09 Nov 2011 15:06:34 -0000

Hi Christophe,=0A=0AThanks for dropping us a note.=0A=0AJust from glancing =
through the EARL specs, it appears that there is some overlap, but the two =
are not congruent. A TAP producer would have a difficult time producing the=
 requisite output for a few reasons.=0A=0A1. You produce output we don't su=
pport natively in a TAP stream.=0A2. RDF documents are, well, documents, no=
t streams.=0A=0AWe're working on a proposal which could address some of poi=
nt #1, but as TAP allows for infinite streams (for example, repeatedly ping=
ing a server to see that it's responsive), I don't think an infinite stream=
 wouldn't be well-represented in a documented-oriented protocol.=0A=0AAs a =
side note, from glancing at=A0http://trac.usefulinc.com/doap/wiki/ProjectGo=
als:=0A=0A* We don't support "suspend[ing] more zombies in the row".=0A* I'=
m uncertain how you plan to extend the vocabulary for=A0http://hepburnsprin=
gsaccommodation.webs.com=0A* Zombies are actually made of tasty, tasty spam=
 (we eat them and before they eat us)=0A=0AYou might want someone to take a=
 look at that page and clean up the spam :)=0A=0ACheers,=0AOvid=0A--=0ALive=
 and work overseas - http://overseas-exile.blogspot.com/=0ABuy the book=A0=
=A0=A0=A0=A0=A0=A0=A0=A0=A0 - http://www.oreilly.com/catalog/perlhks/=0ATec=
h blog=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0- http://blogs.perl.org/use=
rs/ovid/=0ATwitter=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0- http://=
twitter.com/OvidPerl/=0A=0A=0A>________________________________=0A>From: Ch=
ristophe Strobbe <christophe.strobbe@esat.kuleuven.be>=0A>To: tap@ietf.org=
=0A>Cc: Shadi Abou-Zahra <shadi@w3.org>=0A>Sent: Wednesday, 9 November 2011=
, 14:23=0A>Subject: [tap] W3C Evaluation and Report Language (EARL)=0A>=0A>=
Hello,=0A>=0A>I am a participant of the W3C's Evaluation and Repair Tools W=
orking Group (ERT WG), a working group that develops the Evaluation and Rep=
ort Language (EARL) and a few related specifications. EARL's core use case =
is reporting the results of accessibility evaluations of websites (i.e. acc=
essibility for persons with disabilities), but the language itself is gener=
ic, so it can also be used in other contexts. The language is based on RDF;=
 the specification is available at <http://www.w3.org/TR/EARL10/>.=0A>=0A>D=
uring our last call for comments, one of the reviewers asked the working gr=
oup if EARL duplicates TAP's efforts, or vice versa. The working group thin=
ks that this is not the case; we think that EARL could be an alternative re=
port format for TAP if a TAP consumer could be written that produces EARL. =
For this reason, we thought it would be interesting to contact you and to m=
ake sure we are aware of each other's work.=0A>=0A>Shadi Abou-Zahra, in CC,=
 is the working group's chair and W3C staff contact.=0A>=0A>Best regards,=
=0A>=0A>Christophe=0A>=0A>=0A>-- Christophe Strobbe=0A>K.U.Leuven - Dept. o=
f Electrical Engineering - SCD=0A>Research Group on Document Architectures=
=0A>Kasteelpark Arenberg 10 bus 2442=0A>B-3001 Leuven-Heverlee=0A>BELGIUM=
=0A>tel: +32 16 32 85 51=0A>http://www.docarch.be/=0A>Twitter: @RabelaisA11=
y=0A>---=0A>Open source for accessibility: results from the AEGIS project w=
ww.aegis-project.eu=0A>---=0A>Please don't invite me to Facebook, Quechup o=
r other "social networks". You may have agreed to their "privacy policy", b=
ut I haven't.=0A>=0A>_______________________________________________=0A>tap=
 mailing list=0A>tap@ietf.org=0A>https://www.ietf.org/mailman/listinfo/tap=
=0A>=0A>=0A>

From ss5@renormalist.net  Wed Nov  9 12:25:07 2011
Return-Path: <ss5@renormalist.net>
X-Original-To: tap@ietfa.amsl.com
Delivered-To: tap@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 34E7B1F0C53 for <tap@ietfa.amsl.com>; Wed,  9 Nov 2011 12:25:07 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.999
X-Spam-Level: 
X-Spam-Status: No, score=-1.999 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, J_CHICKENPOX_43=0.6]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Qts+DoMi8b9w for <tap@ietfa.amsl.com>; Wed,  9 Nov 2011 12:25:06 -0800 (PST)
Received: from h132974.serverkompetenz.net (renormalist.net [81.169.141.46]) by ietfa.amsl.com (Postfix) with ESMTP id 34D211F0C7F for <tap@ietf.org>; Wed,  9 Nov 2011 12:25:05 -0800 (PST)
Received: by h132974.serverkompetenz.net (Postfix, from userid 1000) id 4B4583F23ED; Wed,  9 Nov 2011 20:25:04 +0000 (GMT)
From: Steffen Schwigon <ss5@renormalist.net>
To: Christophe Strobbe <christophe.strobbe@esat.kuleuven.be>
References: <6.2.5.6.2.20111109131023.02af29c0@esat.kuleuven.be>
Date: Wed, 09 Nov 2011 20:25:04 +0000
In-Reply-To: <6.2.5.6.2.20111109131023.02af29c0@esat.kuleuven.be> (Christophe Strobbe's message of "Wed, 09 Nov 2011 14:23:18 +0100")
Message-ID: <87d3d1qc0v.fsf@renormalist.net>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Cc: tap@ietf.org, Shadi Abou-Zahra <shadi@w3.org>
Subject: Re: [tap] W3C Evaluation and Report Language (EARL)
X-BeenThere: tap@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Test Anything Protocol WG discussions <tap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tap>, <mailto:tap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tap>
List-Post: <mailto:tap@ietf.org>
List-Help: <mailto:tap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 09 Nov 2011 20:25:07 -0000

Christophe Strobbe <christophe.strobbe@esat.kuleuven.be> writes:
> Report Language (EARL) and a few related specifications. EARL's core
> use case is reporting the results of accessibility evaluations of
> websites (i.e. accessibility for persons with disabilities), but the
> language itself is generic, so it can also be used in other
> contexts. The language is based on RDF;
> [=E2=80=A6]
> During our last call for comments, one of the reviewers asked the
> working group if EARL duplicates TAP's efforts, or vice versa. The
> working group thinks that this is not the case; we think that EARL
> could be an alternative report format for TAP if a TAP consumer could
> be written that produces EARL. For this reason, we thought it would be
> interesting to contact you and to make sure we are aware of each
> other's work.

Thanks for sync'ing this back to us. I just skimmed through the specs
and it was indeed interesting. As far as I understand from my (very
short) skimming I think it's not that many duplication of effort as the
main difference is a philosophical one.

- EARL is similar to other W3C specs in respect to specifying a
  comprehensive snapshot of known existing topics. For example, it
  particularly covers all known HTTP methods (POST, GET, PUT, =E2=80=A6). T=
hat
  enables it to build tools on top of it that sematically =E2=80=9Cknow=E2=
=80=9D what
  the document is about.

- TAP in contrast is about specifying test results, really just the
  *result* focus without hard specification of the tested topic, i.e., a
  single test has a =E2=80=9Cdescription=E2=80=9D, so someone reading it kn=
ows what it
  is about but that part does not have a specification.=20

  For instance, a test about a HTTP method could have any description
  from =E2=80=9CPOST=E2=80=9D to =E2=80=9Cthat strange other method that I =
never remember but
  always use when GET is not sufficient=E2=80=9D.


See [1] for some related discussion of this aspect.

In this respect I think TAP is more like your RDF with some extensions
from EARL to describe test success.

That makes the use-cases of TAP and EARL a bit different:=20

- TAP allows to be produced by anything simple without toolchain
  support, like embedded devices with nothing but a =E2=80=9Cprint=E2=80=9D=
 function,
  but you can not *sematically* evaluate results.

- EARL seems to require more heavy toolchain support to produce but
  allows more semantic result evaluation.

Converting TAP to EARL is difficult.=20
Converting EARL to TAP is easy.

On the evaluation of TAP I can point to TAP::DOM and Data::DPath, which
provide a more structured approach to evaluate test results, see my =E2=80=
=9CTAP
Juggling=E2=80=9D slides[2], page 30ff.

Kind regards,
Steffen


Footnotes:=20
[1]  http://grokbase.com/p/perl.org/qa/2008/04/re-tap-l-user-supplied-yaml-=
diagnostic-keys-descriptive-version/11ymnpm2765ztojoinznq2lz5674

[2]  http://www.amd64.org/fileadmin/user_upload/pub/yapc_eu_2011_tapjugglin=
g.pdf

--=20
Steffen Schwigon <ss5@renormalist.net>
Dresden Perl Mongers <http://dresden-pm.org/>

From fawaka@gmail.com  Wed Nov  9 12:50:02 2011
Return-Path: <fawaka@gmail.com>
X-Original-To: tap@ietfa.amsl.com
Delivered-To: tap@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 889361F0C7F for <tap@ietfa.amsl.com>; Wed,  9 Nov 2011 12:50:02 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -3.599
X-Spam-Level: 
X-Spam-Status: No, score=-3.599 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, RCVD_IN_DNSWL_LOW=-1]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id yFSPJCNjgGIU for <tap@ietfa.amsl.com>; Wed,  9 Nov 2011 12:50:02 -0800 (PST)
Received: from mail-vx0-f172.google.com (mail-vx0-f172.google.com [209.85.220.172]) by ietfa.amsl.com (Postfix) with ESMTP id E0C351F0C74 for <tap@ietf.org>; Wed,  9 Nov 2011 12:50:01 -0800 (PST)
Received: by vcbfk1 with SMTP id fk1so2045566vcb.31 for <tap@ietf.org>; Wed, 09 Nov 2011 12:50:01 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type:content-transfer-encoding; bh=4RZIA55Kb0QBESxeBvpCu/vEUH+L1Wy9S9mX2rFfVsk=; b=EQhRvKuAnGt1o9cesbTVcIMhtB3o6duwykb3SGh8oaQaMAcmctIUEirNulCf7ZUfcV 0QS4HqxdojJnLYLa0xQngC2ZeNKr5gkKIvHZdpezQnlGsKdVVpnATb10fjHq4/8B60CM 1dTj3jaM0jHURhUo9ZFHch1msLZK0pQsO8mNs=
Received: by 10.52.173.211 with SMTP id bm19mr7107093vdc.115.1320871801123; Wed, 09 Nov 2011 12:50:01 -0800 (PST)
MIME-Version: 1.0
Received: by 10.52.115.134 with HTTP; Wed, 9 Nov 2011 12:49:40 -0800 (PST)
In-Reply-To: <87d3d1qc0v.fsf@renormalist.net>
References: <6.2.5.6.2.20111109131023.02af29c0@esat.kuleuven.be> <87d3d1qc0v.fsf@renormalist.net>
From: Leon Timmermans <fawaka@gmail.com>
Date: Wed, 9 Nov 2011 21:49:40 +0100
Message-ID: <CAHhgV8h9-W5h8gNQGVv=q4kiZ38KvvJ2gedxcNsrnc1CdAJDJA@mail.gmail.com>
To: Steffen Schwigon <ss5@renormalist.net>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Cc: tap@ietf.org, Shadi Abou-Zahra <shadi@w3.org>
Subject: Re: [tap] W3C Evaluation and Report Language (EARL)
X-BeenThere: tap@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Test Anything Protocol WG discussions <tap.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tap>, <mailto:tap-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/tap>
List-Post: <mailto:tap@ietf.org>
List-Help: <mailto:tap-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tap>, <mailto:tap-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 09 Nov 2011 20:50:02 -0000

On Wed, Nov 9, 2011 at 9:25 PM, Steffen Schwigon <ss5@renormalist.net> wrot=
e:
> - EARL is similar to other W3C specs in respect to specifying a
> =C2=A0comprehensive snapshot of known existing topics. For example, it
> =C2=A0particularly covers all known HTTP methods (POST, GET, PUT, =E2=80=
=A6). That
> =C2=A0enables it to build tools on top of it that sematically =E2=80=9Ckn=
ow=E2=80=9D what
> =C2=A0the document is about.
>
> - TAP in contrast is about specifying test results, really just the
> =C2=A0*result* focus without hard specification of the tested topic, i.e.=
, a
> =C2=A0single test has a =E2=80=9Cdescription=E2=80=9D, so someone reading=
 it knows what it
> =C2=A0is about but that part does not have a specification.
>
> =C2=A0For instance, a test about a HTTP method could have any description
> =C2=A0from =E2=80=9CPOST=E2=80=9D to =E2=80=9Cthat strange other method t=
hat I never remember but
> =C2=A0always use when GET is not sufficient=E2=80=9D.
>
>
> See [1] for some related discussion of this aspect.
>
> In this respect I think TAP is more like your RDF with some extensions
> from EARL to describe test success.
>
> That makes the use-cases of TAP and EARL a bit different:
>
> - TAP allows to be produced by anything simple without toolchain
> =C2=A0support, like embedded devices with nothing but a =E2=80=9Cprint=E2=
=80=9D function,
> =C2=A0but you can not *sematically* evaluate results.
>
> - EARL seems to require more heavy toolchain support to produce but
> =C2=A0allows more semantic result evaluation.

I agree. To me, EARL makes sense in a context that heavy into semantic
web and triplestores, but the toolchain would be too heavy for a lot
of usecases.

> Converting TAP to EARL is difficult.
> Converting EARL to TAP is easy.

Making valid EARL out of TAP shouldn't be difficult. Useful EARL on
the other hand

> On the evaluation of TAP I can point to TAP::DOM and Data::DPath, which
> provide a more structured approach to evaluate test results, see my =E2=
=80=9CTAP
> Juggling=E2=80=9D slides[2], page 30ff.

Interesting=E2=80=A6

Leon
