Re: sws matchmaker contest

Dear all,

I reckognise the rather opposite approach taken by the SWS challenge 
compared to that of the S3 contest of SWS matchmakers I am planning.
Both have their value from different perspectives and goals in mind.

Some minor remarks to the response from the SWS challenge PC:

> Research is required how to actually make good representations: a test
> set given in some formal semantics specification language will be
> biased toward some specific approach (and be partly provide already a
> solution to the overall challenge). 

I disagree with that a test set would be automtically biased toward some
approach and partly provie a solution. In fact, it refers to the
traditional challenge of creating a good test collection that can be 
used not only for a few selected use case scenarios like in your SWS 
challenge but many different domains like it has been successfully
achieved with the TREC test collection in the text IR domain supported 
also by some major industrial stakeholders.

However, the opposite approach of the SWS challenge to start with few
conventional WSDL services and let the participants actually try to
generate and use their own appropriate *semantic* web services to
find and improve the quality of the solution can, as a grass-root 
approach starting from WSDL contribute to the generation of a test
collection for the S3 collection.

> Because of these differences in intent, we did not make a concrete
> collaboration with Mathias' matchmaking workshop. However we believe
> the community should not split. There should certainly be
> synergy between these efforts.  We offer to use of our
> open infrastructure for the matchmaking contest, in any way
> that is useful.

Due to project related deadlines, I am planning with some
colleagues in the EU funded CASCOM project to start a preliminary S3
contest with four open source and different OWL-S matchmakers at DFKI
hopefully next week. R/P evaluation will be done first by use of the
OWLS-TC 2.1. We will of course keep you update on this and report on the
results. However, these tests are to be considered preliminary only in
that the main task of a real S3 contest has to be accomplished still,
that is a large scale test collection for both OWL-S and WSML services,
and even SA-WSDL, if possible.

As to the offer of the SWS challenge PC to help in this matter,
I would be very happy if you could provide us with the set
of domain-specific OWL-S services with their WSDL grounding
(relevance set and service request) towards an extension of
the open source OWLS-TC 2.1.

As to a meeting at ISWC, it seems to be hard if not impossible to
synchronize with all interested people having conflicting
travel arrangements and schedules for ISWC. Therefore I would
like to suggest that anybody who is interested in the extension of 
OWLS-TC2 and the S3 contest should informally meet on Nov 7 right after
Tom Gruber's invited talk in the coffee break, then we can
quickly check how we can proceed from there (maybe during lunch, in the
evening ?), and also to continue our discussion after the ISWC in the 
Wiki, Holger did set up for us.

best regards, matthias

> 
> regards
>   SWS Challenge PC
>   Charles, Michal, Holger
> 
__________________________________________________
Dr. Matthias Klusch
German Research Center for Artificial Intelligence
Stuhlsatzenhausweg 3
66123 Saarbruecken, Germany
Phone: +49-681-302-5297, Fax: +49-681-302-2235
http://www.dfki.de/~klusch/, klusch@dfki.de
__________________________________________________

Received on Friday, 27 October 2006 11:54:54 UTC