W3C home > Mailing lists > Public > public-owl-dev@w3.org > April to June 2006

EON2006 - Evaluating ontologies for the web - Call for Evaluation and Demos

From: Denny Vrandecic <dvr@aifb.uni-karlsruhe.de>
Date: Wed, 12 Apr 2006 19:29:18 +0200
Message-ID: <443D38EE.20606@aifb.uni-karlsruhe.de>
To: semantic-web@w3.org, sekt@aifb.uni-karlsruhe.de

We are looking for your ontology evaluation tools and evaluation 
results! You also can find the list of accepted presentations on the 
EON2006 website at http://km.aifb.uni-karlsruhe.de/ws/eon2006

Apologies for cross-posting. Please forward this mail to anyone interested.



Ontology Evaluation Challenge at the
4th International EON Workshop
Workshop on Evaluation of Ontologies for the Web (EON2006)


Held in conjunction with the
15th International World Wide Web Conference

Edinburgh International Conference Center, Edinburgh, UK
May 22nd, 2006



In this year's EON workshop we bring together researchers and 
practitioners interested in the evaluation of ontologies for the web. 
The aim of this workshop is to ground Ontology Evaluation firmly on the 
needs of the Semantic Web, especially regarding its web-like 
characteristics like high interconnectivity, constant change and 


At the EON workshop there will be a practical session, where a number of 
ontologies are to be evaluated by the participants beforehand and the 
results being discussed at the workshop. In order to obtain an intensive 
exchange of ideas between the participants, there will be left extensive 
time for discussion. The previous workshops (EON2002, EON2003 and 
EON2004) proposed a series of experiments for evaluating different 
aspects of ontology tools, e.g. their expressiveness and 
interoperability capabilities.

This year we focus on ontologies themselves. The EON2006 workshop is 
intended to be a platform to discuss results and further steps with 
interested parties. We explicitly encourage people to make demos of 
their tools. We will reserve time slots for demos in the workshop.

We ask all participants to evaluate a number of ontologies according to 
their approaches. The workshop will facilitate discussion by comparing 
the results of the participants. This is not meant as a test or as 
homework, because we also don’t know the correct results, if there are 
any – it is the goal of this workshop to move towards an answer for this 
very question. The ontologies can be downloaded at the workshop’s website.

A final panel will discuss the research agenda for the coming years, 
based on the presentations and results from the demos, evaluations and 


Demo proposals due: April 14th, 2006
Evaluation results submission: April 14th, 2006
Notification on demos: April 21st, 2006
Notification on evaluation: April 21st, 2006
Workshop: May 22nd, 2006


Interested presenters should submit an electronic PDF of their demo 
proposal to eon2006@aifb.uni-karlsruhe.de prior to the deadline. The 
proposal should include include: title, author names, affiliations, and 
electronic mail addresses for all authors, a brief abstract, a 
screenshot, and a short description of what will be shown in the demo. 
All correspondence will be sent to the author mentioned as contact 
person in the electronic title page (by default, the first author). Demo 
proposals should not exceed 2 pages and should be formatted according to 
the guidelines of the WWW conference (see 
<http://www2006.org/cfp/submissions.php> ).


Interested authors should submit an electronic PDF and source version of 
their evaluation results to eon2006@aifb.uni-karlsruhe.de prior to the 
deadline. Evaluation results should be formatted according to the 
guidelines of the WWW conference (see 
http://www2006.org/cfp/submissions.php ). All correspondence will be 
sent to the author mentioned as contact person in the electronic title 
page (by default, the first author).

Evaluations need to include the following: title, author names, 
affiliations, and electronic mail addresses for all authors, a brief 
abstract, a short summary of the evaluation approach (up to one page), 
the results of each performed ontology evaluation, sorted by the 
ontologies, and how much time the evaluation of each ontology took. For 
each ontology you did not evaluate explain why. We do not want to limit 
the length of the evaluation results, as this will depend heavily on 
your approach, but we ask you to keep them concise. Detailed results 
should be delivered in an ontology itself. A simple starting point for 
the format is provided, but needs to be extended by the evaluators 
needs. For the publication of the ontology evaluation results we will 
work out a format with the authors individually, depending on the number 
and form of submissions. For the workshop we will distribute all 
accepted evaluation results in order to ease discussion. The form of the 
final publication of the evaluation results will be decided later and 
depends on the quality and number of submitted evaluations.


The ontologies are available at 
Here we describe the ontologies shortly. We ask you to evaluate each of 
the four ontologies, so that we can discuss our findings and compare the 
evaluation approaches.

oe1: This is a single file with metadata about Elvis impersonators. It 
was developed by a single person.

oe2: The ROVE ontology describes the Summer School for Ontology 
Engineering and the Semantic Web 2005. It was developed by a small team.

oe3: This is the metadata about the AIFB institute. The SWRC ontology 
provides the vocabulary. The instance data, although offered in one 
file, is being editet by all members of the AIFB institute, not all of 
them knowledgeable in the Semantic Web domain.

oe4: This is a collection of more than a hundred FOAF-files taken from 
the web. The source URIs are included. We regard this collection as a 
standard situation on the Semantic Web, where information will be 
compiled from several, decentralized sources. We regard this collection 
as one ontology.


* Denny Vrandecic, Institute AIFB, University of Karlsruhe, Germany
* Mari Carmen Suarez-Figueroa, Facultad de Informatica, Universidad 
Politecnica de Madrid, Spain
* Aldo Gangemi, Laboratory for Applied Ontology, Institute for Cognitive 
Sciences and Technology, Rome, Italy
* York Sure, Institute AIFB, University of Karlsruhe, Germany


* Sean Bechhofer, University of Manchester (UK)
* Christopher Brewster, University of Sheffield (UK)
* Dan Brickley, Semantic Web Vapourware Ltd and ILRT, University of 
Bristol (UK)
* Oscar Corcho, University of Manchester (UK)
* Roberta Cuel, University of Trento (IT)
* Mariano Fernandez-Lopez, Universidad Politecnica de Madrid (ES)
* Asuncion Gomez-Perez, Universidad Politecnica de Madrid (ES)
* Marko Grobelnik, Jozef Stefan Institute (SI)
* Nicola Guarino, Laboratory for Applied Ontology (IT)
* Kouji Kozaki, Osaka University (JP)
* Deborah McGuinness, Stanford University (US)
* Libby Miller, Asemantics (IT)
* Enrico Motta, Open University (UK)
* Elena Paslaru Bontas, Freie Universitaet Berlin (DE)
* Sofia Pinto, Technical University of Lisbon (PT)
* Robert Porzel, European Media Laboratory (DE)
* Steffen Staab, Universität Koblenz (DE)
* Rudi Studer, University of Karlsruhe (DE)
* Chris Welty, IBM (US)


You may enquire all further information from Denny Vrandecic, 


Received on Wednesday, 12 April 2006 17:29:59 UTC

This archive was generated by hypermail 2.3.1 : Tuesday, 6 January 2015 20:58:14 UTC