EON2006: Call for Evaluations and Demos for the Ontology Evaluation Challenge

Apologies for cross-posting. Please forward this mail to anyone interested.

***********************************************************************

CALL FOR EVALUATIONS AND DEMOS

Ontology Evaluation Challenge at the
4th International EON Workshop
Workshop on Evaluation of Ontologies for the Web (EON2006)

<http://km.aifb.uni-karlsruhe.de/ws/eon2006>

Held in conjunction with the
15th International World Wide Web Conference

Edinburgh International Conference Center, Edinburgh, UK
May 22nd, 2006

***********************************************************************

OBJECTIVES
==========

In this year's EON workshop we bring together researchers and practitioners
interested in the evaluation of ontologies for the web. The aim of this
workshop is to ground Ontology Evaluation firmly on the needs of the
Semantic Web, especially regarding its web-like characteristics like high
interconnectivity, constant change and incompleteness.

EVALUATION AND DEMOS
====================

At the EON workshop there will be a practical session, where a number of
ontologies are to be evaluated by the participants beforehand and the
results being discussed at the workshop. In order to obtain an intensive
exchange of ideas between the participants, there will be left extensive
time for discussion. The previous workshops (EON2002, EON2003 and EON2004)
proposed a series of experiments for evaluating different aspects of
ontology tools, e.g. their expressiveness and interoperability capabilities.


This year we focus on ontologies themselves. The EON2006 workshop is
intended to be a platform to discuss results and further steps with
interested parties. We explicitly encourage people to make demos of their
tools. We will reserve time slots for demos in the workshop.

We ask all participants to evaluate a number of ontologies according to
their approaches. The workshop will facilitate discussion by comparing the
results of the participants. This is not meant as a test or as homework,
because we also don’t know the correct results, if there are any – it is the
goal of this workshop to move towards an answer for this very question. The
ontologies can be downloaded at the workshop’s website.

A final panel will discuss the research agenda for the coming years, based
on the presentations and results from the demos, evaluations and
discussions.

IMPORTANT DATES
===============

Demo proposals due: April 14th, 2006
Evaluation results submission: April 14th, 2006
Notification on demos: April 21st, 2006
Notification on evaluation: April 21st, 2006
Workshop: May 22nd, 2006

SUBMISSIONS FOR DEMO PROPOSALS
==============================

Interested presenters should submit an electronic PDF of their demo proposal
to eon2006@aifb.uni-karlsruhe.de prior to the deadline. The proposal should
include include: title, author names, affiliations, and electronic mail
addresses for all authors, a brief abstract, a screenshot, and a short
description of what will be shown in the demo. All correspondence will be
sent to the author mentioned as contact person in the electronic title page
(by default, the first author). Demo proposals should not exceed 2 pages and
should be formatted according to the guidelines of the WWW conference (see
<http://www2006.org/cfp/submissions.php> ).

SUBMISSIONS OF EVALUATION RESULTS
=================================

Interested authors should submit an electronic PDF and source version of
their evaluation results to eon2006@aifb.uni-karlsruhe.de prior to the
deadline. Evaluation results should be formatted according to the guidelines
of the WWW conference (see http://www2006.org/cfp/submissions.php ). All
correspondence will be sent to the author mentioned as contact person in the
electronic title page (by default, the first author).

Evaluations need to include the following: title, author names,
affiliations, and electronic mail addresses for all authors, a brief
abstract, a short summary of the evaluation approach (up to one page), the
results of each performed ontology evaluation, sorted by the ontologies, and
how much time the evaluation of each ontology took. For each ontology you
did not evaluate explain why. We do not want to limit the length of the
evaluation results, as this will depend heavily on your approach, but we ask
you to keep them concise. Detailed results should be delivered in an
ontology itself. A simple starting point for the format is provided, but
needs to be extended by the evaluators needs. For the publication of the
ontology evaluation results we will work out a format with the authors
individually, depending on the number and form of submissions. For the
workshop we will distribute all accepted evaluation results in order to ease
discussion. The form of the final publication of the evaluation results will
be decided later and depends on the quality and number of submitted
evaluations.

ONTOLOGIES
==========

The ontologies are available at
<http://km.aifb.uni-karlsruhe.de/ws/eon2006/ontoeval.zip>
Here we describe the ontologies shortly. We ask you to evaluate each of the
four ontologies, so that we can discuss our findings and compare the
evaluation approaches.

oe1: This is a single file with metadata about Elvis impersonators. It was
developed by a single person.

oe2: The ROVE ontology describes the Summer School for Ontology Engineering
and the Semantic Web 2005. It was developed by a small team.

oe3: This is the metadata about the AIFB institute. The SWRC ontology
provides the vocabulary. The instance data, although offered in one file, is
being editet by all members of the AIFB institute, not all of them
knowledgeable in the Semantic Web domain.

oe4: This is a collection of more than a hundred FOAF-files taken from the
web. The source URIs are included. We regard this collection as a standard
situation on the Semantic Web, where information will be compiled from
several, decentralized sources. We regard this collection as one ontology.


ORGANIZERS
==========

* Denny Vrandecic, Institute AIFB, University of Karlsruhe, Germany
* Mari Carmen Suarez-Figueroa, Facultad de Informatica, Universidad
Politecnica de Madrid, Spain
* Aldo Gangemi, Laboratory for Applied Ontology, Institute for Cognitive
Sciences and Technology, Rome, Italy
* York Sure, Institute AIFB, University of Karlsruhe, Germany

PROGRAM COMMITTEE
=================

* Sean Bechhofer, University of Manchester (UK)
* Christopher Brewster, University of Sheffield (UK)
* Dan Brickley, Semantic Web Vapourware Ltd and ILRT, University of Bristol
(UK)
* Oscar Corcho, University of Manchester (UK)
* Roberta Cuel, University of Trento (IT)
* Mariano Fernandez-Lopez, Universidad Politecnica de Madrid (ES)
* Asuncion Gomez-Perez, Universidad Politecnica de Madrid (ES)
* Marko Grobelnik, Jozef Stefan Institute (SI)
* Nicola Guarino, Laboratory for Applied Ontology (IT)
* Kouji Kozaki, Osaka University (JP)
* Deborah McGuinness, Stanford University (US)
* Libby Miller, Asemantics (IT)
* Enrico Motta, Open University (UK)
* Elena Paslaru Bontas, Freie Universitaet Berlin (DE)
* Sofia Pinto, Technical University of Lisbon (PT)
* Robert Porzel, European Media Laboratory (DE)
* Steffen Staab, Universität Koblenz (DE)
* Rudi Studer, University of Karlsruhe (DE)
* Chris Welty, IBM (US)

CONTACT
=======

You may enquire all further information from Denny Vrandecic,
denny@aifb.uni-karlsruhe.de

WORKSHOP HOMEPAGE
=================

http://km.aifb.uni-karlsruhe.de/ws/eon2006


--
Dr. York Sure
Institute AIFB, University of Karlsruhe (TH)
phone: +49 (0) 721 608 6592
web: http://www.aifb.uni-karlsruhe.de/WBS/ysu

Received on Thursday, 16 March 2006 14:41:13 UTC