- From: York Sure <sure@aifb.uni-karlsruhe.de>
- Date: Thu, 16 Mar 2006 15:39:56 +0100
- To: <semantic-web@w3.org>
Apologies for cross-posting. Please forward this mail to anyone interested. *********************************************************************** CALL FOR EVALUATIONS AND DEMOS Ontology Evaluation Challenge at the 4th International EON Workshop Workshop on Evaluation of Ontologies for the Web (EON2006) <http://km.aifb.uni-karlsruhe.de/ws/eon2006> Held in conjunction with the 15th International World Wide Web Conference Edinburgh International Conference Center, Edinburgh, UK May 22nd, 2006 *********************************************************************** OBJECTIVES ========== In this year's EON workshop we bring together researchers and practitioners interested in the evaluation of ontologies for the web. The aim of this workshop is to ground Ontology Evaluation firmly on the needs of the Semantic Web, especially regarding its web-like characteristics like high interconnectivity, constant change and incompleteness. EVALUATION AND DEMOS ==================== At the EON workshop there will be a practical session, where a number of ontologies are to be evaluated by the participants beforehand and the results being discussed at the workshop. In order to obtain an intensive exchange of ideas between the participants, there will be left extensive time for discussion. The previous workshops (EON2002, EON2003 and EON2004) proposed a series of experiments for evaluating different aspects of ontology tools, e.g. their expressiveness and interoperability capabilities. This year we focus on ontologies themselves. The EON2006 workshop is intended to be a platform to discuss results and further steps with interested parties. We explicitly encourage people to make demos of their tools. We will reserve time slots for demos in the workshop. We ask all participants to evaluate a number of ontologies according to their approaches. The workshop will facilitate discussion by comparing the results of the participants. This is not meant as a test or as homework, because we also don’t know the correct results, if there are any – it is the goal of this workshop to move towards an answer for this very question. The ontologies can be downloaded at the workshop’s website. A final panel will discuss the research agenda for the coming years, based on the presentations and results from the demos, evaluations and discussions. IMPORTANT DATES =============== Demo proposals due: April 14th, 2006 Evaluation results submission: April 14th, 2006 Notification on demos: April 21st, 2006 Notification on evaluation: April 21st, 2006 Workshop: May 22nd, 2006 SUBMISSIONS FOR DEMO PROPOSALS ============================== Interested presenters should submit an electronic PDF of their demo proposal to eon2006@aifb.uni-karlsruhe.de prior to the deadline. The proposal should include include: title, author names, affiliations, and electronic mail addresses for all authors, a brief abstract, a screenshot, and a short description of what will be shown in the demo. All correspondence will be sent to the author mentioned as contact person in the electronic title page (by default, the first author). Demo proposals should not exceed 2 pages and should be formatted according to the guidelines of the WWW conference (see <http://www2006.org/cfp/submissions.php> ). SUBMISSIONS OF EVALUATION RESULTS ================================= Interested authors should submit an electronic PDF and source version of their evaluation results to eon2006@aifb.uni-karlsruhe.de prior to the deadline. Evaluation results should be formatted according to the guidelines of the WWW conference (see http://www2006.org/cfp/submissions.php ). All correspondence will be sent to the author mentioned as contact person in the electronic title page (by default, the first author). Evaluations need to include the following: title, author names, affiliations, and electronic mail addresses for all authors, a brief abstract, a short summary of the evaluation approach (up to one page), the results of each performed ontology evaluation, sorted by the ontologies, and how much time the evaluation of each ontology took. For each ontology you did not evaluate explain why. We do not want to limit the length of the evaluation results, as this will depend heavily on your approach, but we ask you to keep them concise. Detailed results should be delivered in an ontology itself. A simple starting point for the format is provided, but needs to be extended by the evaluators needs. For the publication of the ontology evaluation results we will work out a format with the authors individually, depending on the number and form of submissions. For the workshop we will distribute all accepted evaluation results in order to ease discussion. The form of the final publication of the evaluation results will be decided later and depends on the quality and number of submitted evaluations. ONTOLOGIES ========== The ontologies are available at <http://km.aifb.uni-karlsruhe.de/ws/eon2006/ontoeval.zip> Here we describe the ontologies shortly. We ask you to evaluate each of the four ontologies, so that we can discuss our findings and compare the evaluation approaches. oe1: This is a single file with metadata about Elvis impersonators. It was developed by a single person. oe2: The ROVE ontology describes the Summer School for Ontology Engineering and the Semantic Web 2005. It was developed by a small team. oe3: This is the metadata about the AIFB institute. The SWRC ontology provides the vocabulary. The instance data, although offered in one file, is being editet by all members of the AIFB institute, not all of them knowledgeable in the Semantic Web domain. oe4: This is a collection of more than a hundred FOAF-files taken from the web. The source URIs are included. We regard this collection as a standard situation on the Semantic Web, where information will be compiled from several, decentralized sources. We regard this collection as one ontology. ORGANIZERS ========== * Denny Vrandecic, Institute AIFB, University of Karlsruhe, Germany * Mari Carmen Suarez-Figueroa, Facultad de Informatica, Universidad Politecnica de Madrid, Spain * Aldo Gangemi, Laboratory for Applied Ontology, Institute for Cognitive Sciences and Technology, Rome, Italy * York Sure, Institute AIFB, University of Karlsruhe, Germany PROGRAM COMMITTEE ================= * Sean Bechhofer, University of Manchester (UK) * Christopher Brewster, University of Sheffield (UK) * Dan Brickley, Semantic Web Vapourware Ltd and ILRT, University of Bristol (UK) * Oscar Corcho, University of Manchester (UK) * Roberta Cuel, University of Trento (IT) * Mariano Fernandez-Lopez, Universidad Politecnica de Madrid (ES) * Asuncion Gomez-Perez, Universidad Politecnica de Madrid (ES) * Marko Grobelnik, Jozef Stefan Institute (SI) * Nicola Guarino, Laboratory for Applied Ontology (IT) * Kouji Kozaki, Osaka University (JP) * Deborah McGuinness, Stanford University (US) * Libby Miller, Asemantics (IT) * Enrico Motta, Open University (UK) * Elena Paslaru Bontas, Freie Universitaet Berlin (DE) * Sofia Pinto, Technical University of Lisbon (PT) * Robert Porzel, European Media Laboratory (DE) * Steffen Staab, Universität Koblenz (DE) * Rudi Studer, University of Karlsruhe (DE) * Chris Welty, IBM (US) CONTACT ======= You may enquire all further information from Denny Vrandecic, denny@aifb.uni-karlsruhe.de WORKSHOP HOMEPAGE ================= http://km.aifb.uni-karlsruhe.de/ws/eon2006 -- Dr. York Sure Institute AIFB, University of Karlsruhe (TH) phone: +49 (0) 721 608 6592 web: http://www.aifb.uni-karlsruhe.de/WBS/ysu
Received on Thursday, 16 March 2006 14:40:22 UTC