EON Ontology Alignment Contest: updated tests

Dear all,

	the tests for the EON Ontology Alignment Contest have been 
updated in order to address comments that were made by several 
participants (and which were not raised during the preparatory phase).
	You can still use the previous tests and the intermediary 
modifications posted in august, but if you have an automated testing 
procedure, the revised one (who only improve the others) might be the 
best solution.
	Remember the papers are due soon!

* EON Ontology Alignment Contest
================================
http://co4.inrialpes.fr/align/Contest/

The increasing number of methods available for schema 
matching/ontology integration suggests the need to establish a 
consensus for evaluation of these methods. There is now a coordinated 
international initiative to forge this consensus through two events 
in 2004:
- The Information Interpretation and Integration Conference (I3CON), 
to be held at the NIST Performance Metrics for Intelligent Systems 
(PerMIS) Workshop, will be an ontology alignment demonstration 
competition on the model of the NIST Text Retrieval Conference. This 
contest focuses on "real-life" test cases and compare algorithm 
global performance.
- The Ontology Alignment Contest at the 3rd Evaluation of 
Ontology-based Tools (EON) Workshop 
(http://km.aifb.uni-karlsruhe.de/ws/eon2004), to be held the 
International Semantic Web Conference (ISWC), will target the 
characterization of alignment methods with regard to particular 
ontology features. This contest aims at defining a proper set of 
benchmark tests for assessing feature-related behavior.

The goal of the EON Ontology Alignment Contest is to provide the 
participants with a complete test base, including couples of 
ontologies to align as well as expected results. The test is based on 
one particular ontology dedicated to a very narrow domain and a 
number of alternative ontologies of the same domain for wich 
alignments are provided. The ontologies are provided in OWL. The 
expected alignments are provided in a standard format expressed in 
RDF/XML and described in http://co4.inrialpes.fr/align/. From these 
alignments and the ontology to compare, the competitors are able to 
compute a number of measures on their results. They can use the 
ontology provided in 
http://www.atl.external.lmco.com/projects/ontology/ for giving their 
results.

The contest will be open to anyone able to provide a paper following 
some simple guidelines with results to these tests. These results 
will be presented at the ISWC 2004 EON workshop, on November 8th, 
2004 in Hiroshima (Japan). The goal of the benchmark is to assess the 
respective merits of some algorithms with respect to precise 
situations, it is not to single out one winner.

Paper due: September 15th, 2004.
-- 
  Jérôme Euzenat                  __
                                  /      /\
  INRIA Rhône-Alpes,            _/  _   _   _ _    _
                               /_) | ` / ) | \ \  /_)
  655, avenue de l'Europe,    (___/___(_/_/  / /_(_________________
  Montbonnot St Martin,       /        http://www.inrialpes.fr/exmo
  38334 Saint-Ismier cedex,  /
  France____________________/   Jerome . Euzenat (à) inrialpes . fr

Received on Wednesday, 8 September 2004 09:53:14 UTC