- From: Kjetil Kjernsmo <kjetil@kjernsmo.net>
- Date: Sun, 9 Mar 2014 00:30:53 +0100
- To: semantic-web@w3.org
First International Workshop-Empirical 2014
May 26, 2014, Crete, Greece.
At the 11th Extended Semantic Web Conference
(ESWC 2014)
http://2014.empirical-ws.org/
Experimental work in the Semantic Web research typically aims to evaluate
proposed scientific contributions on existing benchmarks. Contributions
are newly designed artifacts such as systems or algorithms, which need
to be evaluated in terms of their overall utility or performance. In this,
experimentation in our discipline can be seen as part of the build and
evaluate cycle that also characterizes the design research in other
engineering sciences. In most disciplines in the natural sciences, however,
experimentation typically aims to justify the proposed scientific contribution.
This contribution is a theoretical explanation, which gives rise to hypotheses
of which the truth needs to be tested in the real world. Typically, such tests
have to deal with various forms of variability, forcing researchers to apply
statistical inference techniques to draw conclusions about their hypotheses
from their research data. New contributions typically require new samples of
data to be collected and evaluated.
This workshop starts from the assumption that the Semantic Web research would
progress faster and could broaden its scope when our community embraces both
evaluation and explanation and make them reinforce one another. However, we
observe that the build and evaluate cycle is currently overly represented in
our field, while there is insufficient attention for the research cycle of
theorize and justify. Thus, reproducibility and generality of empirical
results
presented in the literature cannot be commonly ensured. The workshop aims at
bringing together researchers interested in the formalization of statistical
methods to design and analyze empirical studies of Semantic Web technologies.
We welcome any contribution that relates directly to this observation, and
that allows to illustrate the effects of the lack justification and explanation
in the generality of reported experimental results. We invite the
submissions
of research papers (max. 15 pages) or vision and position papers (max. 8
pages).
Potential topics include, but are not limited to:
-------------------------------------------------
-) Foundations of hypothesis formulation: triangulation, common constructs in
the Semantic Web (e.g., performance, completeness) and their validity, typical
operationalizations, and quantifiability.
-) Statistical methods to demonstrate significance and levels of confidence of
experimental studies on Semantic Web technologies and empirical results.
-) Experimental methodologies to design reproducible experimental studies in
the
context of Semantic Web technologies.
-) Critical examinations of assumptions inherent in statistical practices in
Semantic Web research (e.g., assuming normal distribution of populations).
-) Limitations of existing statistical methods on empirical studies of Big
Data.
-) Statistical techniques to analyze and improve benchmarks.
Workshop key dates
-----------------------
Full Paper Submission Deadline March 16, 2014 Extended
Acceptance notification: April 1, 2014
Camera ready version: April 15, 2014
Workshop day: May 25, 2014, morning session
Submissions Guidelines
------------------------
Research papers are limited to 15 pages, vision papers to 8 pages, and
witnesses
to the trial are informal submissions.
All papers will be formatted according to the LNCS format.
Submissions will only be accepted through Easychair
https://www.easychair.org/conferences/?conf=empirical2014
Publication
-------------------------
Proceedings of the workshop will be published online. All papers presented at
the
workshop will be invited to be revised and extended for a second peer-review
process. Accepted papers will be published in a Special Issue of Open Journal
of
Semantic Web (OJWS)
http://www.ronpub.com/index.php/journals/ojsw.
Workshop Chairs
-----------------------
Kjetil Kjernsmo, University of Oslo, Norway.
Maria-Esther Vidal, Universidad Simon Bolivar, Venezuela.
Jacco van Ossenbruggen, VU University Amsterdam, Netherlands.
Program Committee
_________________
Maribel Acosta, AIFB, Karlsruhe Institute of Technology, Germany.
Soren Auer, University of Bonn, Germany.
Oscar Corcho, Universidad Politecnica de Madrid, Spain.
Emanuele Della Valle, Politecnico di Milano, Italy.
Fabian Flöck, AIFB, Karlsruhe Institute of Technology, Germany.
Martin Giese, University of Oslo, Norway.
Peter Haase, fluid Operations AG, Germany.
Tomi Kauppinen, Aalto University School of Science, Finland.
Manolis Koubarakis, University of Athens, Greece.
Gabriela Montoya, University of Nantes, France.
Jose Mora, Universidad Politecnica de Madrid, Spain.
Daniel Palhazi-Cuervo, Universiteit of Antwerpen, Belgium.
Josiane Xavier Parreira, Insight, National University of Ireland - Galway,
Ireland.
Axel Polleres, Vienna University of Economics & Business, Austria.
Ansgar Scherp, Kiel University, Germany.
Willem van Hage, VU University Amsterdam, Netherlands.
Frank van Harmelen, VU University Amsterdam, Netherlands.
Sherif Sakr, University of New South Wales, Australia.
John Tyssedal, Norwegian University of Science and Technology, Norway.
Matthias Thimm, Universität Koblenz, Germany.
Received on Saturday, 8 March 2014 23:31:31 UTC