Re: Socio technical/Qualitative metrics for LD Benchmarks

I am not sure whether calling the drivers of the Semantic Web
narrow-minded is exactly helpful in furthering your cause.

Also, besides stating the obvious, i.e. that we need metrics which are
not purely technical (something that has been recognized in the field
since the beginning), it would have been nice if you would have made
suggestions for the not-so-obvious as well, like, which metrics could
be used in addition to the currently employed. That is the hard part.
I would expect that a well written suggestions or even evaluation of
such metrics would have quite some impact on the whole field.

2012/11/20 Paola Di Maio <>:
> Yesterday I attended the LDBC Technical User Group in Barcelona. This is a
> quick field note for those who are also interested in linked data
> benchmarking and the progress being made in the field.
> It was good to meet some of the people I have exchanged  only via email so
> far, and so many socio-technical dimensions crop up in the many
> presentations. It would important to develop a Benchmark (or set of
> benchmarks) capable of capturing and measuring them. I suggested that:
> - technical performance is an emergent property of a socio-technical system
> - vast quantity of triples are a waste of cyber space if they cannot produce
> measurable knowledge advantage (ther is a cognitive dimension to linked data
> outputs)
> -  I'd likpropose the inclusion of socio-technical/qualitative metrics to
> the Benchmark, in addition to purely technical /quantitative ones, to ensure
> the usefulness of the latter.
> I had several conversations with consortium members, and they all seem to
> agree with this requirement,
> However the very few members of the consortium with a narrow computer
> science background may not immediately grasp the socio-technical aspects of
> technical complexity, since the semantic web research and development have
> been, until very recently,  driven by narrow minded computer scientists and
> characterized by the lack of  socio technical vision.
> Paola Di Maio

Project director Wikidata
Wikimedia Deutschland e.V. | Obentrautstr. 72 | 10963 Berlin
Tel. +49-30-219 158 26-0 |

Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg
unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das
Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985.

Received on Tuesday, 20 November 2012 13:48:25 UTC