Socio technical/Qualitative metrics for LD Benchmarks

Yesterday I attended the LDBC Technical User Group in Barcelona. This is a
quick field note for those who are also interested in linked data
benchmarking and the progress being made in the field.

It was good to meet some of the people I have exchanged  only via email so
far, and so many socio-technical dimensions crop up in the many
presentations. It would important to develop a Benchmark (or set of
benchmarks) capable of capturing and measuring them. I suggested that:

- technical performance is an emergent property of a socio-technical system
- vast quantity of triples are a waste of cyber space if they cannot
produce measurable knowledge advantage (ther is a cognitive dimension to
linked data outputs)
-  I'd likpropose the inclusion of socio-technical/qualitative metrics to
the Benchmark, in addition to purely technical /quantitative ones, to
ensure the usefulness of the latter.

I had several conversations with consortium members, and they all seem to
agree with this requirement,

However the very few members of the consortium with a narrow computer
science background may not immediately grasp the socio-technical aspects of
technical complexity, since the semantic web research and development have
been, until very recently,  driven by narrow minded computer scientists and
characterized by the lack of  socio technical vision.



Paola Di Maio