Re: Socio technical/Qualitative metrics for LD Benchmarks

I think it would be useful to create such benchmark tools. Why not define a initial narrow domain to work out details and then expand to generalized domain?

When you talk "socio-technical" you talk sustainable development issues, which is the domain of the United Nations and relevant international bodies.

And the UN and its constituent bodies is exactly where benchmarking is needed for all the obvious socio-technical, political, economic and other reasons.


 
Milton Ponson
GSM: +297 747 8280
PO Box 1154, Oranjestad
Aruba, Dutch Caribbean
Project Paradigm: A structured approach to bringing the tools for sustainable development to all stakeholders worldwide by creating ICT tools for NGOs worldwide and: providing online access to web sites and repositories of data and information for sustainable development

This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail.



________________________________
 From: Paola Di Maio <paola.dimaio@gmail.com>
To: semantic-web at W3C <semantic-web@w3c.org> 
Sent: Tuesday, November 20, 2012 9:29 AM
Subject: Socio technical/Qualitative metrics for LD Benchmarks
 



Yesterday I attended the LDBC Technical User Group in Barcelona. This is a quick field note for those who are also interested in linked data benchmarking and the progress being made in the field.


It was good to meet some of the people I have exchanged  only via email so far, and so many socio-technical dimensions crop up in the many presentations. It would important to develop a Benchmark (or set of benchmarks) capable of capturing and measuring them. I suggested that:

- technical performance is an emergent property of a socio-technical system
- vast quantity of triples are a waste of cyber space if they cannot produce measurable knowledge advantage (ther is a cognitive dimension to linked data outputs)
-  I'd likpropose the inclusion of socio-technical/qualitative metrics to the Benchmark, in addition to purely technical /quantitative ones, to ensure the usefulness of the latter.

I had several conversations with consortium members, and they all seem to agree with this requirement,  

However the very few members of the consortium with a narrow computer science background may not immediately grasp the socio-technical aspects of technical complexity, since the semantic web research and development have been, until very recently,  driven by narrow minded computer scientists and characterized by the lack of  socio technical vision. 



Paola Di Maio