TTC Roadmap on Evaluation and Measurement Tools for Trustworthy AI

The "roadmap" issued by the US/EU Trade and Technology Council for the evaluation and measurement of trustworthy AI includes these goals and objectives:


Goal 1: Terminologies & Taxonomies ~ Advance shared terminologies and taxonomies

StratML is a set of terms and taxonomy for the content of strategic plans and performance reports.  ISO standards are explicitly referenced in the roadmap.

Objective 2.1: Standards ~ Engage with stakeholders to identify standards that are of mutual interest

StraML is an ISO standard (ISO 17469-1).  Facilitating engagement of stakeholders is among the purposes of the standard.

Objective 2.2.1: Metrics & Methodologies ~ Build a knowledge base of metrics and methodologies for measuring AI trustworthiness, risk management methods, and related tools

Metrics can be documented and reported in the Performance Indicator elements of StratML Part 2.  If a better methodology becomes available, it will be interesting to see how well it works.  
Perhaps we can just leave it to OpenAI's ChatGPT... but it would be nice to think there might be some humans in the loop.
Owen Ambur
https://www.linkedin.com/in/owenambur/
 

    On Friday, December 9, 2022 at 09:10:05 AM EST, ProjectParadigm-ICT-Program <metadataportals@yahoo.com> wrote:  
 
  
Draftstandardisation request to the European Standardisation Organisationsin support of safe and trustworthy artificial intelligence

https://ec.europa.eu/docsroom/documents/52376?locale=en




Demystifyingthe Draft EU Artificial Intelligence Act

https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3896852





Milton Ponson
GSM: +297 747 8280
PO Box 1154, Oranjestad
Aruba, Dutch Caribbean
Project Paradigm: Bringing the ICT tools for sustainable development to all stakeholders worldwide through collaborative research on applied mathematics, advanced modeling, software and standards development