- From: Owen Ambur <Owen.Ambur@verizon.net>
- Date: Mon, 15 Jun 2020 16:36:35 -0400
- To: W3C AIKR CG <public-aikr@w3.org>
- Message-ID: <5d7fc9a0-a6db-e7e0-d985-d389a85c0c62@verizon.net>
Here are the two most recent additions to the StratML collection:
ABOUT ML Project - https://stratml.us/drybridge/index.htm#AML
Toward Trustworthy AI Development: Mechanisms for Supporting
Verifiable Claims - https://stratml.us/drybridge/index.htm#MSVC
in the latter, the very first objective is directly related to the
StratML standard:
Objective 1.1: Goals & Values
<https://stratml.us/carmel/iso/MSVCwStyle.xml#_1589903e-aebb-11ea-863f-edd70a83ea00>
- Clarify the goals and values.
Others include:
Objective 6.1: Criteria, Objectives & Frameworks
<https://stratml.us/carmel/iso/MSVCwStyle.xml#_937934a4-af42-11ea-867a-27142883ea00>
- Establish consensus on the criteria, objectives, and frameworks
for interpretability research.
Objective 7.3: Benchmarks
<https://stratml.us/carmel/iso/MSVCwStyle.xml#_9379482c-af42-11ea-867a-27142883ea00>
- Develop benchmarks for PPML to unify goals and measure progress.
[PPML stands for Privacy-Preserving Machine Learning.]
Objective 7.6: Standardization & Interoperability
<https://stratml.us/carmel/iso/MSVCwStyle.xml#_93795542-af42-11ea-867a-27142883ea00>
- Work on standardization/interoperability.
Objective 9.1: Standardization
<https://stratml.us/carmel/iso/MSVCwStyle.xml#_93796956-af42-11ea-867a-27142883ea00>
- Assess the feasibility of standardizing compute accounting.
Objective 9.2: Reporting
<https://stratml.us/carmel/iso/MSVCwStyle.xml#_93796d16-af42-11ea-867a-27142883ea00>
- Automate or simplify compute reporting.
With reference to ABOUT ML's plan, it would be good if the guide
contemplated in this objective were published as a model performance
plan in StratML Part 2 format:
Objective 2.1: Guidance
<https://stratml.us/carmel/iso/AMLwStyle.xml#_41c51098-af19-11ea-bd1a-b48e1e83ea00>
- Develop a guide to initiating and scaling a documentation pilot.
With reference to Objective 1.2: Questions
<https://stratml.us/carmel/iso/AMLwStyle.xml#_41c50cba-af19-11ea-bd1a-b48e1e83ea00>
- Gather questions in a database, there are currently 183 in their
database
<https://docs.google.com/spreadsheets/d/1HYlWBos7AXxV4TRvWkK_EF6iFFWNjk8NEevlh1JC9Bk/edit#gid=0>.
From my perspective, it would be good if those questions were restated
as objectives in an open, standard, machine-readable format like
StratML. That's more than I am motivated to do right now, but for
anyone who may be interested in checking them out, the database includes
the URLs for the research papers from which the questions were gleaned.
Owen
Received on Monday, 15 June 2020 20:36:55 UTC