Re: The role of the AI KR Strategist:

Agreed discussions should focus on things that are published here. Please
share the document so that it too does not become a distraction.

Carl
It was a pleasure to clarify


On Thu, Jun 11, 2020 at 1:27 AM Paola Di Maio <paola.dimaio@gmail.com>
wrote:

> Carl
> Thank you, looks neat
>
> However, here two initial problems
> 1.  In the document the terms AIKR strategist and AI strategy/ist   are
> used interchangeably
> Please disambiguate in the light of the latest exchange and use the
> correct term as you intend to
> //it is not enough to change the document title//
> 2. If its is not clear yet what the AI KR strategy is -  well, it is clear
> to me to some extent,  but I dont use the term
> strategy nor framework -  because I use the system development process,
> not a strategy to develop AI
>
> however, I may be able to put it in term of strategy if that helps-
>
> Because I do not have much spare time - none of us has I guess -  I rather
> work on a document that I can
> use (without having to discuss/argue because that is time consuming and
> not useful from my pov)
>
> so I ll start working on an AI KR role and definition specification (which
> you may call strategy if you like) - which is not up for discussion but
> will be open for consultation and comments
> which you can then use in your version, if you think is useful
>
> I suspect it may take too long to try to sort out our differences because
> of the distance between our planets
>
> pdm
>
> On Wed, Jun 10, 2020 at 8:47 PM carl mattocks <carlmattocks@gmail.com>
> wrote:
>
>>
>> Please find attached (summary extract below)  Strategic Plan - The role
>> of the AI KR Strategist (A strategist is a person with responsibility
>> for the formulation and implementation of a strategy).
>>
>> To help validate the list of goals we invite proposals for a sequencing
>> (of the goals) that could be the foundation of an AI Strategy Protocol.
>>
>> Please provide your proposals as a reply to this post.. intent is to
>> apply them to the StratMl version at 9:00 am (NY time) June 23 meeting.
>>
>>
>>
>> thanks
>>
>> Carl Mattocks
>> AIKRCG co-Chair
>>
>>
>> Strategic Plan
>>
>> *The role of the AI KR Strategist*
>>
>> For: *Artificial Intelligence Knowledge Representation Community Group
>> (AIKR CG)*
>>
>> Submitted By: *Carl Mattocks*
>>
>> y *CarlMattocks@WellnessIntelligence.Institute*
>>
>> *Overview*
>>
>> This plan defines the role of the AI KR Strategist.
>>
>> Contents
>>
>> *No table of contents entries found.*
>> 1.    Articulation 1.1.    Vision
>>
>> For all AI systems to have clearly and transparently documented goals and
>> performance data showing that they are being achieved.
>> 1.2.    Mission
>>
>> The mission of an AI Strategist is to define the purpose and goals of AI
>> systems, as well as the KPIs by which we can determine if the system is
>> meeting its goals.
>> 1.3.    Scorecard
>>
>>
>>
>> *Goals*
>>
>> *Objectives*
>>
>> *Performance Indicators*
>>
>> *Commentary*
>>
>> *Goals with no perspective*
>>
>> Quality (see pp1)
>>
>> Adherence to Environmental Impacts (see pp1)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Efficiency (see pp1)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Ethics (see pp1)
>>
>> Accountability (see pp1)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Autonomy (see pp1)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Confidentiality (see pp1)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Veracity (see pp1)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Machine Learning Evaluation (see pp1)
>>
>> Track (see pp1)
>>
>> Precision Recall
>>
>>
>>
>>
>>
>>
>>
>> Accuracy
>>
>>
>>
>>
>>
>>
>>
>> Confusion Matrix
>>
>>
>>
>>
>>
>>
>>
>> Per-class accuracy
>>
>>
>>
>>
>>
>>
>>
>> Log-Loss
>>
>>
>>
>>
>>
>>
>>
>> AUC-ROC Curve
>>
>>
>>
>>
>>
>>
>>
>> F-measure
>>
>>
>>
>>
>>
>>
>>
>> NDCG
>>
>>
>>
>>
>>
>>
>>
>> Regression Analysis
>>
>>
>>
>>
>>
>>
>>
>> Quantiles of Errors
>>
>>
>>
>>
>>
>>
>>
>> "Almost correct" predictions
>>
>>
>>
>>
>>
>>
>>
>> Trustworthy (see pp1)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Lawful (see pp1)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Ontological Statements (see pp1)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Track (see pp1)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Business Strategy (see pp1)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Requirements (see pp1)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Document (see pp1)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Robust (see pp1)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> 1.4.    Goals....
>>
>> It was a pleasure to clarify
>>
>>
>> On Tue, Jun 9, 2020 at 11:56 PM Paola Di Maio <paola.dimaio@gmail.com>
>> wrote:
>>
>>> oops-
>>> Thanks Carl Owen and Chris
>>> for capturing and sharing.
>>> I repeat here my comment shared with participants after the session -
>>> also pasted below
>>>
>>> if the plan we worked on yesterday is to describe the role of an AI
>>> Strategist
>>> then we need to make explicit what the goal of the role and associated
>>> activities  is/are
>>>
>>> AI systems /software development can be very sophisticated and well
>>> understood practice
>>> in systems/software engineering . It is not a strategy role to do
>>> requirements analysis and write
>>> technical systems specifications, especially not technically advanced
>>> ones
>>>  So we should review and devise an AI strategist/strategy goals
>>> accordingly, taking into account the technical system specifications.
>>> or viceversa?
>>> A strategist could identify the need for a technical system based on a
>>> business problem/need, but then pass the development
>>> to a specialist (a systems developer/engineer) who has the skills to do
>>> so
>>> So upon further reflection, I dont think requirements belong to an ai
>>> strategy. unless better specified
>>>
>>> pdm
>>> paola wrote:
>>> Thanks for starting this plan
>>> As I read what had been drafted I commented with my software/system
>>> developer hat on
>>> The system lifecycle is considered a process, rather than a strategy,
>>> and consists of
>>> identifying requirements, specifications and documentation and all
>>> Its well understood and documented and there are several models, but the
>>> lifecycle itself
>>> is fairly standard, it applies to AI systems as to any system
>>> So before I have a go at reorganising and perhaps streamlining a bit
>>> those goals
>>> I think we should define better what is the role of the AI strategist
>>> does it overlap the role of a ai system analyst and designer (which is
>>> what I have in mind)
>>> ie  identify what needs to be done
>>> or is it more a role to decide HOW these goals need to be achieved in
>>> terms of resources, schedules, policies, coordination with management etc
>>> Also, as I mentioned, this may depend on what other roles the AI
>>> strategist works with/depends on-
>>> p
>>>
>>>
>>> On Wed, Jun 10, 2020 at 11:45 AM Paola Di Maio <paola.dimaio@gmail.com>
>>> wrote:
>>>
>>>>
>>>>
>>>> On Wed, Jun 10, 2020 at 12:38 AM carl mattocks <carlmattocks@gmail.com>
>>>> wrote:
>>>>
>>>>> Role of Data Scientist has a process that is described in the links
>>>>> below :
>>>>>
>>>>> *Cross-industry standard process for data mining*, known as *CRISP-DM*
>>>>> ,[1]
>>>>> <https://en.wikipedia.org/wiki/Cross-industry_standard_process_for_data_mining#cite_note-Shearer00-1> is
>>>>> an open standard <https://en.wikipedia.org/wiki/Open_standard> process
>>>>> model that describes common approaches used by data mining
>>>>> <https://en.wikipedia.org/wiki/Data_mining> experts. It is the most
>>>>> widely-used analytics <https://en.wikipedia.org/wiki/Analytics> model
>>>>>
>>>>>
>>>>> https://en.wikipedia.org/wiki/Cross-industry_standard_process_for_data_mining
>>>>>
>>>>>
>>>>> these lecture notes provide good background notes
>>>>>
>>>>>
>>>>> https://wiwi.hs-duesseldorf.de/personen/thomas.zeutschler/Documents/HSD_W_ITAiBA_Zeutschler_SS2016_Lecture2_CRSIP_DM.pdf
>>>>>
>>>>>
>>>>> this is an IBM presentation on the  The Data Science Process
>>>>>
>>>>> https://www-01.ibm.com/events/wwe/grp/grp304.nsf/vLookupPDFs/Polong%20Lin%20Presentation/$file/Polong%20Lin%20Presentation.pdf
>>>>>
>>>>>
>>>>> enjoy
>>>>> Carl
>>>>>
>>>>> It was a pleasure to clarify
>>>>>
>>>>>
>>>>> On Tue, Jun 9, 2020 at 12:13 PM Owen Ambur <Owen.Ambur@verizon.net>
>>>>> wrote:
>>>>>
>>>>>> Carl, thanks for leading another productive editing session on the
>>>>>> AIKR CG televideo conference today.  I found myself agreeing with much of
>>>>>> what Paola was saying, and I continue to be impressed by Chris' capability
>>>>>> to comprehend and capture the essence of our dialog in his StratNavApp.
>>>>>> For the benefit of those who were unable to join us, I am providing a link
>>>>>> here
>>>>>> <https://www.stratnavapp.com/StratML/Part1/861566c8-e9be-4642-b52f-f673fa499f4e/Styled>
>>>>>> so that they can view our draft plan as it currently exists.
>>>>>>
>>>>>> I'm sorry that Justin was not able to participate to ensure that we
>>>>>> are capturing the knowledge he has gained in considering the roles of AI
>>>>>> strategists.  However, it would be great if he and others could contribute
>>>>>> their comments and edits on our draft in Chris' app
>>>>>> <https://www.stratnavapp.com/> and perhaps participate in our text
>>>>>> televideo conference on June 23.
>>>>>> While the StratML collection does not yet contain a model performance
>>>>>> plan for Data Scientists, it does include one for Chief Data Officers
>>>>>> (CDOs), at https://stratml.us/drybridge/index.htm#PP4CDO
>>>>>>
>>>>>> Unless someone has a better source, I will soon convert the contents
>>>>>> of this one to StratML format:
>>>>>> https://www.sas.com/en_us/insights/analytics/what-is-a-data-scientist.html
>>>>>>
>>>>>> BTW, Carl, your reference to OASIS's Business Centric Methodology
>>>>>> (BCM) prompted me to convert its content to StratML format at
>>>>>> https://stratml.us/drybridge/index.htm#BCM
>>>>>>
>>>>>> These elements of the BCM are closely related to the purposes of the
>>>>>> StratML standard:
>>>>>>
>>>>>> Objective 1.1: Goals
>>>>>> <https://stratml.us/carmel/iso/BCMwStyle.xml#_6b2c0b98-aa65-11ea-9885-42f42983ea00>
>>>>>> - Determine the business goals.
>>>>>> Objective 1.3: Participants
>>>>>> <https://stratml.us/carmel/iso/BCMwStyle.xml#_6b2c0d32-aa65-11ea-9885-42f42983ea00>
>>>>>> - Identify the project participants.
>>>>>> Objective 1.4: COIs
>>>>>> <https://stratml.us/carmel/iso/BCMwStyle.xml#_6b2c0e40-aa65-11ea-9885-42f42983ea00>
>>>>>> - Identify the Community of Interest.
>>>>>> Goal 2: Goals
>>>>>> <https://stratml.us/carmel/iso/BCMwStyle.xml#_6b2c1106-aa65-11ea-9885-42f42983ea00>
>>>>>> - Understand the business goals.
>>>>>> Objective 3.3: Standards Bodies
>>>>>> <https://stratml.us/carmel/iso/BCMwStyle.xml#_6b2c1750-aa65-11ea-9885-42f42983ea00>
>>>>>> - Map interoperability requirements to standard bodies.
>>>>>> Objective 3.4: Formats
>>>>>> <https://stratml.us/carmel/iso/BCMwStyle.xml#_6b2c182c-aa65-11ea-9885-42f42983ea00>
>>>>>> - Map interoperability requirements to internal legacy system formats.
>>>>>> Objective 3.5: Templates
>>>>>> <https://stratml.us/carmel/iso/BCMwStyle.xml#_6b2c191c-aa65-11ea-9885-42f42983ea00>
>>>>>> - Capture information in a way that can be reused over time and among
>>>>>> participating organizations.
>>>>>> Objective 3.5.1: Strategies
>>>>>> <https://stratml.us/carmel/iso/BCMwStyle.xml#_6b2c19f8-aa65-11ea-9885-42f42983ea00>
>>>>>> - Implement strategies for interoperability.
>>>>>> Objective 3.5.5: Standards
>>>>>> <https://stratml.us/carmel/iso/BCMwStyle.xml#_6b2c1da4-aa65-11ea-9885-42f42983ea00>
>>>>>> - Apply standards for interoperability and contracts.
>>>>>> Objective 3.5.7: Performance
>>>>>> <https://stratml.us/carmel/iso/BCMwStyle.xml#_6b2c206a-aa65-11ea-9885-42f42983ea00>
>>>>>> - Monitor and manage performance.
>>>>>> Objective 4.1: Standards
>>>>>> <https://stratml.us/carmel/iso/BCMwStyle.xml#_6b2c2b82-aa65-11ea-9885-42f42983ea00>
>>>>>> - Use existing standards.
>>>>>>
>>>>>> It would be great if BCM practitioners were to use the StratML
>>>>>> standard (ISO 17469-1).  Anyone who may wish to apply the BCM template as a
>>>>>> performance plan for their organization in StratML Part 2 format could do
>>>>>> so by clicking on the link provided here.
>>>>>>
>>>>>> Owen
>>>>>>
>>>>>> -------- Forwarded Message --------
>>>>>> Subject: Re: ai strategist role
>>>>>> Date: Tue, 9 Jun 2020 11:22:53 -0400
>>>>>> From: carl mattocks <carlmattocks@gmail.com> <carlmattocks@gmail.com>
>>>>>> To: Paola Di Maio <paoladimaio10@googlemail.com>
>>>>>> <paoladimaio10@googlemail.com>
>>>>>> CC: Owen Ambur <Owen.Ambur@verizon.net> <Owen.Ambur@verizon.net>,
>>>>>> Chris Fox <chris@chriscfox.com> <chris@chriscfox.com>, Paul Alagna
>>>>>> <pjalagna@gmail.com> <pjalagna@gmail.com>
>>>>>>
>>>>>> Data Scientist is a complimentary role.. which is supported by an
>>>>>> open source method that has strong emphasis on machine learning and is Plan
>>>>>> Do Check Act oriented.
>>>>>>
>>>>>> Carl
>>>>>>
>>>>>> On Tue, Jun 9, 2020, 11:12 AM Paola Di Maio <paola.dimaio@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Thanks for starting this plan
>>>>>>> As I read what had been drafted I commented with my software/system
>>>>>>> developer hat on
>>>>>>> The system lifecycle is considered a process, rather than a
>>>>>>> strategy, and consists of
>>>>>>> identifying requirements, specifications and documentation and all
>>>>>>> Its well understood and documented and there are several models, but
>>>>>>> the lifecycle itself
>>>>>>> is fairly standard, it applies to AI systems as to any system
>>>>>>> So before I have a go at reorganising and perhaps streamlining a bit
>>>>>>> those goals
>>>>>>> I think we should define better what is the role of the AI strategist
>>>>>>> does it overlap the role of a ai system analyst and designer (which
>>>>>>> is what I have in mind)
>>>>>>> ie  identify what needs to be done
>>>>>>> or is it more a role to decide HOW these goals need to be achieved in
>>>>>>> terms of resources, schedules, policies, coordination with
>>>>>>> management etc
>>>>>>> Also, as I mentioned, this may depend on what other roles the AI
>>>>>>> strategist works with/depends on-
>>>>>>> p
>>>>>>>
>>>>>>