Re: The Measurement and Analysis of Trust, Shared Meaning, and Cohesion in Digital Communities

Civic Technology Community Group,
Daveed,
Felipe,
All,

I found a book on some of these topics under discussion: Artificial Intelligence and Qualitative Research (https://learninganalytics.upenn.edu/book/ai-qualitative-research.html).

However, these R&D topics that we're discussing are so forefront that the book is forthcoming. It is being written as we speak.

Felipe, I'm eagerly awaiting its chapter 14: Validation, Trustworthiness, and Quality Checks, to respond in greater detail on the forefront topics of metrology for AI systems.

Daveed, some of the topics that you raised may be in its chapter 15: Interpretation, Sensemaking, and Theory Building.

Hopefully interesting.


Best regards,
Adam

________________________________
From: Felipe Ribeiro <operarioribeiro@gmail.com>
Sent: Sunday, April 5, 2026 7:39 AM
To: Adam Sobieski <adamsobieski@hotmail.com>
Cc: public-civics@w3.org <public-civics@w3.org>
Subject: Re: The Measurement and Analysis of Trust, Shared Meaning, and Cohesion in Digital Communities

Some possible soyrces for research on these topics:

1. https://medium.com/bankless-dao/what-is-a-trustless-system-3ded568c8921

2. Before this question it may be useful to understand how Tim Berners Lee Web 3.0 and Cripto Web3 differ in their usage of Web 2.0 social media technologies.

3. https://activisthandbook.org/tools/security
https://cyberpeaceinstitute.org

4. https://metrologyinstitute.org/the-ai-revolution-in-metrology is thinking AI in metrology but no one is developing metrology FOR AI. This would require us to DevOps an AI ontology that could start with something like:
i. I/O hardware human interaction
ii. code linguistics
iii. algorithm hierarchy
iv. civic tech public participation
v. IGF internet regulation
vi. machine learning (ML) supervision
vii. artificial intelligence audit

On Sat., Apr. 4, 2026, 19:25 Adam Sobieski, <adamsobieski@hotmail.com<mailto:adamsobieski@hotmail.com>> wrote:
Civic Technology Community Group,
Daveed,
Felipe,
All,

Hello. Recently, some questions were presented to the group:


  1.
What would trust signals look like if they were visible and composable across contexts?
  2.
How can emerging W3C technologies support coordination at the interaction level, not just data interoperability?
  3.
What practices or interfaces help people collectively interpret and validate information in real time?

Building on these questions, I would like to add:


  1.
How can we use technologies, in particular AI, to measure these factors (e.g., trust, shared meaning, sensemaking, and cohesion) in computer-mediated groups, teams, and communities?

With respect to a subtopic of measuring and evaluating task-focused activities, e.g., "collaborative problem-solving", using a search-engine AI, I recently discovered the tools and techniques of: epistemic network analysis (ENA), discrete time Markov chains (DTMCs), synergy degree model (SDM), ordered network analysis (ONA), multidimensional sequence analysis, group metacognition measures, interaction analysis model (IAM) framework, and the connectivist interaction and engagement (CIE) framework.

Some of these techniques are, interestingly, applicable to the topics in questions #1, #3, and #4.

Understanding that a number of existing and emerging tools and techniques exist, what do you think about using AI to provide real-time sociological measurements and analyses for computer-mediated communication and socialization venues, e.g., online bulletin-boards, forums, social-media pages, for participants, moderators, facilitators, and managers to be able to view and utilize?

That is, in addition to the computer-aided and automated moderation of community forums, could AI tools and technologies provide communities' participants with useful real-time sociological measurements and analyses? Could individual forum posts or threads, discussion sequences, be measured, analyzed, and scored for participants with respect to multiple objectives?


Best regards,
Adam