- From: Lorenzo Moriondo <tunedconsulting@gmail.com>
- Date: Mon, 7 Jul 2025 12:19:08 +0100
- To: Amit Chopra <akchopra.mail@gmail.com>
- Cc: public-webagents <public-webagents@w3.org>
- Message-ID: <CAKgLLmvziu3s9K_QNNZouGnMgtET_BNX737RqJrmAvqCr3er1w@mail.gmail.com>
Thanks for the links! This model of MAS provides answers to most of my questions in the previous thread about fail-safeness of the concurrent computation involved in a decentralised network. It could be a good starting point (as FIPA) for a "layer 0" for LLMs to work on top of it. Some questions: Have you considered attaching a piece of syntax for semantic referencing (links to public ontologies)? An LLM may find it difficult to parse a message into a context without the semantic linking or links to NL documents from which to assess a context. Also, for example, different markets (in the case of the buy-sell example in the papers) may apply different nuances to a transaction that are not embeddable using a formal language, thus the more expressive hints provided by the semantic linking that the LLM can leverage. For example: parameters adornments could leverage semantic linking to explain themselves to a context reader that can dereference the link and go acquire its description. Would it be an easy implementation to have a mapping between the protocol and existing standards for Web (HTTP, RPC) payloads and formats (JSON-LD, W3C Hydra)? While for lower levels efficiency is priority, for a shared layer interoperability takes priority. Notes for the sake of the discussion: * the protocol described looks like Protobuffer at first sight. This implies providing an ecosystem of parsers and validators, LLMs are usually good at porting natural languages to formal specification (provided by the authors in the Gitlab repo). One of the first things I would try is some context engineering to develop an agent for accurate translation from protocols to NL. * it is quite compact but may require too much overhead to learn and too much preparation to be interpreted, this makes it less human readable than a NL description. There is too much syntax involved as required by the machine-readability but it doesn't mean an LLM cannot handle it correctly and bypass this overhead. * the main blocker with formal languages in my opinion is that they are an arbitrary pick among possibilities so they require to be widely accepted in usage, thing that may require too much consensus-building costs to be accepted by the majority of industry-players, while NL is already there for every player doing the job and can be leveraged for a standard. But again, if the process of translation between NL and the protocol is effortless... If we accept this point of view, *the best protocol may be the one optimised for accurate translation from machine-readable to NL*. * the papers already provide a verifiable concurrency model, very important. * My take at first reading, this solution can be a good intermediate representation at some layer of the stack that does the translation into a machine readable layer (similar to FIPA). * In my experience causality in human-machine interaction is too wide of a concept to be covered by a formal implementation. Maybe LLM will be a good pick to let agents infer causality from semantic clues mixed in with formally structured data about the flow of information. In the paper a narrow definition of causality is given, good for machine readable messages but maybe too narrow for the "open-endedness" of NL-based systems and all the possible occurrences of meaning (again, this can be improved using semantic referencing/dereferencing). * keep in mind that once a standard is in place, it will be possible to test if LLMs themselves can generate client/server implementations in a given language/tool; so defining client servers parsers and tooling in general may take less work than doing it via traditional software engineering. In general adding an "LLM-aware layer 0" to a formal protocol (like BSPL in the papers or FIPA) would require: 1. Maps Natural Language to Protocol Parameters: Use LLMs to extract structured information (parameters) from unstructured agent messages or user input. This should be quite straightforward for an LLM but the protocol may need semantic annotations to infer contexts from messages. 2. Enforces Protocol Semantics: The layer checks that the information dependencies and causality constraints of the BSPL protocol are respected, ensuring agents only send messages when required inputs are available. Again, this could be difficult to assure for every LLM on the market if the protocol is too complex. 3. Handles Meaning and Commitments: LLMs can interpret or generate explanations of the protocol’s business meaning, commitments, or intentions, providing transparency and facilitating negotiation or clarification between agents. This is the main advantage of using NL-based systems and also what makes their leverage on software so convenient. 4. Supports Protocol Composition: For more complex interactions, the layer can use LLM reasoning to compose or decompose protocols dynamically, this may happen at the machine readable level or at the NL level (or it is possible to decide they should happen at one and only level to avoid mismatch in translations). No.2 is the most challenging in my opinion considering all the challenges already evident in alignments for the many LLMs on the market. Hope these can help the discussion. On Sun, Jul 6, 2025, 22:50 Amit Chopra <akchopra.mail@gmail.com> wrote: > Dear all > > It's great to see interest in applying approaches developed in the > multiagent systems (MAS) community toward building Agentic systems. > > My colleagues (Munindar Singh, Samuel Christie, and Matteo Baldoni) and I > have been working on approaches for specifying interaction protocols > between agents. Our approaches are formal and declarative; support > interaction meaning (which facilitates intelligent decision making by > agents); and enable realizing loosely-coupled, decentralized systems of > asynchronously communicating agents. Moreover, our approaches support > maximally flexible interactions between agents. These features make our > approach, which we call Interaction-Oriented Programming (IOP), ideally > suited to the Agentic paradigm. > > Below are some papers describing our approach. > > 1. (AAMAS) The BSPL Protocol language: > https://www.csc2.ncsu.edu/faculty/mpsingh/papers/mas/AAMAS-11-IBIOP.pdf > 2. (AAMAS) BSPL Semantics and Verification: > https://www.csc2.ncsu.edu/faculty/mpsingh/papers/mas/AAMAS-12-BSPL.pdf > 3. (Services Computing) Methodology for specfiying protocols: > https://www.csc2.ncsu.edu/faculty/mpsingh/papers/mas/SCC-14-Bliss.pdf > <https://www.csc2.ncsu.edu/faculty/mpsingh/papers/mas/SCC-14-Bliss..pdf> > 4. (JAIR) Advantage of our approach over alternative protocol > specification approaches, both formal and informal: > https://www.lancaster.ac.uk/staff/chopraak/pdfs/langeval..pdf > <https://www.lancaster.ac.uk/staff/chopraak/pdfs/langeval.pdf> > 5. (AAMAS) A Python programming model for BSPL: > https://www.lancaster.ac.uk/staff/chopraak/pdfs/Kiko.pdf > 6. (JAAMAS) A programming model for fault tolerance: > https://www.lancaster.ac.uk/staff/chopraak/pdfs/mandrake.pdf > 7. (IJCAI) Efficient verification: > https://www.csc2.ncsu.edu/faculty/mpsingh/papers/mas/IJCAI-21-Tango.pdf > 8. (AAAI) A belief-desire-intention programming model for BSPL: > https://www.lancaster.ac.uk/staff/chopraak/pdfs/orpheus.pdf > 9. (AAMAS) Meaning-based programming model: > https://www.lancaster.ac.uk/staff/chopraak/pdfs/azorus.pdf > 10. (IJCAI) Langshaw, an even higher-level protocol language that compiles > into BSPL: https://www.lancaster.ac.uk/staff/chopraak/pdfs/langshaw.pdf > > There's a lot more here: https://www.lancaster.ac.uk/staff/chopraak/ and > even more here: https://www.csc2.ncsu.edu/faculty/mpsingh/papers/ > > Our ever-growing software repository is available here: > https://gitlab.com/masr > > FIPA standards and KQML are unsuited to engineering multiagent systems. > FIPA ACL's and KQML's semantics are ill-conceived. FIPA Interaction > Protocols capture only a handful of interaction patterns via informal > notations such as UML. These shortcomings are well-known in the MAS > community. For more details, see > https://www.csc2.ncsu.edu/faculty/mpsingh/papers/mas/computer-acl-98.pdf > and https://www.lancaster.ac.uk/staff/chopraak/pdfs/ac-directions-2013.pdf > (especially Singh's on page 15). IOP addresses the shortcomings of the > FIPA standards and KQML. > > I hope my post leads to a more informed discussion of agent communication > approaches. As we seek to establish the relevance of multiagent systems > work for Agentic, let us not repeat the mistakes of the past. > > Best > Amit Chopra > Lorenzo Moriondo ロレンツォ・モリオンドオ https://linkedin.com/in/lorenzomoriondo
Received on Monday, 7 July 2025 11:19:27 UTC